Feb 27 01:16:52 devstack cinder-volume[73245]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=73245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Feb 27 01:16:52 devstack cinder-volume[73245]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=73245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Feb 27 01:16:52 devstack cinder-volume[73245]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=73245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Feb 27 01:16:53 devstack cinder-volume[73245]: INFO dbcounter [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] Registered counter for database cinder
Feb 27 01:16:53 devstack cinder-volume[73245]: DEBUG oslo_db.sqlalchemy.engines [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73245) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Feb 27 01:16:53 devstack cinder-volume[73245]: DEBUG dbcounter [-] [73245] Writer thread running {{(pid=73245) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Feb 27 01:16:53 devstack cinder-volume[73245]: INFO cinder.rpc [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Feb 27 01:16:53 devstack cinder-volume[73245]: INFO cinder.rpc [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Feb 27 01:16:53 devstack cinder-volume[73245]: DEBUG oslo_db.sqlalchemy.engines [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73245) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Feb 27 01:16:53 devstack cinder-volume[73245]: INFO cinder.volume.manager [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] Determined volume DB was empty at startup.
Feb 27 01:16:53 devstack cinder-volume[73245]: DEBUG cinder.volume.manager [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=73245) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Feb 27 01:16:53 devstack cinder-volume[73245]: INFO cinder.volume.manager [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] Service not found for updating active_backend_id, assuming default for driver init.
Feb 27 01:16:53 devstack cinder-volume[73245]: WARNING stevedore.named [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Feb 27 01:16:53 devstack cinder-volume[73245]: WARNING castellan.key_manager [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Feb 27 01:16:53 devstack cinder-volume[73245]: WARNING cinder.keymgr.conf_key_mgr [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Feb 27 01:16:53 devstack cinder-volume[73245]: DEBUG cinder.volume.drivers.lvm [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=73245) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Feb 27 01:16:53 devstack cinder-volume[73245]: DEBUG oslo_concurrency.processutils [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=73245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_concurrency.processutils [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] CMD "cinder-rtstool verify" returned: 0 in 0.248s {{(pid=73245) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_db.sqlalchemy.engines [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73245) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Feb 27 01:16:54 devstack cinder-volume[73245]: INFO cinder.rpc [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Feb 27 01:16:54 devstack cinder-volume[73245]: INFO cinder.rpc [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Feb 27 01:16:54 devstack cinder-volume[73245]: WARNING stevedore.named [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Feb 27 01:16:54 devstack cinder-volume[73245]: WARNING castellan.key_manager [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Feb 27 01:16:54 devstack cinder-volume[73245]: INFO cinder.volume.manager [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_db.sqlalchemy.engines [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73245) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Feb 27 01:16:54 devstack cinder-volume[73245]: INFO oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] Starting 1 workers
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] Started child 73345 {{(pid=73245) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] Full set of CONF: {{(pid=73245) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] ******************************************************************************** {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] Configuration options gathered from: {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Feb 27 01:16:54 devstack cinder-volume[73345]: INFO cinder.service [-] Starting cinder-volume node (version 27.1.0)
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] ================================================================================ {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] allow_availability_zone_fallback = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] allow_compression_on_image_upload = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] allowed_direct_url_schemes     = [] {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] api_rate_limit                 = True {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] auth_strategy                  = keystone {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] az_cache_duration              = 3600 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_availability_zone      = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_host                   = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_name                   = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_stats_polling_interval = 60 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backup_api_class               = cinder.backup.api.API {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backup_name_template           = backup-%s {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backup_use_same_host           = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backup_use_temp_snapshot       = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] chap_password                  = **** {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] chap_username                  =  {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] cinder_internal_tenant_project_id = 76e1995cdf07490b8434036f7148770d {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] cinder_internal_tenant_user_id = 0df49f0d095147b7aba255d44f4dec4b {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] cloned_volume_same_az          = True {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] cluster                        = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] compression_format             = gzip {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] compute_api_class              = cinder.compute.nova.API {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] config_dir                     = [] {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] config_source                  = [] {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] control_exchange               = openstack {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] debug                          = True {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] default_availability_zone      = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] default_group_type             = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] default_volume_type            = lvmdriver-1 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] disk_geometry                  = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] driver_client_cert             = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] driver_client_cert_key         = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] driver_data_namespace          = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] driver_ssl_cert_path           = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] driver_ssl_cert_verify         = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] driver_use_ssl                 = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] enable_force_upload            = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] enable_new_services            = True {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] enable_unsupported_driver      = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] enforce_multipath_for_image_xfer = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] filter_function                = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] glance_api_insecure            = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] glance_api_servers             = ['http://192.168.122.57/image'] {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] glance_api_ssl_compression     = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] glance_ca_certificates_file    = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] glance_catalog_info            = image:glance:publicURL {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] glance_certfile                = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] glance_keyfile                 = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] glance_num_retries             = 3 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] glance_request_timeout         = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] goodness_function              = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] graceful_shutdown_timeout      = 5 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] group_api_class                = cinder.group.api.API {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] host                           = devstack {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] image_compress_on_upload       = True {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73345]: INFO cinder.volume.manager [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] Starting volume driver LVMVolumeDriver (3.0.0)
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] image_conversion_address_space_limit = 1 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] image_conversion_cpu_limit     = 60 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] image_conversion_disable       = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] image_upload_use_cinder_backend = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] image_upload_use_internal_tenant = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] image_volume_cache_enabled     = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] image_volume_cache_max_count   = 0 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] image_volume_cache_max_size_gb = 0 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] init_host_max_objects_retrieval = 0 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] instance_format                = [instance: %(uuid)s]  {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] iscsi_target_flags             =  {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] iscsi_write_cache              = on {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] iser_helper                    = tgtadm {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] iser_ip_address                = 192.168.122.57 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] iser_port                      = 3260 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] log_color                      = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] log_config_append              = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] log_dir                        = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] log_file                       = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] log_options                    = True {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] log_rotate_interval            = 1 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] log_rotate_interval_type       = days {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] log_rotation_type              = none {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] max_age                        = 0 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] max_logfile_count              = 30 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] max_logfile_size_mb            = 200 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] max_over_subscription_ratio    = 20.0 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] message_reap_interval          = 86400 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] message_ttl                    = 2592000 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] migration_create_volume_timeout_secs = 300 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] monkey_patch                   = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] monkey_patch_modules           = [] {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] my_ip                          = 192.168.122.57 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] no_snapshot_gb_quota           = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] num_iser_scan_tries            = 3 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] num_shell_tries                = 3 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] num_volume_device_scan_tries   = 3 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] nvmeof_conn_info_version       = 1 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] nvmet_ns_id                    = 10 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] nvmet_port_id                  = 1 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] osapi_max_limit                = 1000 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] osapi_volume_ext_list          = [] {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] osapi_volume_listen_port       = 8776 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] osapi_volume_use_ssl           = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] osapi_volume_workers           = 2 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] per_volume_size_limit          = -1 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] periodic_fuzzy_delay           = 60 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] periodic_interval              = 60 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] public_endpoint                = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] publish_errors                 = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] quota_backup_gigabytes         = 1000 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] quota_backups                  = 10 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] quota_gigabytes                = 1000 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] quota_groups                   = 10 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] quota_snapshots                = 10 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] quota_volumes                  = 10 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] rate_limit_burst               = 0 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] rate_limit_except_level        = CRITICAL {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] rate_limit_interval            = 0 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] reinit_driver_count            = 3 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] replication_device             = **** {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] report_discard_supported       = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] report_interval                = 120 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] reservation_clean_interval     = 86400 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] reservation_expire             = 86400 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] reserved_image_namespaces      = [] {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] reserved_percentage            = 0 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] rpc_response_timeout           = 120 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] run_external_periodic_tasks    = True {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] scst_target_driver             = iscsi {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] scst_target_iqn_name           = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] service_down_time              = 720 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] shell_completion               = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] snapshot_name_template         = snapshot-%s {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] snapshot_same_host             = True {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] split_loggers                  = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] state_path                     = /opt/stack/data/cinder {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] storage_availability_zone      = nova {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] storage_protocol               = iSCSI {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] syslog_log_facility            = LOG_USER {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] target_helper                  = lioadm {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] target_ip_address              = 192.168.122.57 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] target_port                    = 3260 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] target_protocol                = iscsi {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] target_secondary_ip_addresses  = [] {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] trace_flags                    = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] transport_url                  = **** {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] until_refresh                  = 0 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] use_chap_auth                  = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] use_default_quota_class        = True {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] use_journal                    = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] use_json                       = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] use_multipath_for_image_xfer   = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] use_stderr                     = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] use_syslog                     = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] verify_glance_signatures       = enabled {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] volume_api_class               = cinder.volume.api.API {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] volume_backend_name            = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.011s {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] volume_clear                   = zero {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] volume_clear_ionice            = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] volume_clear_size              = 0 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] volume_copy_bps_limit          = 0 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] volume_dd_blocksize            = 1M {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] volume_name_template           = volume-%s {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] volume_service_inithost_offload = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] volume_usage_audit_period      = month {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] zoning_mode                    = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] oslo_concurrency.disable_process_locking = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] keystone_authtoken.admin_password = **** {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] keystone_authtoken.admin_token = **** {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] keystone_authtoken.admin_user  = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] keystone_authtoken.auth_port   = 35357 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] keystone_authtoken.auth_protocol = https {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] keystone_authtoken.auth_section = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.010s {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] keystone_authtoken.auth_type   = password {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] keystone_authtoken.auth_uri    = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] keystone_authtoken.auth_version = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] keystone_authtoken.cache       = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] keystone_authtoken.certfile    = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] keystone_authtoken.delay_auth_decision = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] keystone_authtoken.http_connect_timeout = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] keystone_authtoken.identity_uri = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] keystone_authtoken.include_service_catalog = True {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] keystone_authtoken.insecure    = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] keystone_authtoken.interface   = public {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] keystone_authtoken.keyfile     = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] keystone_authtoken.memcache_password =  {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] keystone_authtoken.memcache_username =  {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] keystone_authtoken.region_name = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] keystone_authtoken.service_token_roles_required = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] keystone_authtoken.service_type = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] keystone_authtoken.token_cache_time = 300 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.57/identity {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] cache.backend                  = dogpile.cache.null {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] cache.backend_argument         = **** {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] cache.backend_expiration_time  = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] cache.config_prefix            = cache.oslo {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] cache.debug_cache_backend      = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack sudo[73349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] cache.enable_retry_client      = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] cache.enable_socket_keepalive  = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack sudo[73349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] cache.enabled                  = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] cache.enforce_fips_mode        = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] cache.expiration_time          = 600 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] cache.hashclient_retry_attempts = 2 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] cache.memcache_dead_retry      = 300 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] cache.memcache_pool_maxsize    = 10 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] cache.memcache_sasl_enabled    = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] cache.password                 = **** {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] cache.proxies                  = [] {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] cache.redis_db                 = 0 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] cache.redis_sentinel_service_name = mymaster {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] cache.redis_server             = localhost:6379 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] cache.retry_attempts           = 2 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] cache.retry_delay              = 0.0 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] cache.socket_keepalive_count   = 1 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] cache.socket_keepalive_idle    = 1 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] cache.socket_keepalive_interval = 1 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] cache.socket_timeout           = 1.0 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] cache.tls_allowed_ciphers      = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] cache.tls_cafile               = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] cache.tls_certfile             = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] cache.tls_enabled              = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] cache.tls_keyfile              = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] cache.username                 = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] coordination.backend_url       = **** {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] database.asyncio_connection    = **** {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] database.asyncio_slave_connection = **** {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] database.backend               = sqlalchemy {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] database.connection            = **** {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] database.connection_debug      = 0 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] database.connection_parameters =  {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] database.connection_recycle_time = 3600 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] database.connection_trace      = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] database.db_inc_retry_interval = True {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] database.db_max_retries        = 20 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] database.db_max_retry_interval = 10 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] database.db_retry_interval     = 1 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] database.max_overflow          = 50 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] database.max_pool_size         = 5 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] database.max_retries           = 10 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] database.mysql_wsrep_sync_wait = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] database.pool_timeout          = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] database.retry_interval        = 10 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] database.slave_connection      = **** {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] database.sqlite_synchronous    = True {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] database.synchronous_reader    = True {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] database.use_db_reconnect      = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] profiler.connection_string     = messaging:// {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] profiler.enabled               = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] profiler.es_doc_type           = notification {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] profiler.es_scroll_size        = 10000 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] profiler.es_scroll_time        = 2m {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] profiler.filter_error_trace    = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] profiler.hmac_keys             = **** {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] profiler.sentinel_service_name = mymaster {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] profiler.socket_timeout        = 0.1 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] profiler.trace_requests        = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] profiler.trace_sqlalchemy      = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] profiler_jaeger.process_tags   = {} {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] profiler_jaeger.service_name_prefix = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] profiler_otlp.service_name_prefix = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] oslo_policy.enforce_new_defaults = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: WARNING oslo_config.cfg [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] oslo_policy.enforce_scope      = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] oslo_policy.policy_default_rule = default {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] oslo_policy.policy_file        = policy.yaml {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] privsep_osbrick.group          = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] privsep_osbrick.helper_command = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] privsep_osbrick.user           = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] cinder_sys_admin.group         = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] cinder_sys_admin.helper_command = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] cinder_sys_admin.user          = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] service_user.auth_section      = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] service_user.auth_type         = password {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] service_user.cafile            = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] service_user.certfile          = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] service_user.collect_timing    = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] service_user.insecure          = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] service_user.keyfile           = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] service_user.send_service_user_token = True {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] service_user.split_loggers     = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] service_user.timeout           = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] glance.auth_section            = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] glance.auth_type               = password {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] glance.certfile                = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] glance.collect_timing          = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] glance.insecure                = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] glance.keyfile                 = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] glance.region_name             = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] glance.split_loggers           = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] glance.timeout                 = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_defaults.backend_availability_zone = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_defaults.chap_password = **** {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_defaults.chap_username =  {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_defaults.disk_geometry = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_defaults.driver_client_cert = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_defaults.driver_client_cert_key = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_defaults.driver_data_namespace = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_defaults.driver_use_ssl = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_defaults.enable_unsupported_driver = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_defaults.extra_capabilities = {} {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_defaults.filter_function = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_defaults.goodness_function = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_defaults.iscsi_target_flags =  {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_defaults.iscsi_write_cache = on {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_defaults.iser_helper   = tgtadm {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_defaults.iser_ip_address = 192.168.122.57 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_defaults.iser_port     = 3260 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_defaults.lvm_share_target = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_defaults.lvm_type      = auto {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_defaults.num_shell_tries = 3 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_defaults.nvmet_port_id = 1 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_defaults.replication_device = **** {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_defaults.report_discard_supported = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_defaults.reserved_percentage = 0 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_defaults.scst_target_driver = iscsi {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_defaults.scst_target_iqn_name = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_defaults.storage_protocol = iSCSI {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_defaults.target_helper = tgtadm {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_defaults.target_ip_address = 192.168.122.57 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_defaults.target_port   = 3260 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_defaults.target_protocol = iscsi {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_defaults.trace_flags   = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_defaults.unique_fqdn_network = True {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_defaults.use_chap_auth = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_defaults.volume_backend_name = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_defaults.volume_clear  = zero {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_defaults.volume_clear_ionice = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_defaults.volume_clear_size = 0 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] oslo_reports.file_event_handler = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] oslo_reports.log_dir           = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] lvmdriver-1.backend_availability_zone = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] lvmdriver-1.backend_host       = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] lvmdriver-1.chap_password      = **** {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] lvmdriver-1.chap_username      = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] lvmdriver-1.disk_geometry      = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] lvmdriver-1.driver_client_cert = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] lvmdriver-1.driver_data_namespace = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] lvmdriver-1.extra_capabilities = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] lvmdriver-1.filter_function    = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] lvmdriver-1.goodness_function  = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] lvmdriver-1.iser_helper        = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] lvmdriver-1.iser_ip_address    = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] lvmdriver-1.iser_port          = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] lvmdriver-1.iser_target_prefix = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] lvmdriver-1.lvm_share_target   = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] lvmdriver-1.lvm_type           = auto {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] lvmdriver-1.num_shell_tries    = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] lvmdriver-1.replication_device = **** {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] lvmdriver-1.report_discard_supported = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] lvmdriver-1.reserved_percentage = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] lvmdriver-1.scst_target_driver = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] lvmdriver-1.storage_protocol   = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] lvmdriver-1.target_helper      = lioadm {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] lvmdriver-1.target_ip_address  = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] lvmdriver-1.target_port        = 3260 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] lvmdriver-1.trace_flags        = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] lvmdriver-1.use_chap_auth      = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] lvmdriver-1.volume_clear       = zero {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] lvmdriver-1.volume_clear_size  = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] lvmdriver-1.volumes_dir        = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] oslo_messaging_rabbit.ssl      = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] oslo_messaging_notifications.driver = [] {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] oslo_messaging_notifications.retry = -1 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] oslo_messaging_notifications.transport_url = **** {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] key_manager.fixed_key          = **** {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] barbican.barbican_api_version  = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] barbican.barbican_endpoint     = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] barbican.barbican_endpoint_type = public {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] barbican.barbican_region_name  = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] barbican.cafile                = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] barbican.certfile              = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] barbican.collect_timing        = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] barbican.insecure              = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] barbican.keyfile               = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] barbican.number_of_retries     = 60 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] barbican.retry_delay           = 1 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] barbican.send_service_user_token = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] barbican.split_loggers         = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] barbican.timeout               = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] barbican.verify_ssl            = True {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] barbican.verify_ssl_path       = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] barbican_service_user.auth_section = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] barbican_service_user.auth_type = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] barbican_service_user.cafile   = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] barbican_service_user.certfile = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] barbican_service_user.collect_timing = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] barbican_service_user.insecure = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] barbican_service_user.keyfile  = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] barbican_service_user.split_loggers = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] barbican_service_user.timeout  = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] vault.approle_role_id          = **** {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] vault.approle_secret_id        = **** {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] vault.kv_mountpoint            = secret {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] vault.kv_path                  = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] vault.kv_version               = 2 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] vault.namespace                = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] vault.root_token_id            = **** {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] vault.ssl_ca_crt_file          = None {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] vault.timeout                  = 60.0 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] vault.use_ssl                  = False {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:16:54 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] ******************************************************************************** {{(pid=73245) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Feb 27 01:16:54 devstack sudo[73349]: pam_unix(sudo:session): session closed for user root
Feb 27 01:16:54 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.498s {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:16:54 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:16:54 devstack sudo[73358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Feb 27 01:16:54 devstack sudo[73358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:16:55 devstack sudo[73358]: pam_unix(sudo:session): session closed for user root
Feb 27 01:16:55 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.544s {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:16:55 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 27 01:16:55 devstack cinder-volume[73345]: INFO cinder.brick.local_dev.lvm [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Feb 27 01:16:55 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:16:55 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:16:55 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:16:55 devstack sudo[73462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Feb 27 01:16:55 devstack sudo[73462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:16:55 devstack sudo[73462]: pam_unix(sudo:session): session closed for user root
Feb 27 01:16:55 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.556s {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:16:55 devstack cinder-volume[73345]: DEBUG cinder.brick.local_dev.lvm [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=73345) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Feb 27 01:16:55 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:16:55 devstack sudo[73693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Feb 27 01:16:55 devstack sudo[73693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:16:56 devstack sudo[73693]: pam_unix(sudo:session): session closed for user root
Feb 27 01:16:56 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.002s {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:16:56 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:16:56 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.012s {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:16:56 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:16:56 devstack sudo[73983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Feb 27 01:16:56 devstack sudo[73983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:16:57 devstack sudo[73983]: pam_unix(sudo:session): session closed for user root
Feb 27 01:16:57 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.520s {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:16:57 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:16:57 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:16:57 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:16:57 devstack sudo[74060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Feb 27 01:16:57 devstack sudo[74060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:16:57 devstack sudo[74060]: pam_unix(sudo:session): session closed for user root
Feb 27 01:16:57 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.487s {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:16:57 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:16:57 devstack sudo[74075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Feb 27 01:16:57 devstack sudo[74075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:16:58 devstack sudo[74075]: pam_unix(sudo:session): session closed for user root
Feb 27 01:16:58 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.516s {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:16:58 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:16:58 devstack sudo[74078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Feb 27 01:16:58 devstack sudo[74078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:16:58 devstack sudo[74078]: pam_unix(sudo:session): session closed for user root
Feb 27 01:16:58 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.495s {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:16:58 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:16:58 devstack sudo[74086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Feb 27 01:16:58 devstack sudo[74086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:16:59 devstack sudo[74086]: pam_unix(sudo:session): session closed for user root
Feb 27 01:16:59 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.540s {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:16:59 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:16:59 devstack sudo[74091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Feb 27 01:16:59 devstack sudo[74091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:16:59 devstack sudo[74091]: pam_unix(sudo:session): session closed for user root
Feb 27 01:16:59 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.433s {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:16:59 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:16:59 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:16:59 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:16:59 devstack sudo[74096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Feb 27 01:16:59 devstack sudo[74096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:17:00 devstack sudo[74096]: pam_unix(sudo:session): session closed for user root
Feb 27 01:17:00 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.442s {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:17:00 devstack cinder-volume[73345]: INFO cinder.volume.drivers.lvm [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] Enabling LVM thin provisioning by default because a thin pool exists.
Feb 27 01:17:00 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:17:00 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:17:00 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:17:00 devstack sudo[74106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Feb 27 01:17:00 devstack sudo[74106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:17:00 devstack sudo[74106]: pam_unix(sudo:session): session closed for user root
Feb 27 01:17:00 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.466s {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:17:00 devstack cinder-volume[73345]: DEBUG cinder.volume.drivers.lvm [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] Updating volume stats {{(pid=73345) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Feb 27 01:17:00 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:17:00 devstack sudo[74118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Feb 27 01:17:00 devstack sudo[74118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:17:01 devstack sudo[74118]: pam_unix(sudo:session): session closed for user root
Feb 27 01:17:01 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.539s {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:17:01 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:17:01 devstack sudo[74233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Feb 27 01:17:01 devstack sudo[74233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:17:01 devstack sudo[74233]: pam_unix(sudo:session): session closed for user root
Feb 27 01:17:01 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.455s {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:17:01 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:17:01 devstack sudo[74371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Feb 27 01:17:01 devstack sudo[74371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:17:02 devstack sudo[74371]: pam_unix(sudo:session): session closed for user root
Feb 27 01:17:02 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.440s {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:17:02 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:17:02 devstack sudo[74375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Feb 27 01:17:02 devstack sudo[74375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:17:02 devstack sudo[74375]: pam_unix(sudo:session): session closed for user root
Feb 27 01:17:02 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.417s {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:17:02 devstack cinder-volume[73345]: INFO cinder.volume.driver [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] Driver hasn't implemented _init_vendor_properties()
Feb 27 01:17:02 devstack cinder-volume[73345]: DEBUG cinder.volume.driver [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=73345) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Feb 27 01:17:02 devstack cinder-volume[73345]: DEBUG oslo_db.sqlalchemy.engines [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73345) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Feb 27 01:17:02 devstack cinder-volume[73345]: DEBUG dbcounter [-] [73345] Writer thread running {{(pid=73345) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Feb 27 01:17:02 devstack cinder-volume[73345]: DEBUG cinder.db.sqlalchemy.api [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] Building query based on filter {{(pid=73345) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Feb 27 01:17:02 devstack cinder-volume[73345]: DEBUG cinder.image.image_utils [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=73345) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Feb 27 01:17:02 devstack cinder-volume[73345]: INFO cinder.keymgr.migration [None req-d6e09b0f-3d00-4c83-95d0-edfa4e5bd286 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Feb 27 01:17:02 devstack cinder-volume[73345]: DEBUG cinder.volume.drivers.lvm [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] Updating volume stats {{(pid=73345) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Feb 27 01:17:02 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:17:02 devstack sudo[74383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Feb 27 01:17:02 devstack sudo[74383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:17:03 devstack sudo[74383]: pam_unix(sudo:session): session closed for user root
Feb 27 01:17:03 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.422s {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:17:03 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:17:03 devstack sudo[74386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Feb 27 01:17:03 devstack sudo[74386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:17:03 devstack sudo[74386]: pam_unix(sudo:session): session closed for user root
Feb 27 01:17:03 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.461s {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:17:03 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:17:03 devstack sudo[74391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Feb 27 01:17:03 devstack sudo[74391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:17:04 devstack sudo[74391]: pam_unix(sudo:session): session closed for user root
Feb 27 01:17:04 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.470s {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:17:04 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:17:04 devstack cinder-volume[73245]: DEBUG dbcounter [-] [73245] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=73245) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 01:17:04 devstack sudo[74395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Feb 27 01:17:04 devstack sudo[74395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:17:04 devstack sudo[74395]: pam_unix(sudo:session): session closed for user root
Feb 27 01:17:04 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.465s {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:17:04 devstack cinder-volume[73345]: DEBUG cinder.manager [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] Notifying Schedulers of capabilities ... {{(pid=73345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:17:04 devstack cinder-volume[73345]: INFO cinder.volume.manager [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] Driver initialization completed successfully.
Feb 27 01:17:04 devstack cinder-volume[73345]: INFO cinder.manager [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] Initiating service 2 cleanup
Feb 27 01:17:04 devstack cinder-volume[73345]: INFO cinder.manager [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] Service 2 cleanup completed.
Feb 27 01:17:04 devstack cinder-volume[73345]: DEBUG cinder.service [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] Creating RPC server for service cinder-volume {{(pid=73345) start /opt/stack/cinder/cinder/service.py:231}}
Feb 27 01:17:04 devstack cinder-volume[73345]: DEBUG cinder.service [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=73345) start /opt/stack/cinder/cinder/service.py:237}}
Feb 27 01:17:04 devstack cinder-volume[73345]: INFO cinder.volume.manager [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Feb 27 01:17:04 devstack cinder-volume[73345]: DEBUG cinder.volume.drivers.lvm [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] Updating volume stats {{(pid=73345) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Feb 27 01:17:04 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:17:04 devstack sudo[74403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Feb 27 01:17:04 devstack sudo[74403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:17:05 devstack sudo[74403]: pam_unix(sudo:session): session closed for user root
Feb 27 01:17:05 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.552s {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:17:05 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:17:05 devstack sudo[74408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Feb 27 01:17:05 devstack sudo[74408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:17:05 devstack sudo[74408]: pam_unix(sudo:session): session closed for user root
Feb 27 01:17:05 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.553s {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:17:05 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:17:05 devstack sudo[74411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Feb 27 01:17:05 devstack sudo[74411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:17:06 devstack sudo[74411]: pam_unix(sudo:session): session closed for user root
Feb 27 01:17:06 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.501s {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:17:06 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:17:06 devstack sudo[74470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Feb 27 01:17:06 devstack sudo[74470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:17:06 devstack sudo[74470]: pam_unix(sudo:session): session closed for user root
Feb 27 01:17:06 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.435s {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:17:06 devstack cinder-volume[73345]: INFO cinder.volume.manager [None req-e26358d1-dd2b-48c1-bc0d-8da4aa2df8fc None None] Driver post RPC initialization completed successfully.
Feb 27 01:17:14 devstack cinder-volume[73345]: DEBUG dbcounter [-] [73345] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=73345) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 01:17:16 devstack cinder-volume[73345]: DEBUG dbcounter [-] [73345] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=73345) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 01:17:58 devstack cinder-volume[73345]: DEBUG oslo_service.periodic_task [None req-0734cc6d-46d6-403b-a0cc-c8dc77e81f58 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73345) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Feb 27 01:17:58 devstack cinder-volume[73345]: DEBUG cinder.volume.drivers.lvm [None req-0734cc6d-46d6-403b-a0cc-c8dc77e81f58 None None] Updating volume stats {{(pid=73345) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Feb 27 01:17:58 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-0734cc6d-46d6-403b-a0cc-c8dc77e81f58 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:17:58 devstack sudo[76845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Feb 27 01:17:58 devstack sudo[76845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:17:59 devstack sudo[76845]: pam_unix(sudo:session): session closed for user root
Feb 27 01:17:59 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-0734cc6d-46d6-403b-a0cc-c8dc77e81f58 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.454s {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:17:59 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-0734cc6d-46d6-403b-a0cc-c8dc77e81f58 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:17:59 devstack sudo[76848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Feb 27 01:17:59 devstack sudo[76848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:17:59 devstack sudo[76848]: pam_unix(sudo:session): session closed for user root
Feb 27 01:17:59 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-0734cc6d-46d6-403b-a0cc-c8dc77e81f58 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.431s {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:17:59 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-0734cc6d-46d6-403b-a0cc-c8dc77e81f58 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:17:59 devstack sudo[76851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Feb 27 01:17:59 devstack sudo[76851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:18:00 devstack sudo[76851]: pam_unix(sudo:session): session closed for user root
Feb 27 01:18:00 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-0734cc6d-46d6-403b-a0cc-c8dc77e81f58 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.500s {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:18:00 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-0734cc6d-46d6-403b-a0cc-c8dc77e81f58 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:18:00 devstack sudo[76854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Feb 27 01:18:00 devstack sudo[76854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:18:00 devstack sudo[76854]: pam_unix(sudo:session): session closed for user root
Feb 27 01:18:00 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-0734cc6d-46d6-403b-a0cc-c8dc77e81f58 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.444s {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:18:00 devstack cinder-volume[73345]: DEBUG cinder.manager [None req-0734cc6d-46d6-403b-a0cc-c8dc77e81f58 None None] Notifying Schedulers of capabilities ... {{(pid=73345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:18:58 devstack cinder-volume[73345]: DEBUG oslo_service.periodic_task [None req-0734cc6d-46d6-403b-a0cc-c8dc77e81f58 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73345) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Feb 27 01:18:58 devstack cinder-volume[73345]: DEBUG cinder.volume.drivers.lvm [None req-0734cc6d-46d6-403b-a0cc-c8dc77e81f58 None None] Updating volume stats {{(pid=73345) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Feb 27 01:18:58 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-0734cc6d-46d6-403b-a0cc-c8dc77e81f58 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:18:58 devstack sudo[79670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Feb 27 01:18:58 devstack sudo[79670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:18:59 devstack sudo[79670]: pam_unix(sudo:session): session closed for user root
Feb 27 01:18:59 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-0734cc6d-46d6-403b-a0cc-c8dc77e81f58 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.484s {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:18:59 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-0734cc6d-46d6-403b-a0cc-c8dc77e81f58 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:18:59 devstack sudo[79674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Feb 27 01:18:59 devstack sudo[79674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:18:59 devstack sudo[79674]: pam_unix(sudo:session): session closed for user root
Feb 27 01:18:59 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-0734cc6d-46d6-403b-a0cc-c8dc77e81f58 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.522s {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:18:59 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-0734cc6d-46d6-403b-a0cc-c8dc77e81f58 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:18:59 devstack sudo[79678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Feb 27 01:18:59 devstack sudo[79678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:19:00 devstack sudo[79678]: pam_unix(sudo:session): session closed for user root
Feb 27 01:19:00 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-0734cc6d-46d6-403b-a0cc-c8dc77e81f58 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.458s {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:19:00 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-0734cc6d-46d6-403b-a0cc-c8dc77e81f58 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:19:00 devstack sudo[79690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Feb 27 01:19:00 devstack sudo[79690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:19:00 devstack sudo[79690]: pam_unix(sudo:session): session closed for user root
Feb 27 01:19:00 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-0734cc6d-46d6-403b-a0cc-c8dc77e81f58 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.459s {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:19:00 devstack cinder-volume[73345]: DEBUG cinder.manager [None req-0734cc6d-46d6-403b-a0cc-c8dc77e81f58 None None] Notifying Schedulers of capabilities ... {{(pid=73345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:19:16 devstack cinder-volume[73345]: DEBUG dbcounter [-] [73345] Writing DB stats cinder:SELECT=1 {{(pid=73345) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 01:19:16 devstack cinder-volume[73345]: DEBUG dbcounter [-] [73345] Writing DB stats cinder:UPDATE=1 {{(pid=73345) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 01:19:58 devstack cinder-volume[73345]: DEBUG oslo_service.periodic_task [None req-0734cc6d-46d6-403b-a0cc-c8dc77e81f58 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73345) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Feb 27 01:19:58 devstack cinder-volume[73345]: DEBUG cinder.volume.drivers.lvm [None req-0734cc6d-46d6-403b-a0cc-c8dc77e81f58 None None] Updating volume stats {{(pid=73345) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Feb 27 01:19:58 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-0734cc6d-46d6-403b-a0cc-c8dc77e81f58 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:19:58 devstack sudo[81675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Feb 27 01:19:58 devstack sudo[81675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:19:59 devstack sudo[81675]: pam_unix(sudo:session): session closed for user root
Feb 27 01:19:59 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-0734cc6d-46d6-403b-a0cc-c8dc77e81f58 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.496s {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:19:59 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-0734cc6d-46d6-403b-a0cc-c8dc77e81f58 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:19:59 devstack sudo[81679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Feb 27 01:19:59 devstack sudo[81679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:19:59 devstack sudo[81679]: pam_unix(sudo:session): session closed for user root
Feb 27 01:19:59 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-0734cc6d-46d6-403b-a0cc-c8dc77e81f58 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.472s {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:19:59 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-0734cc6d-46d6-403b-a0cc-c8dc77e81f58 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:19:59 devstack sudo[81682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Feb 27 01:19:59 devstack sudo[81682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:20:00 devstack sudo[81682]: pam_unix(sudo:session): session closed for user root
Feb 27 01:20:00 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-0734cc6d-46d6-403b-a0cc-c8dc77e81f58 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.432s {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:20:00 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-0734cc6d-46d6-403b-a0cc-c8dc77e81f58 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:20:00 devstack sudo[81696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Feb 27 01:20:00 devstack sudo[81696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:20:00 devstack sudo[81696]: pam_unix(sudo:session): session closed for user root
Feb 27 01:20:00 devstack cinder-volume[73345]: DEBUG oslo_concurrency.processutils [None req-0734cc6d-46d6-403b-a0cc-c8dc77e81f58 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.426s {{(pid=73345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:20:00 devstack cinder-volume[73345]: DEBUG cinder.manager [None req-0734cc6d-46d6-403b-a0cc-c8dc77e81f58 None None] Notifying Schedulers of capabilities ... {{(pid=73345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:20:41 devstack cinder-volume[73245]: INFO oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] Caught SIGTERM, stopping children
Feb 27 01:20:41 devstack cinder-volume[73245]: DEBUG oslo_concurrency.lockutils [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] Acquiring lock "singleton_lock" {{(pid=73245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Feb 27 01:20:41 devstack cinder-volume[73245]: DEBUG oslo_concurrency.lockutils [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] Acquired lock "singleton_lock" {{(pid=73245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Feb 27 01:20:41 devstack cinder-volume[73245]: DEBUG oslo_concurrency.lockutils [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] Releasing lock "singleton_lock" {{(pid=73245) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Feb 27 01:20:41 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] Stop services. {{(pid=73245) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Feb 27 01:20:41 devstack cinder-volume[73245]: DEBUG oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] Killing children. {{(pid=73245) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Feb 27 01:20:41 devstack cinder-volume[73245]: INFO oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] Waiting on 1 children to exit
Feb 27 01:20:44 devstack cinder-volume[73345]: DEBUG oslo_concurrency.lockutils [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] Acquiring lock "singleton_lock" {{(pid=73345) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Feb 27 01:20:44 devstack cinder-volume[73345]: DEBUG oslo_concurrency.lockutils [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] Acquired lock "singleton_lock" {{(pid=73345) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Feb 27 01:20:44 devstack cinder-volume[73345]: DEBUG oslo_concurrency.lockutils [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] Releasing lock "singleton_lock" {{(pid=73345) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Feb 27 01:20:44 devstack cinder-volume[73345]: WARNING amqp [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Feb 27 01:20:44 devstack cinder-volume[73345]: WARNING amqp [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Feb 27 01:20:44 devstack cinder-volume[73245]: INFO oslo_service.backend._eventlet.service [None req-b6739072-dd6d-491d-acd4-ec0554fff236 None None] Child 73345 exited with status 0
Feb 27 01:20:47 devstack cinder-volume[82561]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82561) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Feb 27 01:20:47 devstack cinder-volume[82561]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82561) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Feb 27 01:20:47 devstack cinder-volume[82561]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82561) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Feb 27 01:20:47 devstack cinder-volume[82561]: INFO dbcounter [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] Registered counter for database cinder
Feb 27 01:20:47 devstack cinder-volume[82561]: DEBUG oslo_db.sqlalchemy.engines [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82561) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Feb 27 01:20:47 devstack cinder-volume[82561]: DEBUG dbcounter [-] [82561] Writer thread running {{(pid=82561) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Feb 27 01:20:47 devstack cinder-volume[82561]: INFO cinder.rpc [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Feb 27 01:20:47 devstack cinder-volume[82561]: INFO cinder.rpc [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Feb 27 01:20:47 devstack cinder-volume[82561]: DEBUG oslo_db.sqlalchemy.engines [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82561) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Feb 27 01:20:47 devstack cinder-volume[82561]: INFO cinder.volume.manager [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] Determined volume DB was empty at startup.
Feb 27 01:20:47 devstack cinder-volume[82561]: DEBUG cinder.volume.manager [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82561) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Feb 27 01:20:47 devstack cinder-volume[82561]: INFO cinder.volume.manager [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] Service not found for updating active_backend_id, assuming default for driver init.
Feb 27 01:20:47 devstack cinder-volume[82561]: WARNING stevedore.named [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Feb 27 01:20:47 devstack cinder-volume[82561]: WARNING castellan.key_manager [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Feb 27 01:20:47 devstack cinder-volume[82561]: WARNING cinder.keymgr.conf_key_mgr [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Feb 27 01:20:48 devstack cinder-volume[82561]: INFO cinder.volume.manager [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_db.sqlalchemy.engines [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82561) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Feb 27 01:20:48 devstack cinder-volume[82561]: INFO oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] Starting 1 workers
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] Started child 82679 {{(pid=82561) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] Full set of CONF: {{(pid=82561) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] ******************************************************************************** {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] Configuration options gathered from: {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] ================================================================================ {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] allow_availability_zone_fallback = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] allow_compression_on_image_upload = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] allowed_direct_url_schemes     = [] {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] api_rate_limit                 = True {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] auth_strategy                  = keystone {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_availability_zone      = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_host                   = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_name                   = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_stats_polling_interval = 60 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backup_api_class               = cinder.backup.api.API {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backup_name_template           = backup-%s {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backup_use_same_host           = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backup_use_temp_snapshot       = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] chap_password                  = **** {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82679]: INFO cinder.service [-] Starting cinder-volume node (version 27.1.0)
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] chap_username                  =  {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] cinder_internal_tenant_project_id = 76e1995cdf07490b8434036f7148770d {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] cinder_internal_tenant_user_id = 0df49f0d095147b7aba255d44f4dec4b {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] cluster                        = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] compression_format             = gzip {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] compute_api_class              = cinder.compute.nova.API {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] config_dir                     = [] {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] config_source                  = [] {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] control_exchange               = openstack {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] debug                          = True {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] default_availability_zone      = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] default_group_type             = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] default_volume_type            = QuobyteHD {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] disk_geometry                  = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] driver_client_cert             = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] driver_client_cert_key         = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] driver_data_namespace          = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] driver_ssl_cert_path           = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] driver_ssl_cert_verify         = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] driver_use_ssl                 = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] enable_new_services            = True {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] enable_unsupported_driver      = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] enabled_backends               = ['QuobyteHD'] {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] enforce_multipath_for_image_xfer = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] filter_function                = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] glance_api_insecure            = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] glance_api_servers             = ['http://192.168.122.57/image'] {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] glance_api_ssl_compression     = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] glance_ca_certificates_file    = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] glance_catalog_info            = image:glance:publicURL {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] glance_certfile                = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] glance_keyfile                 = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] glance_num_retries             = 3 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] glance_request_timeout         = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] goodness_function              = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] graceful_shutdown_timeout      = 5 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] group_api_class                = cinder.group.api.API {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] host                           = devstack {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] image_compress_on_upload       = True {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] image_conversion_address_space_limit = 1 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] image_conversion_cpu_limit     = 60 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] image_conversion_disable       = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] image_upload_use_cinder_backend = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] image_upload_use_internal_tenant = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] image_volume_cache_enabled     = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] image_volume_cache_max_count   = 0 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] image_volume_cache_max_size_gb = 0 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] init_host_max_objects_retrieval = 0 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] instance_format                = [instance: %(uuid)s]  {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] iscsi_target_flags             =  {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] iscsi_write_cache              = on {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] iser_helper                    = tgtadm {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] iser_ip_address                = 192.168.122.57 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] iser_port                      = 3260 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] log_color                      = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] log_config_append              = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] log_dir                        = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] log_file                       = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] log_options                    = True {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] log_rotate_interval            = 1 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] log_rotate_interval_type       = days {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] log_rotation_type              = none {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] max_age                        = 0 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] max_logfile_count              = 30 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] max_logfile_size_mb            = 200 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] max_over_subscription_ratio    = 20.0 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] message_reap_interval          = 86400 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] message_ttl                    = 2592000 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] migration_create_volume_timeout_secs = 300 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] monkey_patch                   = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] monkey_patch_modules           = [] {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] my_ip                          = 192.168.122.57 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] no_snapshot_gb_quota           = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] num_iser_scan_tries            = 3 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] num_shell_tries                = 3 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] num_volume_device_scan_tries   = 3 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] nvmeof_conn_info_version       = 1 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] nvmet_ns_id                    = 10 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] nvmet_port_id                  = 1 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] osapi_max_limit                = 1000 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] osapi_volume_ext_list          = [] {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] osapi_volume_listen_port       = 8776 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] osapi_volume_use_ssl           = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] osapi_volume_workers           = 2 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] per_volume_size_limit          = -1 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] periodic_fuzzy_delay           = 60 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] periodic_interval              = 60 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] public_endpoint                = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] publish_errors                 = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] quota_backup_gigabytes         = 1000 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] quota_backups                  = 10 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] quota_gigabytes                = 1000 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] quota_groups                   = 10 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] quota_snapshots                = 10 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] quota_volumes                  = 10 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] rate_limit_burst               = 0 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] rate_limit_except_level        = CRITICAL {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] rate_limit_interval            = 0 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] reinit_driver_count            = 3 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] replication_device             = **** {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] report_discard_supported       = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] report_interval                = 120 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] reservation_clean_interval     = 86400 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] reservation_expire             = 86400 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] reserved_image_namespaces      = [] {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] reserved_percentage            = 0 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] rpc_response_timeout           = 120 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] run_external_periodic_tasks    = True {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] scst_target_driver             = iscsi {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] scst_target_iqn_name           = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] service_down_time              = 720 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] shell_completion               = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] snapshot_name_template         = snapshot-%s {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] split_loggers                  = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] state_path                     = /opt/stack/data/cinder {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] storage_availability_zone      = nova {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] storage_protocol               = iSCSI {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] syslog_log_facility            = LOG_USER {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] target_helper                  = lioadm {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] target_ip_address              = 192.168.122.57 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] target_port                    = 3260 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] target_protocol                = iscsi {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] target_secondary_ip_addresses  = [] {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] trace_flags                    = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] transport_url                  = **** {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] until_refresh                  = 0 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] use_chap_auth                  = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] use_default_quota_class        = True {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] use_journal                    = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] use_json                       = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] use_multipath_for_image_xfer   = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] use_stderr                     = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] use_syslog                     = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] verify_glance_signatures       = enabled {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] volume_api_class               = cinder.volume.api.API {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] volume_backend_name            = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] volume_clear                   = zero {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] volume_clear_ionice            = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] volume_clear_size              = 0 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] volume_copy_bps_limit          = 0 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] volume_dd_blocksize            = 1M {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] volume_name_template           = volume-%s {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] volume_service_inithost_offload = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82679]: INFO cinder.volume.manager [None req-8f39dc93-c1d1-49de-8e6f-f52f0883b0e2 None None] Starting volume driver QuobyteDriver (1.1.14)
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] volume_usage_audit_period      = month {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82679]: DEBUG cinder.volume.drivers.remotefs [None req-8f39dc93-c1d1-49de-8e6f-f52f0883b0e2 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82679) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] zoning_mode                    = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] oslo_concurrency.disable_process_locking = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] keystone_authtoken.admin_password = **** {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] keystone_authtoken.admin_token = **** {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] keystone_authtoken.admin_user  = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] keystone_authtoken.auth_port   = 35357 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] keystone_authtoken.auth_protocol = https {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] keystone_authtoken.auth_section = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] keystone_authtoken.auth_type   = password {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] keystone_authtoken.auth_uri    = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] keystone_authtoken.auth_version = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] keystone_authtoken.cache       = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] keystone_authtoken.certfile    = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] keystone_authtoken.identity_uri = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] keystone_authtoken.include_service_catalog = True {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] keystone_authtoken.insecure    = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] keystone_authtoken.interface   = public {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] keystone_authtoken.keyfile     = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] keystone_authtoken.memcache_password =  {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] keystone_authtoken.memcache_username =  {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] keystone_authtoken.region_name = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] keystone_authtoken.service_type = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.57/identity {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] cache.backend                  = dogpile.cache.null {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] cache.backend_argument         = **** {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] cache.backend_expiration_time  = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] cache.config_prefix            = cache.oslo {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] cache.debug_cache_backend      = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] cache.enable_retry_client      = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] cache.enable_socket_keepalive  = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] cache.enabled                  = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] cache.enforce_fips_mode        = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] cache.expiration_time          = 600 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] cache.hashclient_retry_attempts = 2 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] cache.memcache_dead_retry      = 300 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] cache.memcache_pool_maxsize    = 10 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] cache.memcache_sasl_enabled    = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] cache.password                 = **** {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] cache.proxies                  = [] {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] cache.redis_db                 = 0 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] cache.redis_server             = localhost:6379 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] cache.retry_attempts           = 2 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] cache.retry_delay              = 0.0 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] cache.socket_keepalive_count   = 1 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] cache.socket_keepalive_idle    = 1 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] cache.socket_keepalive_interval = 1 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] cache.socket_timeout           = 1.0 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] cache.tls_allowed_ciphers      = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] cache.tls_cafile               = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] cache.tls_certfile             = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] cache.tls_enabled              = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] cache.tls_keyfile              = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] cache.username                 = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] coordination.backend_url       = **** {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] database.asyncio_connection    = **** {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] database.asyncio_slave_connection = **** {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] database.backend               = sqlalchemy {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] database.connection            = **** {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] database.connection_debug      = 0 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] database.connection_parameters =  {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] database.connection_recycle_time = 3600 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] database.connection_trace      = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] database.db_inc_retry_interval = True {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] database.db_max_retries        = 20 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] database.db_max_retry_interval = 10 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] database.db_retry_interval     = 1 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] database.max_overflow          = 50 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] database.max_pool_size         = 5 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] database.max_retries           = 10 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] database.mysql_wsrep_sync_wait = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] database.pool_timeout          = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] database.retry_interval        = 10 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] database.slave_connection      = **** {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] database.sqlite_synchronous    = True {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] database.synchronous_reader    = True {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] database.use_db_reconnect      = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] profiler.connection_string     = messaging:// {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] profiler.enabled               = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] profiler.es_doc_type           = notification {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] profiler.es_scroll_size        = 10000 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] profiler.es_scroll_time        = 2m {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] profiler.filter_error_trace    = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] profiler.hmac_keys             = **** {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] profiler.sentinel_service_name = mymaster {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] profiler.socket_timeout        = 0.1 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] profiler.trace_requests        = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] profiler.trace_sqlalchemy      = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] profiler_jaeger.process_tags   = {} {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] profiler_jaeger.service_name_prefix = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] profiler_otlp.service_name_prefix = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] oslo_policy.enforce_new_defaults = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: WARNING oslo_config.cfg [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] oslo_policy.enforce_scope      = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] oslo_policy.policy_default_rule = default {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] oslo_policy.policy_file        = policy.yaml {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] privsep_osbrick.group          = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] privsep_osbrick.helper_command = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] privsep_osbrick.user           = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] cinder_sys_admin.group         = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] cinder_sys_admin.helper_command = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] cinder_sys_admin.user          = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] service_user.auth_section      = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] service_user.auth_type         = password {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] service_user.cafile            = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] service_user.certfile          = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] service_user.collect_timing    = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] service_user.insecure          = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] service_user.keyfile           = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] service_user.send_service_user_token = True {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] service_user.split_loggers     = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] service_user.timeout           = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] glance.auth_section            = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] glance.auth_type               = password {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] glance.certfile                = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] glance.collect_timing          = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] glance.insecure                = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] glance.keyfile                 = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] glance.region_name             = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] glance.split_loggers           = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] glance.timeout                 = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.backend_availability_zone = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.chap_password = **** {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.chap_username =  {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.disk_geometry = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.driver_client_cert = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.driver_client_cert_key = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.driver_data_namespace = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.driver_use_ssl = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.extra_capabilities = {} {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.filter_function = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.goodness_function = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.iscsi_target_flags =  {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.iscsi_write_cache = on {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.iser_helper   = tgtadm {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.iser_ip_address = 192.168.122.57 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.iser_port     = 3260 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.nas_host      =  {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.nas_login     = admin {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.nas_mount_options = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.nas_password  = **** {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.nas_private_key =  {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.nas_share_path =  {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.num_shell_tries = 3 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.quobyte_volume_url = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.replication_device = **** {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.report_discard_supported = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.reserved_percentage = 0 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.target_helper = tgtadm {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.target_ip_address = 192.168.122.57 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.target_port   = 3260 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.target_protocol = iscsi {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.trace_flags   = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.unique_fqdn_network = True {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.use_chap_auth = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.volume_backend_name = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.volume_clear  = zero {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.volume_clear_ionice = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.volume_clear_size = 0 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] oslo_reports.file_event_handler = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] oslo_reports.log_dir           = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.backend_availability_zone = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.backend_host         = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.chap_password        = **** {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.chap_username        = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.chiscsi_conf         = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.disk_geometry        = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.driver_client_cert   = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.driver_data_namespace = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.driver_use_ssl       = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.extra_capabilities   = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.filter_function      = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.goodness_function    = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.iser_helper          = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.iser_ip_address      = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.iser_port            = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.iser_target_prefix   = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.nas_host             = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.nas_login            = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.nas_mount_options    = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.nas_password         = **** {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.nas_private_key      = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.nas_share_path       = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.nas_ssh_port         = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.num_shell_tries      = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.nvmet_port_id        = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.replication_device   = **** {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.report_discard_supported = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.reserved_percentage  = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82679]: DEBUG cinder.volume.drivers.quobyte [None req-8f39dc93-c1d1-49de-8e6f-f52f0883b0e2 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82679) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.scst_target_driver   = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.storage_protocol     = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.target_helper        = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82679]: WARNING cinder.volume.drivers.quobyte [None req-8f39dc93-c1d1-49de-8e6f-f52f0883b0e2 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.target_ip_address    = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82679]: WARNING cinder.volume.drivers.quobyte [None req-8f39dc93-c1d1-49de-8e6f-f52f0883b0e2 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.target_port          = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.target_prefix        = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.target_protocol      = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.trace_flags          = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82679]: DEBUG oslo_concurrency.processutils [None req-8f39dc93-c1d1-49de-8e6f-f52f0883b0e2 None None] Running cmd (subprocess): mount.quobyte {{(pid=82679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.use_chap_auth        = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.volume_clear         = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.volume_clear_size    = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] QuobyteHD.volumes_dir          = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] oslo_messaging_rabbit.ssl      = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] oslo_messaging_notifications.driver = [] {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] oslo_messaging_notifications.retry = -1 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] key_manager.fixed_key          = **** {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] barbican.barbican_api_version  = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] barbican.barbican_endpoint     = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] barbican.barbican_endpoint_type = public {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] barbican.barbican_region_name  = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] barbican.cafile                = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] barbican.certfile              = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] barbican.collect_timing        = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] barbican.insecure              = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] barbican.keyfile               = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] barbican.number_of_retries     = 60 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] barbican.retry_delay           = 1 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] barbican.send_service_user_token = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] barbican.split_loggers         = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] barbican.timeout               = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] barbican.verify_ssl            = True {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] barbican.verify_ssl_path       = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] barbican_service_user.auth_section = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] barbican_service_user.auth_type = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] barbican_service_user.cafile   = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] barbican_service_user.certfile = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] barbican_service_user.collect_timing = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] barbican_service_user.insecure = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] barbican_service_user.keyfile  = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] barbican_service_user.split_loggers = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] barbican_service_user.timeout  = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] vault.approle_role_id          = **** {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] vault.approle_secret_id        = **** {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] vault.kv_mountpoint            = secret {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] vault.kv_path                  = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] vault.kv_version               = 2 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] vault.namespace                = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] vault.root_token_id            = **** {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] vault.ssl_ca_crt_file          = None {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] vault.timeout                  = 60.0 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] vault.use_ssl                  = False {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:20:48 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] ******************************************************************************** {{(pid=82561) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Feb 27 01:20:48 devstack quobyte-client[82681]: Reading configuration file: /etc/quobyte/client.cfg
Feb 27 01:20:48 devstack quobyte-client[82681]: Invalid parameters found, error: missing mount point.
Feb 27 01:20:48 devstack quobyte-client[82681]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Feb 27 01:20:48 devstack quobyte-client[82681]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Feb 27 01:20:48 devstack cinder-volume[82679]: DEBUG oslo_concurrency.processutils [None req-8f39dc93-c1d1-49de-8e6f-f52f0883b0e2 None None] CMD "mount.quobyte" returned: 1 in 0.086s {{(pid=82679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:20:48 devstack cinder-volume[82679]: DEBUG oslo_concurrency.lockutils [None req-8f39dc93-c1d1-49de-8e6f-f52f0883b0e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82679) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:20:48 devstack cinder-volume[82679]: DEBUG oslo_concurrency.lockutils [None req-8f39dc93-c1d1-49de-8e6f-f52f0883b0e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82679) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:20:48 devstack cinder-volume[82679]: DEBUG cinder.volume.drivers.quobyte [None req-8f39dc93-c1d1-49de-8e6f-f52f0883b0e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=82679) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:20:48 devstack cinder-volume[82679]: INFO cinder.volume.drivers.quobyte [None req-8f39dc93-c1d1-49de-8e6f-f52f0883b0e2 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c ...
Feb 27 01:20:48 devstack cinder-volume[82679]: DEBUG oslo_concurrency.processutils [None req-8f39dc93-c1d1-49de-8e6f-f52f0883b0e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 -c /etc/quobyte/client-cinder.cfg {{(pid=82679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:20:48 devstack sudo[82682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 -c /etc/quobyte/client-cinder.cfg
Feb 27 01:20:48 devstack sudo[82682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:20:48 devstack sudo[82682]: pam_unix(sudo:session): session closed for user root
Feb 27 01:20:48 devstack cinder-volume[82679]: DEBUG oslo_concurrency.processutils [None req-8f39dc93-c1d1-49de-8e6f-f52f0883b0e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.572s {{(pid=82679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:20:48 devstack cinder-volume[82679]: INFO cinder.volume.drivers.quobyte [None req-8f39dc93-c1d1-49de-8e6f-f52f0883b0e2 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c succeeded
Feb 27 01:20:48 devstack cinder-volume[82679]: DEBUG cinder.volume.drivers.quobyte [None req-8f39dc93-c1d1-49de-8e6f-f52f0883b0e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=82679) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:20:48 devstack cinder-volume[82679]: DEBUG oslo_concurrency.lockutils [None req-8f39dc93-c1d1-49de-8e6f-f52f0883b0e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.585s {{(pid=82679) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:20:48 devstack cinder-volume[82679]: DEBUG oslo_concurrency.processutils [None req-8f39dc93-c1d1-49de-8e6f-f52f0883b0e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=82679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:20:48 devstack sudo[82751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:20:48 devstack sudo[82751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:20:49 devstack sudo[82751]: pam_unix(sudo:session): session closed for user root
Feb 27 01:20:49 devstack cinder-volume[82679]: DEBUG oslo_concurrency.processutils [None req-8f39dc93-c1d1-49de-8e6f-f52f0883b0e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.428s {{(pid=82679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:20:49 devstack cinder-volume[82679]: INFO cinder.volume.driver [None req-8f39dc93-c1d1-49de-8e6f-f52f0883b0e2 None None] Driver hasn't implemented _init_vendor_properties()
Feb 27 01:20:49 devstack cinder-volume[82679]: DEBUG cinder.volume.driver [None req-8f39dc93-c1d1-49de-8e6f-f52f0883b0e2 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7511749267578, 'free_capacity_gb': 1775.7511749267578, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82679) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Feb 27 01:20:49 devstack cinder-volume[82679]: DEBUG oslo_db.sqlalchemy.engines [None req-8f39dc93-c1d1-49de-8e6f-f52f0883b0e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82679) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Feb 27 01:20:49 devstack cinder-volume[82679]: DEBUG dbcounter [-] [82679] Writer thread running {{(pid=82679) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Feb 27 01:20:49 devstack cinder-volume[82679]: DEBUG cinder.db.sqlalchemy.api [None req-8f39dc93-c1d1-49de-8e6f-f52f0883b0e2 None None] Building query based on filter {{(pid=82679) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Feb 27 01:20:49 devstack cinder-volume[82679]: DEBUG cinder.image.image_utils [None req-8f39dc93-c1d1-49de-8e6f-f52f0883b0e2 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82679) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Feb 27 01:20:49 devstack cinder-volume[82679]: INFO cinder.keymgr.migration [None req-e8eace2a-ec75-479d-9a72-a18834be7b3c None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Feb 27 01:20:49 devstack cinder-volume[82679]: DEBUG oslo_concurrency.lockutils [None req-8f39dc93-c1d1-49de-8e6f-f52f0883b0e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82679) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:20:49 devstack cinder-volume[82679]: DEBUG oslo_concurrency.lockutils [None req-8f39dc93-c1d1-49de-8e6f-f52f0883b0e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82679) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:20:49 devstack cinder-volume[82679]: DEBUG cinder.volume.drivers.quobyte [None req-8f39dc93-c1d1-49de-8e6f-f52f0883b0e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=82679) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:20:49 devstack cinder-volume[82679]: DEBUG cinder.volume.drivers.quobyte [None req-8f39dc93-c1d1-49de-8e6f-f52f0883b0e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=82679) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:20:49 devstack cinder-volume[82679]: DEBUG oslo_concurrency.lockutils [None req-8f39dc93-c1d1-49de-8e6f-f52f0883b0e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82679) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:20:49 devstack cinder-volume[82679]: DEBUG oslo_concurrency.processutils [None req-8f39dc93-c1d1-49de-8e6f-f52f0883b0e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=82679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:20:49 devstack sudo[82762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:20:49 devstack sudo[82762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:20:49 devstack sudo[82762]: pam_unix(sudo:session): session closed for user root
Feb 27 01:20:49 devstack cinder-volume[82679]: DEBUG oslo_concurrency.processutils [None req-8f39dc93-c1d1-49de-8e6f-f52f0883b0e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.484s {{(pid=82679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:20:49 devstack cinder-volume[82679]: DEBUG cinder.manager [None req-8f39dc93-c1d1-49de-8e6f-f52f0883b0e2 None None] Notifying Schedulers of capabilities ... {{(pid=82679) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:20:49 devstack cinder-volume[82679]: INFO cinder.volume.manager [None req-8f39dc93-c1d1-49de-8e6f-f52f0883b0e2 None None] Driver initialization completed successfully.
Feb 27 01:20:49 devstack cinder-volume[82679]: INFO cinder.manager [None req-8f39dc93-c1d1-49de-8e6f-f52f0883b0e2 None None] Initiating service 3 cleanup
Feb 27 01:20:49 devstack cinder-volume[82679]: INFO cinder.manager [None req-8f39dc93-c1d1-49de-8e6f-f52f0883b0e2 None None] Service 3 cleanup completed.
Feb 27 01:20:49 devstack cinder-volume[82679]: DEBUG cinder.service [None req-8f39dc93-c1d1-49de-8e6f-f52f0883b0e2 None None] Creating RPC server for service cinder-volume {{(pid=82679) start /opt/stack/cinder/cinder/service.py:231}}
Feb 27 01:20:49 devstack cinder-volume[82679]: DEBUG cinder.service [None req-8f39dc93-c1d1-49de-8e6f-f52f0883b0e2 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82679) start /opt/stack/cinder/cinder/service.py:237}}
Feb 27 01:20:50 devstack cinder-volume[82679]: INFO cinder.volume.manager [None req-8f39dc93-c1d1-49de-8e6f-f52f0883b0e2 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Feb 27 01:20:50 devstack cinder-volume[82679]: DEBUG oslo_concurrency.lockutils [None req-8f39dc93-c1d1-49de-8e6f-f52f0883b0e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82679) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:20:50 devstack cinder-volume[82679]: DEBUG oslo_concurrency.lockutils [None req-8f39dc93-c1d1-49de-8e6f-f52f0883b0e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82679) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:20:50 devstack cinder-volume[82679]: DEBUG cinder.volume.drivers.quobyte [None req-8f39dc93-c1d1-49de-8e6f-f52f0883b0e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=82679) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:20:50 devstack cinder-volume[82679]: DEBUG cinder.volume.drivers.quobyte [None req-8f39dc93-c1d1-49de-8e6f-f52f0883b0e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=82679) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:20:50 devstack cinder-volume[82679]: DEBUG oslo_concurrency.lockutils [None req-8f39dc93-c1d1-49de-8e6f-f52f0883b0e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82679) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:20:50 devstack cinder-volume[82679]: DEBUG oslo_concurrency.processutils [None req-8f39dc93-c1d1-49de-8e6f-f52f0883b0e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=82679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:20:50 devstack sudo[82784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:20:50 devstack sudo[82784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:20:50 devstack sudo[82784]: pam_unix(sudo:session): session closed for user root
Feb 27 01:20:50 devstack cinder-volume[82679]: DEBUG oslo_concurrency.processutils [None req-8f39dc93-c1d1-49de-8e6f-f52f0883b0e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.593s {{(pid=82679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:20:50 devstack cinder-volume[82679]: INFO cinder.volume.manager [None req-8f39dc93-c1d1-49de-8e6f-f52f0883b0e2 None None] Driver post RPC initialization completed successfully.
Feb 27 01:20:52 devstack cinder-volume[82679]: DEBUG oslo_concurrency.lockutils [None req-2964909e-8ac4-48f7-92cc-688de2cec84f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82679) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:20:52 devstack cinder-volume[82679]: DEBUG oslo_concurrency.lockutils [None req-2964909e-8ac4-48f7-92cc-688de2cec84f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82679) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:20:52 devstack cinder-volume[82679]: DEBUG cinder.volume.drivers.quobyte [None req-2964909e-8ac4-48f7-92cc-688de2cec84f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=82679) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:20:52 devstack cinder-volume[82679]: DEBUG cinder.volume.drivers.quobyte [None req-2964909e-8ac4-48f7-92cc-688de2cec84f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=82679) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:20:52 devstack cinder-volume[82679]: DEBUG oslo_concurrency.lockutils [None req-2964909e-8ac4-48f7-92cc-688de2cec84f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82679) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:20:52 devstack cinder-volume[82679]: DEBUG oslo_concurrency.processutils [None req-2964909e-8ac4-48f7-92cc-688de2cec84f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=82679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:20:52 devstack sudo[82826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:20:52 devstack sudo[82826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:20:53 devstack sudo[82826]: pam_unix(sudo:session): session closed for user root
Feb 27 01:20:53 devstack cinder-volume[82679]: DEBUG oslo_concurrency.processutils [None req-2964909e-8ac4-48f7-92cc-688de2cec84f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.431s {{(pid=82679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:20:53 devstack cinder-volume[82679]: DEBUG cinder.manager [None req-2964909e-8ac4-48f7-92cc-688de2cec84f None None] Notifying Schedulers of capabilities ... {{(pid=82679) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:20:53 devstack cinder-volume[82561]: INFO oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] Caught SIGTERM, stopping children
Feb 27 01:20:53 devstack cinder-volume[82561]: DEBUG oslo_concurrency.lockutils [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] Acquiring lock "singleton_lock" {{(pid=82561) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Feb 27 01:20:53 devstack cinder-volume[82561]: DEBUG oslo_concurrency.lockutils [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] Acquired lock "singleton_lock" {{(pid=82561) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Feb 27 01:20:53 devstack cinder-volume[82561]: DEBUG oslo_concurrency.lockutils [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] Releasing lock "singleton_lock" {{(pid=82561) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Feb 27 01:20:53 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] Stop services. {{(pid=82561) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Feb 27 01:20:53 devstack cinder-volume[82561]: DEBUG oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] Killing children. {{(pid=82561) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Feb 27 01:20:53 devstack cinder-volume[82561]: INFO oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] Waiting on 1 children to exit
Feb 27 01:20:58 devstack cinder-volume[82679]: DEBUG oslo_concurrency.lockutils [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] Acquiring lock "singleton_lock" {{(pid=82679) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Feb 27 01:20:58 devstack cinder-volume[82679]: DEBUG oslo_concurrency.lockutils [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] Acquired lock "singleton_lock" {{(pid=82679) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Feb 27 01:20:58 devstack cinder-volume[82679]: DEBUG oslo_concurrency.lockutils [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] Releasing lock "singleton_lock" {{(pid=82679) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Feb 27 01:20:58 devstack cinder-volume[82679]: WARNING amqp [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Feb 27 01:20:58 devstack cinder-volume[82679]: WARNING amqp [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Feb 27 01:20:58 devstack cinder-volume[82561]: INFO oslo_service.backend._eventlet.service [None req-18101484-9f16-4469-b274-17f9585dfd61 None None] Child 82679 exited with status 0
Feb 27 01:21:00 devstack cinder-volume[82946]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82946) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Feb 27 01:21:00 devstack cinder-volume[82946]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82946) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Feb 27 01:21:00 devstack cinder-volume[82946]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82946) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Feb 27 01:21:00 devstack cinder-volume[82946]: INFO dbcounter [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] Registered counter for database cinder
Feb 27 01:21:00 devstack cinder-volume[82946]: DEBUG oslo_db.sqlalchemy.engines [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82946) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG dbcounter [-] [82946] Writer thread running {{(pid=82946) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Feb 27 01:21:01 devstack cinder-volume[82946]: INFO cinder.rpc [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Feb 27 01:21:01 devstack cinder-volume[82946]: INFO cinder.rpc [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_db.sqlalchemy.engines [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82946) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Feb 27 01:21:01 devstack cinder-volume[82946]: INFO cinder.volume.manager [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] Determined volume DB was empty at startup.
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG cinder.volume.manager [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82946) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Feb 27 01:21:01 devstack cinder-volume[82946]: WARNING stevedore.named [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Feb 27 01:21:01 devstack cinder-volume[82946]: WARNING castellan.key_manager [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Feb 27 01:21:01 devstack cinder-volume[82946]: WARNING cinder.keymgr.conf_key_mgr [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Feb 27 01:21:01 devstack cinder-volume[82946]: INFO cinder.volume.manager [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] Image-volume cache disabled for host devstack@QuobyteHD.
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_db.sqlalchemy.engines [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82946) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Feb 27 01:21:01 devstack cinder-volume[82946]: INFO oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] Starting 1 workers
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] Started child 83106 {{(pid=82946) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] Full set of CONF: {{(pid=82946) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] ******************************************************************************** {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] Configuration options gathered from: {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Feb 27 01:21:01 devstack cinder-volume[83106]: INFO cinder.service [-] Starting cinder-volume node (version 27.1.0)
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] ================================================================================ {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] allow_availability_zone_fallback = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] allow_compression_on_image_upload = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] allowed_direct_url_schemes     = [] {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] api_rate_limit                 = True {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] auth_strategy                  = keystone {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_availability_zone      = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_host                   = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_name                   = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_stats_polling_interval = 60 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backup_api_class               = cinder.backup.api.API {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backup_name_template           = backup-%s {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backup_use_same_host           = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backup_use_temp_snapshot       = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] chap_password                  = **** {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] chap_username                  =  {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] cinder_internal_tenant_project_id = 76e1995cdf07490b8434036f7148770d {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] cinder_internal_tenant_user_id = 0df49f0d095147b7aba255d44f4dec4b {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] cluster                        = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] compression_format             = gzip {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] compute_api_class              = cinder.compute.nova.API {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] config_dir                     = [] {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] config_source                  = [] {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] control_exchange               = openstack {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] debug                          = True {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] default_availability_zone      = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] default_group_type             = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] default_volume_type            = QuobyteHD {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] disk_geometry                  = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] driver_client_cert             = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] driver_client_cert_key         = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] driver_data_namespace          = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] driver_ssl_cert_path           = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] driver_ssl_cert_verify         = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] driver_use_ssl                 = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] enable_new_services            = True {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] enable_unsupported_driver      = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] enabled_backends               = ['QuobyteHD'] {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] enforce_multipath_for_image_xfer = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] filter_function                = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] glance_api_insecure            = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] glance_api_servers             = ['http://192.168.122.57/image'] {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] glance_api_ssl_compression     = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] glance_ca_certificates_file    = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] glance_catalog_info            = image:glance:publicURL {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] glance_certfile                = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] glance_keyfile                 = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] glance_num_retries             = 3 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] glance_request_timeout         = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] goodness_function              = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] graceful_shutdown_timeout      = 5 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] group_api_class                = cinder.group.api.API {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] host                           = devstack {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] image_compress_on_upload       = True {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-9f0810d7-af04-4172-a494-10cbdc62728f None None] Starting volume driver QuobyteDriver (1.1.14)
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] image_conversion_address_space_limit = 1 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] image_conversion_cpu_limit     = 60 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] image_conversion_disable       = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] image_upload_use_cinder_backend = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] image_upload_use_internal_tenant = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] image_volume_cache_enabled     = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] image_volume_cache_max_count   = 0 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-9f0810d7-af04-4172-a494-10cbdc62728f None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=83106) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] image_volume_cache_max_size_gb = 0 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] init_host_max_objects_retrieval = 0 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] instance_format                = [instance: %(uuid)s]  {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] iscsi_target_flags             =  {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] iscsi_write_cache              = on {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] iser_helper                    = tgtadm {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] iser_ip_address                = 192.168.122.57 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] iser_port                      = 3260 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] log_color                      = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] log_config_append              = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] log_dir                        = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] log_file                       = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] log_options                    = True {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] log_rotate_interval            = 1 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] log_rotate_interval_type       = days {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] log_rotation_type              = none {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] max_age                        = 0 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] max_logfile_count              = 30 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] max_logfile_size_mb            = 200 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] max_over_subscription_ratio    = 20.0 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] message_reap_interval          = 86400 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] message_ttl                    = 2592000 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] migration_create_volume_timeout_secs = 300 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] monkey_patch                   = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] monkey_patch_modules           = [] {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] my_ip                          = 192.168.122.57 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] no_snapshot_gb_quota           = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] num_iser_scan_tries            = 3 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] num_shell_tries                = 3 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] num_volume_device_scan_tries   = 3 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] nvmeof_conn_info_version       = 1 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] nvmet_ns_id                    = 10 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] nvmet_port_id                  = 1 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] osapi_max_limit                = 1000 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] osapi_volume_ext_list          = [] {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] osapi_volume_listen            = 0.0.0.0 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] osapi_volume_listen_port       = 8776 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] osapi_volume_use_ssl           = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] osapi_volume_workers           = 2 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] per_volume_size_limit          = -1 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] periodic_fuzzy_delay           = 60 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] periodic_interval              = 60 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] project_id_regex               = [0-9a-f\-]+ {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] public_endpoint                = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] publish_errors                 = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] quota_backup_gigabytes         = 1000 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] quota_backups                  = 10 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] quota_gigabytes                = 1000 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] quota_groups                   = 10 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] quota_snapshots                = 10 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] quota_volumes                  = 10 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] rate_limit_burst               = 0 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] rate_limit_except_level        = CRITICAL {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] rate_limit_interval            = 0 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] reinit_driver_count            = 3 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] replication_device             = **** {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] report_discard_supported       = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] report_interval                = 120 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] reservation_clean_interval     = 86400 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] reservation_expire             = 86400 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] reserved_image_namespaces      = [] {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] reserved_percentage            = 0 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] rpc_response_timeout           = 120 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] run_external_periodic_tasks    = True {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] scst_target_driver             = iscsi {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] scst_target_iqn_name           = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] service_down_time              = 720 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] shell_completion               = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] snapshot_name_template         = snapshot-%s {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] split_loggers                  = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] state_path                     = /opt/stack/data/cinder {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] storage_availability_zone      = nova {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] storage_protocol               = iSCSI {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] syslog_log_facility            = LOG_USER {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] target_helper                  = lioadm {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] target_ip_address              = 192.168.122.57 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] target_port                    = 3260 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] target_protocol                = iscsi {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] target_secondary_ip_addresses  = [] {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] trace_flags                    = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] transfer_api_class             = cinder.transfer.api.API {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] transport_url                  = **** {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] until_refresh                  = 0 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] use_chap_auth                  = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] use_default_quota_class        = True {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] use_journal                    = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] use_json                       = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] use_multipath_for_image_xfer   = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] use_stderr                     = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] use_syslog                     = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] verify_glance_signatures       = enabled {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] volume_api_class               = cinder.volume.api.API {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] volume_backend_name            = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] volume_clear                   = zero {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] volume_clear_ionice            = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] volume_clear_size              = 0 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] volume_copy_bps_limit          = 0 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] volume_dd_blocksize            = 1M {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] volume_name_template           = volume-%s {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] volume_service_inithost_offload = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] volume_usage_audit_period      = month {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] zoning_mode                    = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] oslo_concurrency.disable_process_locking = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] keystone_authtoken.admin_password = **** {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] keystone_authtoken.admin_token = **** {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] keystone_authtoken.admin_user  = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] keystone_authtoken.auth_admin_prefix =  {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] keystone_authtoken.auth_port   = 35357 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] keystone_authtoken.auth_protocol = https {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] keystone_authtoken.auth_section = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] keystone_authtoken.auth_type   = password {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] keystone_authtoken.auth_uri    = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] keystone_authtoken.auth_version = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-9f0810d7-af04-4172-a494-10cbdc62728f None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=83106) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Feb 27 01:21:01 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.quobyte [None req-9f0810d7-af04-4172-a494-10cbdc62728f None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Feb 27 01:21:01 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.quobyte [None req-9f0810d7-af04-4172-a494-10cbdc62728f None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] keystone_authtoken.cache       = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] keystone_authtoken.certfile    = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9f0810d7-af04-4172-a494-10cbdc62728f None None] Running cmd (subprocess): mount.quobyte {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] keystone_authtoken.delay_auth_decision = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] keystone_authtoken.http_connect_timeout = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] keystone_authtoken.identity_uri = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] keystone_authtoken.include_service_catalog = True {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] keystone_authtoken.insecure    = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] keystone_authtoken.interface   = public {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] keystone_authtoken.keyfile     = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] keystone_authtoken.memcache_password =  {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] keystone_authtoken.memcache_username =  {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] keystone_authtoken.region_name = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] keystone_authtoken.service_token_roles_required = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] keystone_authtoken.service_type = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] keystone_authtoken.token_cache_time = 300 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.57/identity {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] cache.backend                  = dogpile.cache.null {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] cache.backend_argument         = **** {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] cache.backend_expiration_time  = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] cache.config_prefix            = cache.oslo {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] cache.debug_cache_backend      = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] cache.enable_retry_client      = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] cache.enable_socket_keepalive  = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] cache.enabled                  = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] cache.enforce_fips_mode        = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] cache.expiration_time          = 600 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] cache.hashclient_retry_attempts = 2 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] cache.memcache_dead_retry      = 300 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] cache.memcache_pool_maxsize    = 10 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] cache.memcache_sasl_enabled    = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] cache.password                 = **** {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] cache.proxies                  = [] {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] cache.redis_db                 = 0 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] cache.redis_sentinel_service_name = mymaster {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] cache.redis_server             = localhost:6379 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] cache.retry_attempts           = 2 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] cache.retry_delay              = 0.0 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] cache.socket_keepalive_count   = 1 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] cache.socket_keepalive_idle    = 1 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] cache.socket_keepalive_interval = 1 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] cache.socket_timeout           = 1.0 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] cache.tls_allowed_ciphers      = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] cache.tls_cafile               = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] cache.tls_certfile             = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] cache.tls_enabled              = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] cache.tls_keyfile              = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] cache.username                 = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] coordination.backend_url       = **** {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] database.asyncio_connection    = **** {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] database.asyncio_slave_connection = **** {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] database.backend               = sqlalchemy {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] database.connection            = **** {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] database.connection_debug      = 0 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] database.connection_parameters =  {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] database.connection_recycle_time = 3600 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] database.connection_trace      = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] database.db_inc_retry_interval = True {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] database.db_max_retries        = 20 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] database.db_max_retry_interval = 10 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] database.db_retry_interval     = 1 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] database.max_overflow          = 50 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] database.max_pool_size         = 5 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] database.max_retries           = 10 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] database.mysql_wsrep_sync_wait = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] database.pool_timeout          = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] database.retry_interval        = 10 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] database.slave_connection      = **** {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] database.sqlite_synchronous    = True {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] database.synchronous_reader    = True {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] database.use_db_reconnect      = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] profiler.connection_string     = messaging:// {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] profiler.enabled               = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] profiler.es_doc_type           = notification {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] profiler.es_scroll_size        = 10000 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] profiler.es_scroll_time        = 2m {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] profiler.filter_error_trace    = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] profiler.hmac_keys             = **** {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] profiler.sentinel_service_name = mymaster {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] profiler.socket_timeout        = 0.1 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] profiler.trace_requests        = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] profiler.trace_sqlalchemy      = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] profiler_jaeger.process_tags   = {} {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] profiler_jaeger.service_name_prefix = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] profiler_otlp.service_name_prefix = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] oslo_policy.enforce_new_defaults = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: WARNING oslo_config.cfg [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] oslo_policy.enforce_scope      = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] oslo_policy.policy_default_rule = default {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] oslo_policy.policy_file        = policy.yaml {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] oslo_policy.remote_timeout     = 60.0 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] privsep_osbrick.group          = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] privsep_osbrick.helper_command = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] privsep_osbrick.user           = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] cinder_sys_admin.group         = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] cinder_sys_admin.helper_command = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] cinder_sys_admin.user          = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] service_user.auth_section      = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] service_user.auth_type         = password {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] service_user.cafile            = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] service_user.certfile          = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] service_user.collect_timing    = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] service_user.insecure          = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] service_user.keyfile           = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] service_user.send_service_user_token = True {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] service_user.split_loggers     = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] service_user.timeout           = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] glance.auth_section            = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] glance.auth_type               = password {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] glance.certfile                = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] glance.collect_timing          = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] glance.insecure                = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] glance.keyfile                 = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] glance.region_name             = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] glance.split_loggers           = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] glance.timeout                 = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.backend_availability_zone = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.chap_password = **** {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack quobyte-client[83113]: Reading configuration file: /etc/quobyte/client.cfg
Feb 27 01:21:01 devstack quobyte-client[83113]: Invalid parameters found, error: missing mount point.
Feb 27 01:21:01 devstack quobyte-client[83113]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Feb 27 01:21:01 devstack quobyte-client[83113]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.chap_username =  {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.disk_geometry = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.driver_client_cert = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.driver_client_cert_key = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9f0810d7-af04-4172-a494-10cbdc62728f None None] CMD "mount.quobyte" returned: 1 in 0.080s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.driver_data_namespace = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-9f0810d7-af04-4172-a494-10cbdc62728f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-9f0810d7-af04-4172-a494-10cbdc62728f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:21:01 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-9f0810d7-af04-4172-a494-10cbdc62728f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.driver_use_ssl = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.enable_unsupported_driver = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.extra_capabilities = {} {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.filter_function = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.goodness_function = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.iscsi_target_flags =  {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.iscsi_write_cache = on {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.iser_helper   = tgtadm {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-9f0810d7-af04-4172-a494-10cbdc62728f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:21:01 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-9f0810d7-af04-4172-a494-10cbdc62728f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:21:01 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9f0810d7-af04-4172-a494-10cbdc62728f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.iser_ip_address = 192.168.122.57 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.iser_port     = 3260 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack sudo[83140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:21:01 devstack sudo[83140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.nas_host      =  {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.nas_login     = admin {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.nas_mount_options = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.nas_password  = **** {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.nas_private_key =  {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.nas_share_path =  {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.nas_ssh_port  = 22 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.num_shell_tries = 3 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.nvmet_port_id = 1 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.quobyte_client_cfg = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.quobyte_volume_url = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.replication_device = **** {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.report_discard_supported = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.reserved_percentage = 0 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.scst_target_driver = iscsi {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.scst_target_iqn_name = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.storage_protocol = iSCSI {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.target_helper = tgtadm {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.target_ip_address = 192.168.122.57 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.target_port   = 3260 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.target_protocol = iscsi {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.trace_flags   = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.unique_fqdn_network = True {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.use_chap_auth = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.volume_backend_name = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.volume_clear  = zero {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.volume_clear_ionice = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.volume_clear_size = 0 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] oslo_reports.file_event_handler = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] oslo_reports.log_dir           = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.backend_availability_zone = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.backend_host         = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.chap_password        = **** {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.chap_username        = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.chiscsi_conf         = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.disk_geometry        = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.driver_client_cert   = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.driver_client_cert_key = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.driver_data_namespace = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.driver_use_ssl       = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.extra_capabilities   = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.filter_function      = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.goodness_function    = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.iscsi_target_flags   = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.iscsi_write_cache    = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.iser_helper          = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.iser_ip_address      = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.iser_port            = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.iser_target_prefix   = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.nas_host             = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.nas_login            = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.nas_mount_options    = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.nas_password         = **** {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.nas_private_key      = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.nas_share_path       = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.nas_ssh_port         = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.num_shell_tries      = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.nvmet_ns_id          = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.nvmet_port_id        = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.replication_device   = **** {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.report_discard_supported = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.reserved_percentage  = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.scst_target_driver   = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.storage_protocol     = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.target_helper        = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.target_ip_address    = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.target_port          = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.target_prefix        = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.target_protocol      = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.trace_flags          = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.unique_fqdn_network  = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.use_chap_auth        = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.volume_clear         = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.volume_clear_ionice  = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.volume_clear_size    = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] QuobyteHD.volumes_dir          = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] oslo_messaging_rabbit.ssl      = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] oslo_messaging_rabbit.ssl_version =  {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] oslo_messaging_notifications.driver = [] {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] oslo_messaging_notifications.retry = -1 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] oslo_messaging_notifications.transport_url = **** {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] key_manager.fixed_key          = **** {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] barbican.barbican_api_version  = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] barbican.barbican_endpoint     = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] barbican.barbican_endpoint_type = public {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] barbican.barbican_region_name  = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] barbican.cafile                = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] barbican.certfile              = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] barbican.collect_timing        = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] barbican.insecure              = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] barbican.keyfile               = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] barbican.number_of_retries     = 60 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] barbican.retry_delay           = 1 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] barbican.send_service_user_token = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] barbican.split_loggers         = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] barbican.timeout               = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] barbican.verify_ssl            = True {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] barbican.verify_ssl_path       = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] barbican_service_user.auth_section = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] barbican_service_user.auth_type = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] barbican_service_user.cafile   = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] barbican_service_user.certfile = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] barbican_service_user.collect_timing = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] barbican_service_user.insecure = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] barbican_service_user.keyfile  = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] barbican_service_user.split_loggers = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] barbican_service_user.timeout  = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] vault.approle_role_id          = **** {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] vault.approle_secret_id        = **** {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] vault.kv_mountpoint            = secret {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] vault.kv_path                  = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] vault.kv_version               = 2 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] vault.namespace                = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] vault.root_token_id            = **** {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] vault.ssl_ca_crt_file          = None {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] vault.timeout                  = 60.0 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] vault.use_ssl                  = False {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:21:01 devstack cinder-volume[82946]: DEBUG oslo_service.backend._eventlet.service [None req-d160a67e-9015-4d9c-af5d-06cd57e2098c None None] ******************************************************************************** {{(pid=82946) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Feb 27 01:21:01 devstack sudo[83140]: pam_unix(sudo:session): session closed for user root
Feb 27 01:21:01 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9f0810d7-af04-4172-a494-10cbdc62728f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.468s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:21:01 devstack cinder-volume[83106]: INFO cinder.volume.driver [None req-9f0810d7-af04-4172-a494-10cbdc62728f None None] Driver hasn't implemented _init_vendor_properties()
Feb 27 01:21:01 devstack cinder-volume[83106]: DEBUG cinder.volume.driver [None req-9f0810d7-af04-4172-a494-10cbdc62728f None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580490112305, 'free_capacity_gb': 1775.7580490112305, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83106) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Feb 27 01:21:01 devstack cinder-volume[83106]: DEBUG oslo_db.sqlalchemy.engines [None req-9f0810d7-af04-4172-a494-10cbdc62728f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83106) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Feb 27 01:21:01 devstack cinder-volume[83106]: DEBUG dbcounter [-] [83106] Writer thread running {{(pid=83106) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Feb 27 01:21:01 devstack cinder-volume[83106]: DEBUG cinder.db.sqlalchemy.api [None req-9f0810d7-af04-4172-a494-10cbdc62728f None None] Building query based on filter {{(pid=83106) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Feb 27 01:21:01 devstack cinder-volume[83106]: DEBUG cinder.image.image_utils [None req-9f0810d7-af04-4172-a494-10cbdc62728f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83106) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Feb 27 01:21:01 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-9f0810d7-af04-4172-a494-10cbdc62728f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:21:01 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-9f0810d7-af04-4172-a494-10cbdc62728f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:21:01 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-9f0810d7-af04-4172-a494-10cbdc62728f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:21:01 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-9f0810d7-af04-4172-a494-10cbdc62728f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:21:01 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-9f0810d7-af04-4172-a494-10cbdc62728f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:21:01 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9f0810d7-af04-4172-a494-10cbdc62728f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:21:01 devstack cinder-volume[83106]: INFO cinder.keymgr.migration [None req-dfd7fc5f-3650-4964-b354-601bd6fba469 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Feb 27 01:21:01 devstack sudo[83179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:21:01 devstack sudo[83179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:21:02 devstack sudo[83179]: pam_unix(sudo:session): session closed for user root
Feb 27 01:21:02 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9f0810d7-af04-4172-a494-10cbdc62728f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.463s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:21:02 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-9f0810d7-af04-4172-a494-10cbdc62728f None None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:21:02 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-9f0810d7-af04-4172-a494-10cbdc62728f None None] Driver initialization completed successfully.
Feb 27 01:21:02 devstack cinder-volume[83106]: INFO cinder.manager [None req-9f0810d7-af04-4172-a494-10cbdc62728f None None] Initiating service 3 cleanup
Feb 27 01:21:02 devstack cinder-volume[83106]: INFO cinder.manager [None req-9f0810d7-af04-4172-a494-10cbdc62728f None None] Service 3 cleanup completed.
Feb 27 01:21:02 devstack cinder-volume[83106]: DEBUG cinder.service [None req-9f0810d7-af04-4172-a494-10cbdc62728f None None] Creating RPC server for service cinder-volume {{(pid=83106) start /opt/stack/cinder/cinder/service.py:231}}
Feb 27 01:21:02 devstack cinder-volume[83106]: DEBUG cinder.service [None req-9f0810d7-af04-4172-a494-10cbdc62728f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83106) start /opt/stack/cinder/cinder/service.py:237}}
Feb 27 01:21:02 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-9f0810d7-af04-4172-a494-10cbdc62728f None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Feb 27 01:21:02 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-9f0810d7-af04-4172-a494-10cbdc62728f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:21:02 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-9f0810d7-af04-4172-a494-10cbdc62728f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:21:02 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-9f0810d7-af04-4172-a494-10cbdc62728f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:21:02 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-9f0810d7-af04-4172-a494-10cbdc62728f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:21:02 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-9f0810d7-af04-4172-a494-10cbdc62728f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:21:02 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9f0810d7-af04-4172-a494-10cbdc62728f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:21:02 devstack sudo[83195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:21:02 devstack sudo[83195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:21:02 devstack sudo[83195]: pam_unix(sudo:session): session closed for user root
Feb 27 01:21:02 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9f0810d7-af04-4172-a494-10cbdc62728f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.433s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:21:02 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-9f0810d7-af04-4172-a494-10cbdc62728f None None] Driver post RPC initialization completed successfully.
Feb 27 01:21:11 devstack cinder-volume[82946]: DEBUG dbcounter [-] [82946] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=82946) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 01:21:12 devstack cinder-volume[83106]: DEBUG dbcounter [-] [83106] Writing DB stats cinder:SELECT=2 {{(pid=83106) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 01:21:12 devstack cinder-volume[83106]: DEBUG dbcounter [-] [83106] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=83106) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 01:21:59 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-101267a2-9616-4c33-8cb5-b516f733a548 tempest-DeleteServersTestJSON-1369502962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:21:59 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-101267a2-9616-4c33-8cb5-b516f733a548 tempest-DeleteServersTestJSON-1369502962 None] Flow 'volume_create_manager' (b84b7d85-d373-4265-8adb-af15862e3c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:21:59 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-101267a2-9616-4c33-8cb5-b516f733a548 tempest-DeleteServersTestJSON-1369502962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1aca93a-1417-4045-b7b0-d0627fdbc28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:21:59 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-101267a2-9616-4c33-8cb5-b516f733a548 tempest-DeleteServersTestJSON-1369502962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1aca93a-1417-4045-b7b0-d0627fdbc28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-90526422',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db0f58c3-870c-45f6-8fb0-473d6ea537d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24e865bd6b434660ab76ca8f7ba7d5d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:21:59Z,use_quota=True,user_id='28bf42de4ed04c1c976f6dde7df415b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:21:59 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-101267a2-9616-4c33-8cb5-b516f733a548 tempest-DeleteServersTestJSON-1369502962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2053e2a7-aed1-4e58-b5f2-2ce7da0951f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:21:59 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-101267a2-9616-4c33-8cb5-b516f733a548 tempest-DeleteServersTestJSON-1369502962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2053e2a7-aed1-4e58-b5f2-2ce7da0951f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:21:59 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-101267a2-9616-4c33-8cb5-b516f733a548 tempest-DeleteServersTestJSON-1369502962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e2e889a-2203-48f3-bee0-de4ba642b313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:21:59 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-101267a2-9616-4c33-8cb5-b516f733a548 tempest-DeleteServersTestJSON-1369502962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e2e889a-2203-48f3-bee0-de4ba642b313) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db0f58c3-870c-45f6-8fb0-473d6ea537d7', 'volume_name': 'volume-db0f58c3-870c-45f6-8fb0-473d6ea537d7', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:21:59 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-101267a2-9616-4c33-8cb5-b516f733a548 tempest-DeleteServersTestJSON-1369502962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f19d6936-5f13-4a60-acd3-d6f44d538050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:21:59 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-101267a2-9616-4c33-8cb5-b516f733a548 tempest-DeleteServersTestJSON-1369502962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f19d6936-5f13-4a60-acd3-d6f44d538050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:21:59 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-101267a2-9616-4c33-8cb5-b516f733a548 tempest-DeleteServersTestJSON-1369502962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4abec061-5be6-42f1-9715-406243161ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:21:59 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-101267a2-9616-4c33-8cb5-b516f733a548 tempest-DeleteServersTestJSON-1369502962 None] Volume db0f58c3-870c-45f6-8fb0-473d6ea537d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db0f58c3-870c-45f6-8fb0-473d6ea537d7', 'volume_size': 1}
Feb 27 01:21:59 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-101267a2-9616-4c33-8cb5-b516f733a548 tempest-DeleteServersTestJSON-1369502962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:21:59 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-101267a2-9616-4c33-8cb5-b516f733a548 tempest-DeleteServersTestJSON-1369502962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:21:59 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-101267a2-9616-4c33-8cb5-b516f733a548 tempest-DeleteServersTestJSON-1369502962 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-90526422',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db0f58c3-870c-45f6-8fb0-473d6ea537d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24e865bd6b434660ab76ca8f7ba7d5d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:21:59Z,use_quota=True,user_id='28bf42de4ed04c1c976f6dde7df415b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:21:59 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-101267a2-9616-4c33-8cb5-b516f733a548 tempest-DeleteServersTestJSON-1369502962 None] Creating volume db0f58c3-870c-45f6-8fb0-473d6ea537d7 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:21:59 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-101267a2-9616-4c33-8cb5-b516f733a548 tempest-DeleteServersTestJSON-1369502962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:21:59 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-101267a2-9616-4c33-8cb5-b516f733a548 tempest-DeleteServersTestJSON-1369502962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:21:59 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-101267a2-9616-4c33-8cb5-b516f733a548 tempest-DeleteServersTestJSON-1369502962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:21:59 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-101267a2-9616-4c33-8cb5-b516f733a548 tempest-DeleteServersTestJSON-1369502962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:21:59 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-101267a2-9616-4c33-8cb5-b516f733a548 tempest-DeleteServersTestJSON-1369502962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:21:59 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-101267a2-9616-4c33-8cb5-b516f733a548 tempest-DeleteServersTestJSON-1369502962 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:21:59 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-101267a2-9616-4c33-8cb5-b516f733a548 tempest-DeleteServersTestJSON-1369502962 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:21:59 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-101267a2-9616-4c33-8cb5-b516f733a548 tempest-DeleteServersTestJSON-1369502962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-db0f58c3-870c-45f6-8fb0-473d6ea537d7 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:22:00 devstack sudo[83640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-db0f58c3-870c-45f6-8fb0-473d6ea537d7 1073741824
Feb 27 01:22:00 devstack sudo[83640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:22:01 devstack sudo[83640]: pam_unix(sudo:session): session closed for user root
Feb 27 01:22:01 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-101267a2-9616-4c33-8cb5-b516f733a548 tempest-DeleteServersTestJSON-1369502962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-db0f58c3-870c-45f6-8fb0-473d6ea537d7 1073741824" returned: 0 in 1.516s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:22:01 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-101267a2-9616-4c33-8cb5-b516f733a548 tempest-DeleteServersTestJSON-1369502962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-db0f58c3-870c-45f6-8fb0-473d6ea537d7 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:22:01 devstack sudo[83990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-db0f58c3-870c-45f6-8fb0-473d6ea537d7
Feb 27 01:22:01 devstack sudo[83990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:22:03 devstack sudo[83990]: pam_unix(sudo:session): session closed for user root
Feb 27 01:22:03 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-101267a2-9616-4c33-8cb5-b516f733a548 tempest-DeleteServersTestJSON-1369502962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-db0f58c3-870c-45f6-8fb0-473d6ea537d7" returned: 0 in 1.852s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:22:03 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-101267a2-9616-4c33-8cb5-b516f733a548 tempest-DeleteServersTestJSON-1369502962 None] <== create_volume: return (3458ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:22:03 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-101267a2-9616-4c33-8cb5-b516f733a548 tempest-DeleteServersTestJSON-1369502962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.468s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:22:03 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-101267a2-9616-4c33-8cb5-b516f733a548 tempest-DeleteServersTestJSON-1369502962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4abec061-5be6-42f1-9715-406243161ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db0f58c3-870c-45f6-8fb0-473d6ea537d7', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:22:03 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-101267a2-9616-4c33-8cb5-b516f733a548 tempest-DeleteServersTestJSON-1369502962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14e51607-9c74-42d8-adb3-3e2da9703623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:22:03 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-101267a2-9616-4c33-8cb5-b516f733a548 tempest-DeleteServersTestJSON-1369502962 None] Volume volume-db0f58c3-870c-45f6-8fb0-473d6ea537d7 (db0f58c3-870c-45f6-8fb0-473d6ea537d7): created successfully
Feb 27 01:22:03 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-101267a2-9616-4c33-8cb5-b516f733a548 tempest-DeleteServersTestJSON-1369502962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14e51607-9c74-42d8-adb3-3e2da9703623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:22:03 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-101267a2-9616-4c33-8cb5-b516f733a548 tempest-DeleteServersTestJSON-1369502962 None] Flow 'volume_create_manager' (b84b7d85-d373-4265-8adb-af15862e3c38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:22:03 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-101267a2-9616-4c33-8cb5-b516f733a548 tempest-DeleteServersTestJSON-1369502962 None] Created volume successfully.
Feb 27 01:22:08 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-10b67d04-eadf-4937-a777-225d17b04a99 tempest-ServerRescueNegativeTestJSON-420900678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:22:08 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-10b67d04-eadf-4937-a777-225d17b04a99 tempest-ServerRescueNegativeTestJSON-420900678 None] Flow 'volume_create_manager' (a7a8a7b3-b6a1-4cc4-b7ae-da3926c2bfef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:22:08 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-10b67d04-eadf-4937-a777-225d17b04a99 tempest-ServerRescueNegativeTestJSON-420900678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75541d51-207e-4e3a-a9b8-2f23a89f5170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:22:08 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-10b67d04-eadf-4937-a777-225d17b04a99 tempest-ServerRescueNegativeTestJSON-420900678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75541d51-207e-4e3a-a9b8-2f23a89f5170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-245082796',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95454fdc-0cf0-4a70-9a53-590e27d4a8be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bcae9e0396946d9aa8c16a7436306ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:22:09Z,use_quota=True,user_id='8815aa71a8874bad9e9ce3e2fad48fd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:22:08 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-10b67d04-eadf-4937-a777-225d17b04a99 tempest-ServerRescueNegativeTestJSON-420900678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c278fa8a-4e1b-4c4b-a1f4-67a324071ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:22:08 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-10b67d04-eadf-4937-a777-225d17b04a99 tempest-ServerRescueNegativeTestJSON-420900678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c278fa8a-4e1b-4c4b-a1f4-67a324071ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:22:08 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-10b67d04-eadf-4937-a777-225d17b04a99 tempest-ServerRescueNegativeTestJSON-420900678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57c8bf99-a501-4b70-a55e-d4ee3e7a5f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:22:08 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-10b67d04-eadf-4937-a777-225d17b04a99 tempest-ServerRescueNegativeTestJSON-420900678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57c8bf99-a501-4b70-a55e-d4ee3e7a5f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95454fdc-0cf0-4a70-9a53-590e27d4a8be', 'volume_name': 'volume-95454fdc-0cf0-4a70-9a53-590e27d4a8be', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:22:08 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-10b67d04-eadf-4937-a777-225d17b04a99 tempest-ServerRescueNegativeTestJSON-420900678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0de9638-fdf0-48f6-9156-16b39a8ca726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:22:08 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-10b67d04-eadf-4937-a777-225d17b04a99 tempest-ServerRescueNegativeTestJSON-420900678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0de9638-fdf0-48f6-9156-16b39a8ca726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:22:08 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-10b67d04-eadf-4937-a777-225d17b04a99 tempest-ServerRescueNegativeTestJSON-420900678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (762849c8-e457-4d8e-a6c2-28de5bb2f84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:22:08 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-10b67d04-eadf-4937-a777-225d17b04a99 tempest-ServerRescueNegativeTestJSON-420900678 None] Volume 95454fdc-0cf0-4a70-9a53-590e27d4a8be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95454fdc-0cf0-4a70-9a53-590e27d4a8be', 'volume_size': 1}
Feb 27 01:22:08 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-10b67d04-eadf-4937-a777-225d17b04a99 tempest-ServerRescueNegativeTestJSON-420900678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:22:08 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-10b67d04-eadf-4937-a777-225d17b04a99 tempest-ServerRescueNegativeTestJSON-420900678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:22:08 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-10b67d04-eadf-4937-a777-225d17b04a99 tempest-ServerRescueNegativeTestJSON-420900678 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-245082796',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95454fdc-0cf0-4a70-9a53-590e27d4a8be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bcae9e0396946d9aa8c16a7436306ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:22:09Z,use_quota=True,user_id='8815aa71a8874bad9e9ce3e2fad48fd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:22:08 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-10b67d04-eadf-4937-a777-225d17b04a99 tempest-ServerRescueNegativeTestJSON-420900678 None] Creating volume 95454fdc-0cf0-4a70-9a53-590e27d4a8be {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:22:08 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-10b67d04-eadf-4937-a777-225d17b04a99 tempest-ServerRescueNegativeTestJSON-420900678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:22:08 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-10b67d04-eadf-4937-a777-225d17b04a99 tempest-ServerRescueNegativeTestJSON-420900678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:22:08 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-10b67d04-eadf-4937-a777-225d17b04a99 tempest-ServerRescueNegativeTestJSON-420900678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:22:08 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-10b67d04-eadf-4937-a777-225d17b04a99 tempest-ServerRescueNegativeTestJSON-420900678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:22:08 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-10b67d04-eadf-4937-a777-225d17b04a99 tempest-ServerRescueNegativeTestJSON-420900678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:22:08 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-10b67d04-eadf-4937-a777-225d17b04a99 tempest-ServerRescueNegativeTestJSON-420900678 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:22:08 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-10b67d04-eadf-4937-a777-225d17b04a99 tempest-ServerRescueNegativeTestJSON-420900678 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:22:08 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-10b67d04-eadf-4937-a777-225d17b04a99 tempest-ServerRescueNegativeTestJSON-420900678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-95454fdc-0cf0-4a70-9a53-590e27d4a8be 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:22:08 devstack sudo[84038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-95454fdc-0cf0-4a70-9a53-590e27d4a8be 1073741824
Feb 27 01:22:08 devstack sudo[84038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:22:10 devstack sudo[84038]: pam_unix(sudo:session): session closed for user root
Feb 27 01:22:10 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-10b67d04-eadf-4937-a777-225d17b04a99 tempest-ServerRescueNegativeTestJSON-420900678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-95454fdc-0cf0-4a70-9a53-590e27d4a8be 1073741824" returned: 0 in 1.234s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:22:10 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-10b67d04-eadf-4937-a777-225d17b04a99 tempest-ServerRescueNegativeTestJSON-420900678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-95454fdc-0cf0-4a70-9a53-590e27d4a8be {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:22:10 devstack sudo[84044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-95454fdc-0cf0-4a70-9a53-590e27d4a8be
Feb 27 01:22:10 devstack sudo[84044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:22:10 devstack sudo[84044]: pam_unix(sudo:session): session closed for user root
Feb 27 01:22:10 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-10b67d04-eadf-4937-a777-225d17b04a99 tempest-ServerRescueNegativeTestJSON-420900678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-95454fdc-0cf0-4a70-9a53-590e27d4a8be" returned: 0 in 0.817s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:22:10 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-10b67d04-eadf-4937-a777-225d17b04a99 tempest-ServerRescueNegativeTestJSON-420900678 None] <== create_volume: return (2127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:22:10 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-10b67d04-eadf-4937-a777-225d17b04a99 tempest-ServerRescueNegativeTestJSON-420900678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.130s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:22:11 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-10b67d04-eadf-4937-a777-225d17b04a99 tempest-ServerRescueNegativeTestJSON-420900678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (762849c8-e457-4d8e-a6c2-28de5bb2f84b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95454fdc-0cf0-4a70-9a53-590e27d4a8be', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:22:11 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-10b67d04-eadf-4937-a777-225d17b04a99 tempest-ServerRescueNegativeTestJSON-420900678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de6e6c88-a54d-4a67-be03-87699d8478b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:22:11 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-10b67d04-eadf-4937-a777-225d17b04a99 tempest-ServerRescueNegativeTestJSON-420900678 None] Volume volume-95454fdc-0cf0-4a70-9a53-590e27d4a8be (95454fdc-0cf0-4a70-9a53-590e27d4a8be): created successfully
Feb 27 01:22:11 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-10b67d04-eadf-4937-a777-225d17b04a99 tempest-ServerRescueNegativeTestJSON-420900678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de6e6c88-a54d-4a67-be03-87699d8478b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:22:11 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-10b67d04-eadf-4937-a777-225d17b04a99 tempest-ServerRescueNegativeTestJSON-420900678 None] Flow 'volume_create_manager' (a7a8a7b3-b6a1-4cc4-b7ae-da3926c2bfef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:22:11 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-10b67d04-eadf-4937-a777-225d17b04a99 tempest-ServerRescueNegativeTestJSON-420900678 None] Created volume successfully.
Feb 27 01:22:11 devstack cinder-volume[83106]: WARNING py.warnings [req-04a0efe9-862f-4d8f-b448-31ad7bb94862 req-22de2f67-492d-4f6f-8c2f-c0c7907e3e09 tempest-DeleteServersTestJSON-1369502962 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment".  Apply join condition(s) between each element to resolve.
Feb 27 01:22:11 devstack cinder-volume[83106]:   .first()
Feb 27 01:22:11 devstack cinder-volume[83106]: 
Feb 27 01:22:11 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [req-04a0efe9-862f-4d8f-b448-31ad7bb94862 req-22de2f67-492d-4f6f-8c2f-c0c7907e3e09 tempest-DeleteServersTestJSON-1369502962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:22:11 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [req-04a0efe9-862f-4d8f-b448-31ad7bb94862 req-22de2f67-492d-4f6f-8c2f-c0c7907e3e09 tempest-DeleteServersTestJSON-1369502962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:22:11 devstack cinder-volume[83106]: INFO oslo.privsep.daemon [req-04a0efe9-862f-4d8f-b448-31ad7bb94862 req-22de2f67-492d-4f6f-8c2f-c0c7907e3e09 tempest-DeleteServersTestJSON-1369502962 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpqweiukxq/privsep.sock']
Feb 27 01:22:11 devstack sudo[84058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpqweiukxq/privsep.sock
Feb 27 01:22:11 devstack sudo[84058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:22:13 devstack sudo[84058]: pam_unix(sudo:session): session closed for user root
Feb 27 01:22:13 devstack cinder-volume[83106]: INFO oslo.privsep.daemon [req-04a0efe9-862f-4d8f-b448-31ad7bb94862 req-22de2f67-492d-4f6f-8c2f-c0c7907e3e09 tempest-DeleteServersTestJSON-1369502962 None] Spawned new privsep daemon via rootwrap
Feb 27 01:22:13 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [req-04a0efe9-862f-4d8f-b448-31ad7bb94862 req-22de2f67-492d-4f6f-8c2f-c0c7907e3e09 tempest-DeleteServersTestJSON-1369502962 None] Accepted privsep connection to /tmp/tmpqweiukxq/privsep.sock {{(pid=83106) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}}
Feb 27 01:22:13 devstack cinder-volume[83106]: INFO oslo.privsep.daemon [-] privsep daemon starting
Feb 27 01:22:13 devstack cinder-volume[83106]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Feb 27 01:22:13 devstack cinder-volume[83106]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Feb 27 01:22:13 devstack cinder-volume[83106]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84063
Feb 27 01:22:13 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[9088ab46-1719-4d40-a140-881ba8d85ea7]: (2,) {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:22:13 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63ad608-ceb7-41ad-912c-608f651c26bc]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:22:13 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-04a0efe9-862f-4d8f-b448-31ad7bb94862 req-22de2f67-492d-4f6f-8c2f-c0c7907e3e09 tempest-DeleteServersTestJSON-1369502962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-db0f58c3-870c-45f6-8fb0-473d6ea537d7 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:22:13 devstack sudo[84065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-db0f58c3-870c-45f6-8fb0-473d6ea537d7
Feb 27 01:22:13 devstack sudo[84065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:22:14 devstack sudo[84065]: pam_unix(sudo:session): session closed for user root
Feb 27 01:22:14 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-04a0efe9-862f-4d8f-b448-31ad7bb94862 req-22de2f67-492d-4f6f-8c2f-c0c7907e3e09 tempest-DeleteServersTestJSON-1369502962 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-db0f58c3-870c-45f6-8fb0-473d6ea537d7" returned: 0 in 1.219s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:22:14 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [req-04a0efe9-862f-4d8f-b448-31ad7bb94862 req-22de2f67-492d-4f6f-8c2f-c0c7907e3e09 tempest-DeleteServersTestJSON-1369502962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 3.047s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:22:14 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [req-04a0efe9-862f-4d8f-b448-31ad7bb94862 req-22de2f67-492d-4f6f-8c2f-c0c7907e3e09 tempest-DeleteServersTestJSON-1369502962 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c', 'name': 'volume-db0f58c3-870c-45f6-8fb0-473d6ea537d7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '43e6e964-4cd0-4dd8-b9b8-fb446050df6c', 'enforce_multipath': True} {{(pid=83106) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Feb 27 01:22:14 devstack cinder-volume[83106]: INFO cinder.volume.manager [req-04a0efe9-862f-4d8f-b448-31ad7bb94862 req-22de2f67-492d-4f6f-8c2f-c0c7907e3e09 tempest-DeleteServersTestJSON-1369502962 None] attachment_update completed successfully.
Feb 27 01:22:15 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [req-763a95ed-6be8-4d41-92ef-fed52be974f9 req-50a0d9c5-ff83-4723-9e9b-5d98ebb9f158 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:22:15 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [req-763a95ed-6be8-4d41-92ef-fed52be974f9 req-50a0d9c5-ff83-4723-9e9b-5d98ebb9f158 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Flow 'volume_create_manager' (a76da501-e706-4225-8705-46a46847f15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:22:15 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [req-763a95ed-6be8-4d41-92ef-fed52be974f9 req-50a0d9c5-ff83-4723-9e9b-5d98ebb9f158 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2862cedd-e92b-42a3-9929-90321e627270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:22:15 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [req-763a95ed-6be8-4d41-92ef-fed52be974f9 req-50a0d9c5-ff83-4723-9e9b-5d98ebb9f158 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2862cedd-e92b-42a3-9929-90321e627270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:22:15Z,deleted=False,deleted_at=None,display_description='',display_name='6208069e-0eda-4db7-81b0-c50084f85fdc-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a19276fc-d9b6-4ca4-a712-667e4e4ce830,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c84a1e54202b4f1f807e8c66d048eb05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:22:15Z,use_quota=True,user_id='4a34621a36c34d768c38e8622a355585',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:22:15 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [req-763a95ed-6be8-4d41-92ef-fed52be974f9 req-50a0d9c5-ff83-4723-9e9b-5d98ebb9f158 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (330b685b-f14e-41f2-8e34-66b89246c3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:22:15 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [req-763a95ed-6be8-4d41-92ef-fed52be974f9 req-50a0d9c5-ff83-4723-9e9b-5d98ebb9f158 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (330b685b-f14e-41f2-8e34-66b89246c3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:22:15 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [req-763a95ed-6be8-4d41-92ef-fed52be974f9 req-50a0d9c5-ff83-4723-9e9b-5d98ebb9f158 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad519d47-8ef4-4086-a2af-9bd655ef4579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:22:15 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [req-763a95ed-6be8-4d41-92ef-fed52be974f9 req-50a0d9c5-ff83-4723-9e9b-5d98ebb9f158 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad519d47-8ef4-4086-a2af-9bd655ef4579) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a19276fc-d9b6-4ca4-a712-667e4e4ce830', 'volume_name': 'volume-a19276fc-d9b6-4ca4-a712-667e4e4ce830', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:22:15 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [req-763a95ed-6be8-4d41-92ef-fed52be974f9 req-50a0d9c5-ff83-4723-9e9b-5d98ebb9f158 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1edd2ed0-d2e7-495c-b9a7-12d1ff1a50ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:22:15 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [req-763a95ed-6be8-4d41-92ef-fed52be974f9 req-50a0d9c5-ff83-4723-9e9b-5d98ebb9f158 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1edd2ed0-d2e7-495c-b9a7-12d1ff1a50ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:22:15 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [req-763a95ed-6be8-4d41-92ef-fed52be974f9 req-50a0d9c5-ff83-4723-9e9b-5d98ebb9f158 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7b41855-29c8-49a0-be79-154b12a61063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:22:15 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [req-763a95ed-6be8-4d41-92ef-fed52be974f9 req-50a0d9c5-ff83-4723-9e9b-5d98ebb9f158 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Volume a19276fc-d9b6-4ca4-a712-667e4e4ce830: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a19276fc-d9b6-4ca4-a712-667e4e4ce830', 'volume_size': 1}
Feb 27 01:22:15 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [req-763a95ed-6be8-4d41-92ef-fed52be974f9 req-50a0d9c5-ff83-4723-9e9b-5d98ebb9f158 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:22:15 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [req-763a95ed-6be8-4d41-92ef-fed52be974f9 req-50a0d9c5-ff83-4723-9e9b-5d98ebb9f158 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:22:15 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [req-763a95ed-6be8-4d41-92ef-fed52be974f9 req-50a0d9c5-ff83-4723-9e9b-5d98ebb9f158 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:22:15Z,deleted=False,deleted_at=None,display_description='',display_name='6208069e-0eda-4db7-81b0-c50084f85fdc-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a19276fc-d9b6-4ca4-a712-667e4e4ce830,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c84a1e54202b4f1f807e8c66d048eb05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:22:15Z,use_quota=True,user_id='4a34621a36c34d768c38e8622a355585',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:22:15 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [req-763a95ed-6be8-4d41-92ef-fed52be974f9 req-50a0d9c5-ff83-4723-9e9b-5d98ebb9f158 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Creating volume a19276fc-d9b6-4ca4-a712-667e4e4ce830 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:22:15 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [req-763a95ed-6be8-4d41-92ef-fed52be974f9 req-50a0d9c5-ff83-4723-9e9b-5d98ebb9f158 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:22:15 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [req-763a95ed-6be8-4d41-92ef-fed52be974f9 req-50a0d9c5-ff83-4723-9e9b-5d98ebb9f158 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:22:15 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [req-763a95ed-6be8-4d41-92ef-fed52be974f9 req-50a0d9c5-ff83-4723-9e9b-5d98ebb9f158 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:22:15 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [req-763a95ed-6be8-4d41-92ef-fed52be974f9 req-50a0d9c5-ff83-4723-9e9b-5d98ebb9f158 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:22:15 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [req-763a95ed-6be8-4d41-92ef-fed52be974f9 req-50a0d9c5-ff83-4723-9e9b-5d98ebb9f158 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:22:15 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [req-763a95ed-6be8-4d41-92ef-fed52be974f9 req-50a0d9c5-ff83-4723-9e9b-5d98ebb9f158 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:22:15 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [req-763a95ed-6be8-4d41-92ef-fed52be974f9 req-50a0d9c5-ff83-4723-9e9b-5d98ebb9f158 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:22:15 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-763a95ed-6be8-4d41-92ef-fed52be974f9 req-50a0d9c5-ff83-4723-9e9b-5d98ebb9f158 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-a19276fc-d9b6-4ca4-a712-667e4e4ce830 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:22:15 devstack sudo[84093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-a19276fc-d9b6-4ca4-a712-667e4e4ce830 1073741824
Feb 27 01:22:15 devstack sudo[84093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:22:16 devstack sudo[84093]: pam_unix(sudo:session): session closed for user root
Feb 27 01:22:16 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-763a95ed-6be8-4d41-92ef-fed52be974f9 req-50a0d9c5-ff83-4723-9e9b-5d98ebb9f158 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-a19276fc-d9b6-4ca4-a712-667e4e4ce830 1073741824" returned: 0 in 1.006s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:22:16 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-763a95ed-6be8-4d41-92ef-fed52be974f9 req-50a0d9c5-ff83-4723-9e9b-5d98ebb9f158 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-a19276fc-d9b6-4ca4-a712-667e4e4ce830 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:22:16 devstack sudo[84459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-a19276fc-d9b6-4ca4-a712-667e4e4ce830
Feb 27 01:22:16 devstack sudo[84459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:22:17 devstack sudo[84459]: pam_unix(sudo:session): session closed for user root
Feb 27 01:22:17 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-763a95ed-6be8-4d41-92ef-fed52be974f9 req-50a0d9c5-ff83-4723-9e9b-5d98ebb9f158 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-a19276fc-d9b6-4ca4-a712-667e4e4ce830" returned: 0 in 0.946s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:22:17 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [req-763a95ed-6be8-4d41-92ef-fed52be974f9 req-50a0d9c5-ff83-4723-9e9b-5d98ebb9f158 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] <== create_volume: return (2056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:22:17 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [req-763a95ed-6be8-4d41-92ef-fed52be974f9 req-50a0d9c5-ff83-4723-9e9b-5d98ebb9f158 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.063s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:22:17 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [req-763a95ed-6be8-4d41-92ef-fed52be974f9 req-50a0d9c5-ff83-4723-9e9b-5d98ebb9f158 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7b41855-29c8-49a0-be79-154b12a61063) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a19276fc-d9b6-4ca4-a712-667e4e4ce830', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:22:17 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [req-763a95ed-6be8-4d41-92ef-fed52be974f9 req-50a0d9c5-ff83-4723-9e9b-5d98ebb9f158 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23b6ed55-f983-4073-97ed-e08a55011d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:22:17 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [req-763a95ed-6be8-4d41-92ef-fed52be974f9 req-50a0d9c5-ff83-4723-9e9b-5d98ebb9f158 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Volume volume-a19276fc-d9b6-4ca4-a712-667e4e4ce830 (a19276fc-d9b6-4ca4-a712-667e4e4ce830): created successfully
Feb 27 01:22:17 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [req-763a95ed-6be8-4d41-92ef-fed52be974f9 req-50a0d9c5-ff83-4723-9e9b-5d98ebb9f158 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23b6ed55-f983-4073-97ed-e08a55011d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:22:17 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [req-763a95ed-6be8-4d41-92ef-fed52be974f9 req-50a0d9c5-ff83-4723-9e9b-5d98ebb9f158 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Flow 'volume_create_manager' (a76da501-e706-4225-8705-46a46847f15f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:22:17 devstack cinder-volume[83106]: INFO cinder.volume.manager [req-763a95ed-6be8-4d41-92ef-fed52be974f9 req-50a0d9c5-ff83-4723-9e9b-5d98ebb9f158 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Created volume successfully.
Feb 27 01:22:19 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [req-763a95ed-6be8-4d41-92ef-fed52be974f9 req-1d4fedda-d511-4a5a-b66a-878a809da027 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:22:19 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [req-763a95ed-6be8-4d41-92ef-fed52be974f9 req-1d4fedda-d511-4a5a-b66a-878a809da027 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:22:19 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[4668a96a-a39e-4576-96e2-92c1bce93012]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:22:19 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-763a95ed-6be8-4d41-92ef-fed52be974f9 req-1d4fedda-d511-4a5a-b66a-878a809da027 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-a19276fc-d9b6-4ca4-a712-667e4e4ce830 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:22:19 devstack sudo[84473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-a19276fc-d9b6-4ca4-a712-667e4e4ce830
Feb 27 01:22:19 devstack sudo[84473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:22:20 devstack sudo[84473]: pam_unix(sudo:session): session closed for user root
Feb 27 01:22:20 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-763a95ed-6be8-4d41-92ef-fed52be974f9 req-1d4fedda-d511-4a5a-b66a-878a809da027 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-a19276fc-d9b6-4ca4-a712-667e4e4ce830" returned: 0 in 0.910s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:22:20 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [req-763a95ed-6be8-4d41-92ef-fed52be974f9 req-1d4fedda-d511-4a5a-b66a-878a809da027 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.012s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:22:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [req-763a95ed-6be8-4d41-92ef-fed52be974f9 req-1d4fedda-d511-4a5a-b66a-878a809da027 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c', 'name': 'volume-a19276fc-d9b6-4ca4-a712-667e4e4ce830', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7dd6a16b-6728-47f9-bc71-2b47c1973e1b', 'enforce_multipath': True} {{(pid=83106) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Feb 27 01:22:20 devstack cinder-volume[83106]: INFO cinder.volume.manager [req-763a95ed-6be8-4d41-92ef-fed52be974f9 req-1d4fedda-d511-4a5a-b66a-878a809da027 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] attachment_update completed successfully.
Feb 27 01:22:25 devstack cinder-volume[83106]: INFO cinder.volume.manager [req-05fe0d05-ab39-4dfe-b9c3-a1e63745efbc req-80c69830-4cbf-4344-ac4c-f636db740e8b tempest-DeleteServersTestJSON-1369502962 None] Terminate volume connection completed successfully.
Feb 27 01:22:25 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [req-05fe0d05-ab39-4dfe-b9c3-a1e63745efbc req-80c69830-4cbf-4344-ac4c-f636db740e8b tempest-DeleteServersTestJSON-1369502962 None] Deleting attachment 43e6e964-4cd0-4dd8-b9b8-fb446050df6c. {{(pid=83106) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Feb 27 01:22:27 devstack cinder-volume[83106]: INFO cinder.volume.manager [req-763a95ed-6be8-4d41-92ef-fed52be974f9 req-81a477b9-b565-4095-b49d-cbcec9921d54 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Terminate volume connection completed successfully.
Feb 27 01:22:27 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [req-763a95ed-6be8-4d41-92ef-fed52be974f9 req-81a477b9-b565-4095-b49d-cbcec9921d54 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Deleting attachment 7dd6a16b-6728-47f9-bc71-2b47c1973e1b. {{(pid=83106) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Feb 27 01:22:29 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-b05c5013-4f36-45b5-8a97-8f362d0bf565 tempest-DeleteServersTestJSON-1369502962 None] Acquiring lock "cinder-db0f58c3-870c-45f6-8fb0-473d6ea537d7-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:22:29 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-b05c5013-4f36-45b5-8a97-8f362d0bf565 tempest-DeleteServersTestJSON-1369502962 None] Lock "cinder-db0f58c3-870c-45f6-8fb0-473d6ea537d7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:22:29 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-b05c5013-4f36-45b5-8a97-8f362d0bf565 tempest-DeleteServersTestJSON-1369502962 None] Acquiring lock "cinder-quobyte-db0f58c3-870c-45f6-8fb0-473d6ea537d7" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:22:29 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-b05c5013-4f36-45b5-8a97-8f362d0bf565 tempest-DeleteServersTestJSON-1369502962 None] Lock "cinder-quobyte-db0f58c3-870c-45f6-8fb0-473d6ea537d7" acquired by "delete_volume" :: waited 0.018s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:22:29 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[21bf92b2-1434-4c79-bf53-29adf95dc5f4]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:22:29 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b05c5013-4f36-45b5-8a97-8f362d0bf565 tempest-DeleteServersTestJSON-1369502962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-db0f58c3-870c-45f6-8fb0-473d6ea537d7 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:22:29 devstack sudo[84662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-db0f58c3-870c-45f6-8fb0-473d6ea537d7
Feb 27 01:22:29 devstack sudo[84662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:22:31 devstack sudo[84662]: pam_unix(sudo:session): session closed for user root
Feb 27 01:22:31 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b05c5013-4f36-45b5-8a97-8f362d0bf565 tempest-DeleteServersTestJSON-1369502962 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-db0f58c3-870c-45f6-8fb0-473d6ea537d7" returned: 0 in 1.278s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:22:31 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b05c5013-4f36-45b5-8a97-8f362d0bf565 tempest-DeleteServersTestJSON-1369502962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-db0f58c3-870c-45f6-8fb0-473d6ea537d7 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:22:31 devstack sudo[84671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-db0f58c3-870c-45f6-8fb0-473d6ea537d7
Feb 27 01:22:31 devstack sudo[84671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:22:32 devstack sudo[84671]: pam_unix(sudo:session): session closed for user root
Feb 27 01:22:32 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b05c5013-4f36-45b5-8a97-8f362d0bf565 tempest-DeleteServersTestJSON-1369502962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-db0f58c3-870c-45f6-8fb0-473d6ea537d7" returned: 0 in 0.964s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:22:32 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-b05c5013-4f36-45b5-8a97-8f362d0bf565 tempest-DeleteServersTestJSON-1369502962 None] Lock "cinder-quobyte-db0f58c3-870c-45f6-8fb0-473d6ea537d7" released by "delete_volume" :: held 2.367s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:22:32 devstack cinder-volume[83106]: WARNING cinder.quota [None req-b05c5013-4f36-45b5-8a97-8f362d0bf565 tempest-DeleteServersTestJSON-1369502962 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Feb 27 01:22:32 devstack cinder-volume[83106]: WARNING cinder.quota [None req-b05c5013-4f36-45b5-8a97-8f362d0bf565 tempest-DeleteServersTestJSON-1369502962 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Feb 27 01:22:32 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-b05c5013-4f36-45b5-8a97-8f362d0bf565 tempest-DeleteServersTestJSON-1369502962 None] Created reservations ['167b264b-cecd-4c92-8b0d-fb6b8ada3040', 'c7eb3d9f-a6db-48fc-81d2-fdcfc12520fe', '9ea7398d-7e7f-4483-9621-bf3aa330c05c', '167b0292-a625-4df5-a087-0dd339d1817d'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:22:32 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-b05c5013-4f36-45b5-8a97-8f362d0bf565 tempest-DeleteServersTestJSON-1369502962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:22:32 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-b05c5013-4f36-45b5-8a97-8f362d0bf565 tempest-DeleteServersTestJSON-1369502962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:22:32 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-b05c5013-4f36-45b5-8a97-8f362d0bf565 tempest-DeleteServersTestJSON-1369502962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:22:32 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-b05c5013-4f36-45b5-8a97-8f362d0bf565 tempest-DeleteServersTestJSON-1369502962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:22:32 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-b05c5013-4f36-45b5-8a97-8f362d0bf565 tempest-DeleteServersTestJSON-1369502962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:22:32 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b05c5013-4f36-45b5-8a97-8f362d0bf565 tempest-DeleteServersTestJSON-1369502962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:22:32 devstack sudo[84674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:22:32 devstack sudo[84674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:22:33 devstack sudo[84674]: pam_unix(sudo:session): session closed for user root
Feb 27 01:22:33 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b05c5013-4f36-45b5-8a97-8f362d0bf565 tempest-DeleteServersTestJSON-1369502962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 1.349s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:22:33 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-b05c5013-4f36-45b5-8a97-8f362d0bf565 tempest-DeleteServersTestJSON-1369502962 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:22:33 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-b05c5013-4f36-45b5-8a97-8f362d0bf565 tempest-DeleteServersTestJSON-1369502962 None] Deleted volume successfully.
Feb 27 01:22:33 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-b05c5013-4f36-45b5-8a97-8f362d0bf565 tempest-DeleteServersTestJSON-1369502962 None] Lock "cinder-db0f58c3-870c-45f6-8fb0-473d6ea537d7-delete_volume" released by "delete_volume" :: held 4.116s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:22:36 devstack cinder-volume[83106]: DEBUG cinder.coordination [req-f5ee33fe-9588-4f86-8e53-d87f52e233cb req-3a4d3c67-0f01-4226-976e-3d043c007687 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Acquiring lock "cinder-a19276fc-d9b6-4ca4-a712-667e4e4ce830-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:22:36 devstack cinder-volume[83106]: DEBUG cinder.coordination [req-f5ee33fe-9588-4f86-8e53-d87f52e233cb req-3a4d3c67-0f01-4226-976e-3d043c007687 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Lock "cinder-a19276fc-d9b6-4ca4-a712-667e4e4ce830-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:22:36 devstack cinder-volume[83106]: DEBUG cinder.coordination [req-f5ee33fe-9588-4f86-8e53-d87f52e233cb req-3a4d3c67-0f01-4226-976e-3d043c007687 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Acquiring lock "cinder-quobyte-a19276fc-d9b6-4ca4-a712-667e4e4ce830" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:22:36 devstack cinder-volume[83106]: DEBUG cinder.coordination [req-f5ee33fe-9588-4f86-8e53-d87f52e233cb req-3a4d3c67-0f01-4226-976e-3d043c007687 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Lock "cinder-quobyte-a19276fc-d9b6-4ca4-a712-667e4e4ce830" acquired by "delete_volume" :: waited 0.025s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:22:36 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f86def-abd2-4634-b355-fbd11c8b01b0]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:22:36 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-f5ee33fe-9588-4f86-8e53-d87f52e233cb req-3a4d3c67-0f01-4226-976e-3d043c007687 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-a19276fc-d9b6-4ca4-a712-667e4e4ce830 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:22:36 devstack sudo[84727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-a19276fc-d9b6-4ca4-a712-667e4e4ce830
Feb 27 01:22:36 devstack sudo[84727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:22:37 devstack sudo[84727]: pam_unix(sudo:session): session closed for user root
Feb 27 01:22:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-f5ee33fe-9588-4f86-8e53-d87f52e233cb req-3a4d3c67-0f01-4226-976e-3d043c007687 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-a19276fc-d9b6-4ca4-a712-667e4e4ce830" returned: 0 in 1.228s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:22:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-f5ee33fe-9588-4f86-8e53-d87f52e233cb req-3a4d3c67-0f01-4226-976e-3d043c007687 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-a19276fc-d9b6-4ca4-a712-667e4e4ce830 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:22:37 devstack sudo[84733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-a19276fc-d9b6-4ca4-a712-667e4e4ce830
Feb 27 01:22:37 devstack sudo[84733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:22:39 devstack sudo[84733]: pam_unix(sudo:session): session closed for user root
Feb 27 01:22:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-f5ee33fe-9588-4f86-8e53-d87f52e233cb req-3a4d3c67-0f01-4226-976e-3d043c007687 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-a19276fc-d9b6-4ca4-a712-667e4e4ce830" returned: 0 in 1.079s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:22:39 devstack cinder-volume[83106]: DEBUG cinder.coordination [req-f5ee33fe-9588-4f86-8e53-d87f52e233cb req-3a4d3c67-0f01-4226-976e-3d043c007687 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Lock "cinder-quobyte-a19276fc-d9b6-4ca4-a712-667e4e4ce830" released by "delete_volume" :: held 2.427s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:22:39 devstack cinder-volume[83106]: DEBUG cinder.quota [req-f5ee33fe-9588-4f86-8e53-d87f52e233cb req-3a4d3c67-0f01-4226-976e-3d043c007687 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Created reservations ['f68303f5-c4d2-4a57-98e6-90b8c6a95f37', '20c1586a-1b9a-407b-a3bd-3e022a5309aa', 'c5094713-f3b2-4561-bf73-5ce727cd75a1', '906cc32b-5d68-4aa0-8e17-00b219b3dd3d'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:22:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [req-f5ee33fe-9588-4f86-8e53-d87f52e233cb req-3a4d3c67-0f01-4226-976e-3d043c007687 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:22:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [req-f5ee33fe-9588-4f86-8e53-d87f52e233cb req-3a4d3c67-0f01-4226-976e-3d043c007687 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:22:39 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [req-f5ee33fe-9588-4f86-8e53-d87f52e233cb req-3a4d3c67-0f01-4226-976e-3d043c007687 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:22:39 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [req-f5ee33fe-9588-4f86-8e53-d87f52e233cb req-3a4d3c67-0f01-4226-976e-3d043c007687 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:22:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [req-f5ee33fe-9588-4f86-8e53-d87f52e233cb req-3a4d3c67-0f01-4226-976e-3d043c007687 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:22:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-f5ee33fe-9588-4f86-8e53-d87f52e233cb req-3a4d3c67-0f01-4226-976e-3d043c007687 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:22:39 devstack sudo[84736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:22:39 devstack sudo[84736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:22:40 devstack sudo[84736]: pam_unix(sudo:session): session closed for user root
Feb 27 01:22:40 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-f5ee33fe-9588-4f86-8e53-d87f52e233cb req-3a4d3c67-0f01-4226-976e-3d043c007687 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 1.159s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:22:40 devstack cinder-volume[83106]: DEBUG cinder.manager [req-f5ee33fe-9588-4f86-8e53-d87f52e233cb req-3a4d3c67-0f01-4226-976e-3d043c007687 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:22:40 devstack cinder-volume[83106]: INFO cinder.volume.manager [req-f5ee33fe-9588-4f86-8e53-d87f52e233cb req-3a4d3c67-0f01-4226-976e-3d043c007687 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Deleted volume successfully.
Feb 27 01:22:40 devstack cinder-volume[83106]: DEBUG cinder.coordination [req-f5ee33fe-9588-4f86-8e53-d87f52e233cb req-3a4d3c67-0f01-4226-976e-3d043c007687 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Lock "cinder-a19276fc-d9b6-4ca4-a712-667e4e4ce830-delete_volume" released by "delete_volume" :: held 4.095s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:22:41 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-74e3463c-131b-4959-a5ba-da5428b71dc3 tempest-ServerRescueNegativeTestJSON-420900678 None] Acquiring lock "cinder-95454fdc-0cf0-4a70-9a53-590e27d4a8be-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:22:41 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-74e3463c-131b-4959-a5ba-da5428b71dc3 tempest-ServerRescueNegativeTestJSON-420900678 None] Lock "cinder-95454fdc-0cf0-4a70-9a53-590e27d4a8be-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:22:41 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-74e3463c-131b-4959-a5ba-da5428b71dc3 tempest-ServerRescueNegativeTestJSON-420900678 None] Acquiring lock "cinder-quobyte-95454fdc-0cf0-4a70-9a53-590e27d4a8be" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:22:41 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-74e3463c-131b-4959-a5ba-da5428b71dc3 tempest-ServerRescueNegativeTestJSON-420900678 None] Lock "cinder-quobyte-95454fdc-0cf0-4a70-9a53-590e27d4a8be" acquired by "delete_volume" :: waited 0.028s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:22:41 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[537ee41e-684e-4d0d-b7cc-fbd21d2b4182]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:22:41 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-74e3463c-131b-4959-a5ba-da5428b71dc3 tempest-ServerRescueNegativeTestJSON-420900678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-95454fdc-0cf0-4a70-9a53-590e27d4a8be {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:22:42 devstack sudo[84744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-95454fdc-0cf0-4a70-9a53-590e27d4a8be
Feb 27 01:22:42 devstack sudo[84744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:22:42 devstack sudo[84744]: pam_unix(sudo:session): session closed for user root
Feb 27 01:22:42 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-74e3463c-131b-4959-a5ba-da5428b71dc3 tempest-ServerRescueNegativeTestJSON-420900678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-95454fdc-0cf0-4a70-9a53-590e27d4a8be" returned: 0 in 1.074s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:22:42 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-74e3463c-131b-4959-a5ba-da5428b71dc3 tempest-ServerRescueNegativeTestJSON-420900678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-95454fdc-0cf0-4a70-9a53-590e27d4a8be {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:22:42 devstack sudo[84758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-95454fdc-0cf0-4a70-9a53-590e27d4a8be
Feb 27 01:22:42 devstack sudo[84758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:22:43 devstack sudo[84758]: pam_unix(sudo:session): session closed for user root
Feb 27 01:22:43 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-74e3463c-131b-4959-a5ba-da5428b71dc3 tempest-ServerRescueNegativeTestJSON-420900678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-95454fdc-0cf0-4a70-9a53-590e27d4a8be" returned: 0 in 0.833s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:22:43 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-74e3463c-131b-4959-a5ba-da5428b71dc3 tempest-ServerRescueNegativeTestJSON-420900678 None] Lock "cinder-quobyte-95454fdc-0cf0-4a70-9a53-590e27d4a8be" released by "delete_volume" :: held 2.047s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:22:43 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-74e3463c-131b-4959-a5ba-da5428b71dc3 tempest-ServerRescueNegativeTestJSON-420900678 None] Created reservations ['eb0e4477-56a5-4af0-b659-300b90e78668', '67190902-dda3-4e84-b799-ae9505c4eb9e', '8b349dae-c60c-41b0-8826-731aeb58b8d0', 'e59cc8cb-fa55-48c8-aa5e-d4b2be882e0a'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:22:44 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-74e3463c-131b-4959-a5ba-da5428b71dc3 tempest-ServerRescueNegativeTestJSON-420900678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:22:44 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-74e3463c-131b-4959-a5ba-da5428b71dc3 tempest-ServerRescueNegativeTestJSON-420900678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:22:44 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-74e3463c-131b-4959-a5ba-da5428b71dc3 tempest-ServerRescueNegativeTestJSON-420900678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:22:44 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-74e3463c-131b-4959-a5ba-da5428b71dc3 tempest-ServerRescueNegativeTestJSON-420900678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:22:44 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-74e3463c-131b-4959-a5ba-da5428b71dc3 tempest-ServerRescueNegativeTestJSON-420900678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:22:44 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-74e3463c-131b-4959-a5ba-da5428b71dc3 tempest-ServerRescueNegativeTestJSON-420900678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:22:44 devstack sudo[84761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:22:44 devstack sudo[84761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:22:45 devstack sudo[84761]: pam_unix(sudo:session): session closed for user root
Feb 27 01:22:45 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-74e3463c-131b-4959-a5ba-da5428b71dc3 tempest-ServerRescueNegativeTestJSON-420900678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 1.138s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:22:45 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-74e3463c-131b-4959-a5ba-da5428b71dc3 tempest-ServerRescueNegativeTestJSON-420900678 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:22:45 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-74e3463c-131b-4959-a5ba-da5428b71dc3 tempest-ServerRescueNegativeTestJSON-420900678 None] Deleted volume successfully.
Feb 27 01:22:45 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-74e3463c-131b-4959-a5ba-da5428b71dc3 tempest-ServerRescueNegativeTestJSON-420900678 None] Lock "cinder-95454fdc-0cf0-4a70-9a53-590e27d4a8be-delete_volume" released by "delete_volume" :: held 3.578s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:22:47 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [req-6c7c0d1c-3514-4ac5-ba76-5ea623b10c15 req-28447edf-2fd6-4311-a081-7f77d337ab98 tempest-VolumesSnapshotsTestJSON-217314340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:22:47 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [req-6c7c0d1c-3514-4ac5-ba76-5ea623b10c15 req-28447edf-2fd6-4311-a081-7f77d337ab98 tempest-VolumesSnapshotsTestJSON-217314340 None] Flow 'volume_create_manager' (e773efa2-380c-4e6b-a609-3bed39d2a568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:22:47 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [req-6c7c0d1c-3514-4ac5-ba76-5ea623b10c15 req-28447edf-2fd6-4311-a081-7f77d337ab98 tempest-VolumesSnapshotsTestJSON-217314340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4d61929-4a91-4b6d-baee-dfc3c3182214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:22:47 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [req-6c7c0d1c-3514-4ac5-ba76-5ea623b10c15 req-28447edf-2fd6-4311-a081-7f77d337ab98 tempest-VolumesSnapshotsTestJSON-217314340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4d61929-4a91-4b6d-baee-dfc3c3182214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:22:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1527369712',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8c92263-0758-4529-99d1-5ce02aed4022,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ecc9c282969410891bf5a396e074af1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:22:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:22:47Z,use_quota=True,user_id='93aa78721f2e4ba4b0233294660d7619',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:22:47 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [req-6c7c0d1c-3514-4ac5-ba76-5ea623b10c15 req-28447edf-2fd6-4311-a081-7f77d337ab98 tempest-VolumesSnapshotsTestJSON-217314340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8678ecc5-7ca1-46d9-bdd0-ca1ae375b959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:22:47 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [req-6c7c0d1c-3514-4ac5-ba76-5ea623b10c15 req-28447edf-2fd6-4311-a081-7f77d337ab98 tempest-VolumesSnapshotsTestJSON-217314340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8678ecc5-7ca1-46d9-bdd0-ca1ae375b959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:22:47 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [req-6c7c0d1c-3514-4ac5-ba76-5ea623b10c15 req-28447edf-2fd6-4311-a081-7f77d337ab98 tempest-VolumesSnapshotsTestJSON-217314340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90a6bd55-87fe-44ad-b3b5-2d8420d1f0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:22:47 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [req-6c7c0d1c-3514-4ac5-ba76-5ea623b10c15 req-28447edf-2fd6-4311-a081-7f77d337ab98 tempest-VolumesSnapshotsTestJSON-217314340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90a6bd55-87fe-44ad-b3b5-2d8420d1f0fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8c92263-0758-4529-99d1-5ce02aed4022', 'volume_name': 'volume-b8c92263-0758-4529-99d1-5ce02aed4022', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:22:47 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [req-6c7c0d1c-3514-4ac5-ba76-5ea623b10c15 req-28447edf-2fd6-4311-a081-7f77d337ab98 tempest-VolumesSnapshotsTestJSON-217314340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (735c163a-69ff-474d-b9ae-410b23684624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:22:47 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [req-6c7c0d1c-3514-4ac5-ba76-5ea623b10c15 req-28447edf-2fd6-4311-a081-7f77d337ab98 tempest-VolumesSnapshotsTestJSON-217314340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (735c163a-69ff-474d-b9ae-410b23684624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:22:47 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [req-6c7c0d1c-3514-4ac5-ba76-5ea623b10c15 req-28447edf-2fd6-4311-a081-7f77d337ab98 tempest-VolumesSnapshotsTestJSON-217314340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (123c940f-68ac-4dff-90fb-b1f586b8d1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:22:47 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [req-6c7c0d1c-3514-4ac5-ba76-5ea623b10c15 req-28447edf-2fd6-4311-a081-7f77d337ab98 tempest-VolumesSnapshotsTestJSON-217314340 None] Volume b8c92263-0758-4529-99d1-5ce02aed4022: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8c92263-0758-4529-99d1-5ce02aed4022', 'volume_size': 1}
Feb 27 01:22:47 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [req-6c7c0d1c-3514-4ac5-ba76-5ea623b10c15 req-28447edf-2fd6-4311-a081-7f77d337ab98 tempest-VolumesSnapshotsTestJSON-217314340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:22:47 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [req-6c7c0d1c-3514-4ac5-ba76-5ea623b10c15 req-28447edf-2fd6-4311-a081-7f77d337ab98 tempest-VolumesSnapshotsTestJSON-217314340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:22:47 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [req-6c7c0d1c-3514-4ac5-ba76-5ea623b10c15 req-28447edf-2fd6-4311-a081-7f77d337ab98 tempest-VolumesSnapshotsTestJSON-217314340 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:22:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1527369712',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8c92263-0758-4529-99d1-5ce02aed4022,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ecc9c282969410891bf5a396e074af1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:22:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:22:47Z,use_quota=True,user_id='93aa78721f2e4ba4b0233294660d7619',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:22:47 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [req-6c7c0d1c-3514-4ac5-ba76-5ea623b10c15 req-28447edf-2fd6-4311-a081-7f77d337ab98 tempest-VolumesSnapshotsTestJSON-217314340 None] Creating volume b8c92263-0758-4529-99d1-5ce02aed4022 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:22:47 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [req-6c7c0d1c-3514-4ac5-ba76-5ea623b10c15 req-28447edf-2fd6-4311-a081-7f77d337ab98 tempest-VolumesSnapshotsTestJSON-217314340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:22:47 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [req-6c7c0d1c-3514-4ac5-ba76-5ea623b10c15 req-28447edf-2fd6-4311-a081-7f77d337ab98 tempest-VolumesSnapshotsTestJSON-217314340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:22:47 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [req-6c7c0d1c-3514-4ac5-ba76-5ea623b10c15 req-28447edf-2fd6-4311-a081-7f77d337ab98 tempest-VolumesSnapshotsTestJSON-217314340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:22:47 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [req-6c7c0d1c-3514-4ac5-ba76-5ea623b10c15 req-28447edf-2fd6-4311-a081-7f77d337ab98 tempest-VolumesSnapshotsTestJSON-217314340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:22:47 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [req-6c7c0d1c-3514-4ac5-ba76-5ea623b10c15 req-28447edf-2fd6-4311-a081-7f77d337ab98 tempest-VolumesSnapshotsTestJSON-217314340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:22:47 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [req-6c7c0d1c-3514-4ac5-ba76-5ea623b10c15 req-28447edf-2fd6-4311-a081-7f77d337ab98 tempest-VolumesSnapshotsTestJSON-217314340 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:22:47 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [req-6c7c0d1c-3514-4ac5-ba76-5ea623b10c15 req-28447edf-2fd6-4311-a081-7f77d337ab98 tempest-VolumesSnapshotsTestJSON-217314340 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:22:47 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-6c7c0d1c-3514-4ac5-ba76-5ea623b10c15 req-28447edf-2fd6-4311-a081-7f77d337ab98 tempest-VolumesSnapshotsTestJSON-217314340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b8c92263-0758-4529-99d1-5ce02aed4022 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:22:47 devstack sudo[84790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b8c92263-0758-4529-99d1-5ce02aed4022 1073741824
Feb 27 01:22:47 devstack sudo[84790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:22:48 devstack sudo[84790]: pam_unix(sudo:session): session closed for user root
Feb 27 01:22:48 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-6c7c0d1c-3514-4ac5-ba76-5ea623b10c15 req-28447edf-2fd6-4311-a081-7f77d337ab98 tempest-VolumesSnapshotsTestJSON-217314340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b8c92263-0758-4529-99d1-5ce02aed4022 1073741824" returned: 0 in 0.824s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:22:48 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-6c7c0d1c-3514-4ac5-ba76-5ea623b10c15 req-28447edf-2fd6-4311-a081-7f77d337ab98 tempest-VolumesSnapshotsTestJSON-217314340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b8c92263-0758-4529-99d1-5ce02aed4022 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:22:48 devstack sudo[84798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b8c92263-0758-4529-99d1-5ce02aed4022
Feb 27 01:22:48 devstack sudo[84798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:22:49 devstack sudo[84798]: pam_unix(sudo:session): session closed for user root
Feb 27 01:22:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-6c7c0d1c-3514-4ac5-ba76-5ea623b10c15 req-28447edf-2fd6-4311-a081-7f77d337ab98 tempest-VolumesSnapshotsTestJSON-217314340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b8c92263-0758-4529-99d1-5ce02aed4022" returned: 0 in 0.810s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:22:49 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [req-6c7c0d1c-3514-4ac5-ba76-5ea623b10c15 req-28447edf-2fd6-4311-a081-7f77d337ab98 tempest-VolumesSnapshotsTestJSON-217314340 None] <== create_volume: return (1680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:22:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [req-6c7c0d1c-3514-4ac5-ba76-5ea623b10c15 req-28447edf-2fd6-4311-a081-7f77d337ab98 tempest-VolumesSnapshotsTestJSON-217314340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.688s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:22:49 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [req-6c7c0d1c-3514-4ac5-ba76-5ea623b10c15 req-28447edf-2fd6-4311-a081-7f77d337ab98 tempest-VolumesSnapshotsTestJSON-217314340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (123c940f-68ac-4dff-90fb-b1f586b8d1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8c92263-0758-4529-99d1-5ce02aed4022', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:22:49 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [req-6c7c0d1c-3514-4ac5-ba76-5ea623b10c15 req-28447edf-2fd6-4311-a081-7f77d337ab98 tempest-VolumesSnapshotsTestJSON-217314340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47292d87-1b59-408a-8475-5474c7bbb514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:22:49 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [req-6c7c0d1c-3514-4ac5-ba76-5ea623b10c15 req-28447edf-2fd6-4311-a081-7f77d337ab98 tempest-VolumesSnapshotsTestJSON-217314340 None] Volume volume-b8c92263-0758-4529-99d1-5ce02aed4022 (b8c92263-0758-4529-99d1-5ce02aed4022): created successfully
Feb 27 01:22:49 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [req-6c7c0d1c-3514-4ac5-ba76-5ea623b10c15 req-28447edf-2fd6-4311-a081-7f77d337ab98 tempest-VolumesSnapshotsTestJSON-217314340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47292d87-1b59-408a-8475-5474c7bbb514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:22:49 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [req-6c7c0d1c-3514-4ac5-ba76-5ea623b10c15 req-28447edf-2fd6-4311-a081-7f77d337ab98 tempest-VolumesSnapshotsTestJSON-217314340 None] Flow 'volume_create_manager' (e773efa2-380c-4e6b-a609-3bed39d2a568) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:22:49 devstack cinder-volume[83106]: INFO cinder.volume.manager [req-6c7c0d1c-3514-4ac5-ba76-5ea623b10c15 req-28447edf-2fd6-4311-a081-7f77d337ab98 tempest-VolumesSnapshotsTestJSON-217314340 None] Created volume successfully.
Feb 27 01:22:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [req-30547966-0c5b-469b-9216-2444c85c0c45 req-ce471801-0fc0-4803-af17-a9e99e35fb6b tempest-VolumesSnapshotsTestJSON-217314340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:22:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [req-30547966-0c5b-469b-9216-2444c85c0c45 req-ce471801-0fc0-4803-af17-a9e99e35fb6b tempest-VolumesSnapshotsTestJSON-217314340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:22:50 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [req-30547966-0c5b-469b-9216-2444c85c0c45 req-ce471801-0fc0-4803-af17-a9e99e35fb6b tempest-VolumesSnapshotsTestJSON-217314340 None] Creating offline snapshot 3abcee1b-d19b-41da-a852-6dd00f32aa5d of volume b8c92263-0758-4529-99d1-5ce02aed4022 {{(pid=83106) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:22:50 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3fafe15-949f-4602-a44a-6e80fe307769]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:22:50 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-30547966-0c5b-469b-9216-2444c85c0c45 req-ce471801-0fc0-4803-af17-a9e99e35fb6b tempest-VolumesSnapshotsTestJSON-217314340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b8c92263-0758-4529-99d1-5ce02aed4022 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:22:50 devstack sudo[84815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b8c92263-0758-4529-99d1-5ce02aed4022
Feb 27 01:22:50 devstack sudo[84815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:22:51 devstack sudo[84815]: pam_unix(sudo:session): session closed for user root
Feb 27 01:22:51 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-30547966-0c5b-469b-9216-2444c85c0c45 req-ce471801-0fc0-4803-af17-a9e99e35fb6b tempest-VolumesSnapshotsTestJSON-217314340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b8c92263-0758-4529-99d1-5ce02aed4022" returned: 0 in 1.570s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:22:51 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-30547966-0c5b-469b-9216-2444c85c0c45 req-ce471801-0fc0-4803-af17-a9e99e35fb6b tempest-VolumesSnapshotsTestJSON-217314340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b8c92263-0758-4529-99d1-5ce02aed4022,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b8c92263-0758-4529-99d1-5ce02aed4022.3abcee1b-d19b-41da-a852-6dd00f32aa5d 1G {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:22:51 devstack sudo[84820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b8c92263-0758-4529-99d1-5ce02aed4022,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b8c92263-0758-4529-99d1-5ce02aed4022.3abcee1b-d19b-41da-a852-6dd00f32aa5d 1G
Feb 27 01:22:51 devstack sudo[84820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:22:52 devstack sudo[84820]: pam_unix(sudo:session): session closed for user root
Feb 27 01:22:52 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-30547966-0c5b-469b-9216-2444c85c0c45 req-ce471801-0fc0-4803-af17-a9e99e35fb6b tempest-VolumesSnapshotsTestJSON-217314340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b8c92263-0758-4529-99d1-5ce02aed4022,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b8c92263-0758-4529-99d1-5ce02aed4022.3abcee1b-d19b-41da-a852-6dd00f32aa5d 1G" returned: 0 in 0.908s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:22:52 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-30547966-0c5b-469b-9216-2444c85c0c45 req-ce471801-0fc0-4803-af17-a9e99e35fb6b tempest-VolumesSnapshotsTestJSON-217314340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8c92263-0758-4529-99d1-5ce02aed4022 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b8c92263-0758-4529-99d1-5ce02aed4022.3abcee1b-d19b-41da-a852-6dd00f32aa5d {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:22:52 devstack sudo[84828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8c92263-0758-4529-99d1-5ce02aed4022 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b8c92263-0758-4529-99d1-5ce02aed4022.3abcee1b-d19b-41da-a852-6dd00f32aa5d
Feb 27 01:22:52 devstack sudo[84828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:22:53 devstack sudo[84828]: pam_unix(sudo:session): session closed for user root
Feb 27 01:22:53 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-30547966-0c5b-469b-9216-2444c85c0c45 req-ce471801-0fc0-4803-af17-a9e99e35fb6b tempest-VolumesSnapshotsTestJSON-217314340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8c92263-0758-4529-99d1-5ce02aed4022 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b8c92263-0758-4529-99d1-5ce02aed4022.3abcee1b-d19b-41da-a852-6dd00f32aa5d" returned: 0 in 0.821s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:22:53 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [req-30547966-0c5b-469b-9216-2444c85c0c45 req-ce471801-0fc0-4803-af17-a9e99e35fb6b tempest-VolumesSnapshotsTestJSON-217314340 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b8c92263-0758-4529-99d1-5ce02aed4022.3abcee1b-d19b-41da-a852-6dd00f32aa5d is being set with open permissions: ugo+rw
Feb 27 01:22:53 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-30547966-0c5b-469b-9216-2444c85c0c45 req-ce471801-0fc0-4803-af17-a9e99e35fb6b tempest-VolumesSnapshotsTestJSON-217314340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b8c92263-0758-4529-99d1-5ce02aed4022.3abcee1b-d19b-41da-a852-6dd00f32aa5d {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:22:53 devstack sudo[84834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b8c92263-0758-4529-99d1-5ce02aed4022.3abcee1b-d19b-41da-a852-6dd00f32aa5d
Feb 27 01:22:53 devstack sudo[84834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:22:54 devstack sudo[84834]: pam_unix(sudo:session): session closed for user root
Feb 27 01:22:54 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-30547966-0c5b-469b-9216-2444c85c0c45 req-ce471801-0fc0-4803-af17-a9e99e35fb6b tempest-VolumesSnapshotsTestJSON-217314340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b8c92263-0758-4529-99d1-5ce02aed4022.3abcee1b-d19b-41da-a852-6dd00f32aa5d" returned: 0 in 0.822s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:22:54 devstack cinder-volume[83106]: DEBUG dbcounter [-] [83106] Writing DB stats cinder:UPDATE=37,cinder:SELECT=31,cinder:DELETE=5,cinder:INSERT=7 {{(pid=83106) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 01:22:54 devstack cinder-volume[83106]: DEBUG dbcounter [-] [83106] Writing DB stats cinder:SELECT=45,cinder:INSERT=9,cinder:UPDATE=42,cinder:DELETE=2 {{(pid=83106) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 01:22:54 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-30547966-0c5b-469b-9216-2444c85c0c45 req-ce471801-0fc0-4803-af17-a9e99e35fb6b tempest-VolumesSnapshotsTestJSON-217314340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b8c92263-0758-4529-99d1-5ce02aed4022.info {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:22:54 devstack sudo[84863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b8c92263-0758-4529-99d1-5ce02aed4022.info
Feb 27 01:22:54 devstack sudo[84863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:22:54 devstack sudo[84863]: pam_unix(sudo:session): session closed for user root
Feb 27 01:22:54 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-30547966-0c5b-469b-9216-2444c85c0c45 req-ce471801-0fc0-4803-af17-a9e99e35fb6b tempest-VolumesSnapshotsTestJSON-217314340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b8c92263-0758-4529-99d1-5ce02aed4022.info" returned: 0 in 0.703s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:22:54 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [req-30547966-0c5b-469b-9216-2444c85c0c45 req-ce471801-0fc0-4803-af17-a9e99e35fb6b tempest-VolumesSnapshotsTestJSON-217314340 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b8c92263-0758-4529-99d1-5ce02aed4022.info is being set with open permissions: ugo+rw
Feb 27 01:22:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-30547966-0c5b-469b-9216-2444c85c0c45 req-ce471801-0fc0-4803-af17-a9e99e35fb6b tempest-VolumesSnapshotsTestJSON-217314340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b8c92263-0758-4529-99d1-5ce02aed4022.info {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:22:55 devstack sudo[84866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b8c92263-0758-4529-99d1-5ce02aed4022.info
Feb 27 01:22:55 devstack sudo[84866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:22:55 devstack sudo[84866]: pam_unix(sudo:session): session closed for user root
Feb 27 01:22:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-30547966-0c5b-469b-9216-2444c85c0c45 req-ce471801-0fc0-4803-af17-a9e99e35fb6b tempest-VolumesSnapshotsTestJSON-217314340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b8c92263-0758-4529-99d1-5ce02aed4022.info" returned: 0 in 0.516s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:22:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [req-30547966-0c5b-469b-9216-2444c85c0c45 req-ce471801-0fc0-4803-af17-a9e99e35fb6b tempest-VolumesSnapshotsTestJSON-217314340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.541s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:22:55 devstack cinder-volume[83106]: INFO cinder.volume.manager [req-30547966-0c5b-469b-9216-2444c85c0c45 req-ce471801-0fc0-4803-af17-a9e99e35fb6b tempest-VolumesSnapshotsTestJSON-217314340 None] Create snapshot completed successfully
Feb 27 01:22:55 devstack cinder-volume[83106]: DEBUG cinder.coordination [req-36455036-22e7-4b7f-b83a-7e725ead95e9 req-0c8bf33d-f758-40df-8e2f-e2fb84fe6aad tempest-VolumesSnapshotsTestJSON-217314340 None] Acquiring lock "cinder-3abcee1b-d19b-41da-a852-6dd00f32aa5d-delete_snapshot" by "delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:22:55 devstack cinder-volume[83106]: DEBUG cinder.coordination [req-36455036-22e7-4b7f-b83a-7e725ead95e9 req-0c8bf33d-f758-40df-8e2f-e2fb84fe6aad tempest-VolumesSnapshotsTestJSON-217314340 None] Lock "cinder-3abcee1b-d19b-41da-a852-6dd00f32aa5d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:22:55 devstack cinder-volume[83106]: DEBUG cinder.coordination [req-36455036-22e7-4b7f-b83a-7e725ead95e9 req-0c8bf33d-f758-40df-8e2f-e2fb84fe6aad tempest-VolumesSnapshotsTestJSON-217314340 None] Acquiring lock "cinder-quobyte-b8c92263-0758-4529-99d1-5ce02aed4022" by "delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:22:55 devstack cinder-volume[83106]: DEBUG cinder.coordination [req-36455036-22e7-4b7f-b83a-7e725ead95e9 req-0c8bf33d-f758-40df-8e2f-e2fb84fe6aad tempest-VolumesSnapshotsTestJSON-217314340 None] Lock "cinder-quobyte-b8c92263-0758-4529-99d1-5ce02aed4022" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:22:55 devstack cinder-volume[83106]: DEBUG cinder.coordination [req-36455036-22e7-4b7f-b83a-7e725ead95e9 req-0c8bf33d-f758-40df-8e2f-e2fb84fe6aad tempest-VolumesSnapshotsTestJSON-217314340 None] Acquiring lock "cinder-quobyte-3abcee1b-d19b-41da-a852-6dd00f32aa5d" by "_delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:22:55 devstack cinder-volume[83106]: DEBUG cinder.coordination [req-36455036-22e7-4b7f-b83a-7e725ead95e9 req-0c8bf33d-f758-40df-8e2f-e2fb84fe6aad tempest-VolumesSnapshotsTestJSON-217314340 None] Lock "cinder-quobyte-3abcee1b-d19b-41da-a852-6dd00f32aa5d" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:22:55 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [req-36455036-22e7-4b7f-b83a-7e725ead95e9 req-0c8bf33d-f758-40df-8e2f-e2fb84fe6aad tempest-VolumesSnapshotsTestJSON-217314340 None] Deleting offline snapshot 3abcee1b-d19b-41da-a852-6dd00f32aa5d of volume b8c92263-0758-4529-99d1-5ce02aed4022 {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:22:55 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [req-36455036-22e7-4b7f-b83a-7e725ead95e9 req-0c8bf33d-f758-40df-8e2f-e2fb84fe6aad tempest-VolumesSnapshotsTestJSON-217314340 None] snapshot_file for this snap is: volume-b8c92263-0758-4529-99d1-5ce02aed4022.3abcee1b-d19b-41da-a852-6dd00f32aa5d {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:22:55 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ed6b74-8125-431b-a677-3b618e2c4391]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:22:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-36455036-22e7-4b7f-b83a-7e725ead95e9 req-0c8bf33d-f758-40df-8e2f-e2fb84fe6aad tempest-VolumesSnapshotsTestJSON-217314340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b8c92263-0758-4529-99d1-5ce02aed4022.3abcee1b-d19b-41da-a852-6dd00f32aa5d {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:22:55 devstack sudo[84889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b8c92263-0758-4529-99d1-5ce02aed4022.3abcee1b-d19b-41da-a852-6dd00f32aa5d
Feb 27 01:22:55 devstack sudo[84889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:22:56 devstack sudo[84889]: pam_unix(sudo:session): session closed for user root
Feb 27 01:22:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-36455036-22e7-4b7f-b83a-7e725ead95e9 req-0c8bf33d-f758-40df-8e2f-e2fb84fe6aad tempest-VolumesSnapshotsTestJSON-217314340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b8c92263-0758-4529-99d1-5ce02aed4022.3abcee1b-d19b-41da-a852-6dd00f32aa5d" returned: 0 in 0.607s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:22:56 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [req-36455036-22e7-4b7f-b83a-7e725ead95e9 req-0c8bf33d-f758-40df-8e2f-e2fb84fe6aad tempest-VolumesSnapshotsTestJSON-217314340 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b8c92263-0758-4529-99d1-5ce02aed4022(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83106) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:22:56 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cfe2d5f-725f-4965-b202-5dbaec8e22e3]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:22:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-36455036-22e7-4b7f-b83a-7e725ead95e9 req-0c8bf33d-f758-40df-8e2f-e2fb84fe6aad tempest-VolumesSnapshotsTestJSON-217314340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b8c92263-0758-4529-99d1-5ce02aed4022 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:22:56 devstack sudo[84894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b8c92263-0758-4529-99d1-5ce02aed4022
Feb 27 01:22:56 devstack sudo[84894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:22:56 devstack cinder-volume[83106]: DEBUG oslo_service.periodic_task [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83106) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Feb 27 01:22:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:22:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:22:56 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:22:56 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:22:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:22:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:22:56 devstack sudo[84896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:22:56 devstack sudo[84896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:22:57 devstack sudo[84894]: pam_unix(sudo:session): session closed for user root
Feb 27 01:22:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-36455036-22e7-4b7f-b83a-7e725ead95e9 req-0c8bf33d-f758-40df-8e2f-e2fb84fe6aad tempest-VolumesSnapshotsTestJSON-217314340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b8c92263-0758-4529-99d1-5ce02aed4022" returned: 0 in 0.649s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:22:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-36455036-22e7-4b7f-b83a-7e725ead95e9 req-0c8bf33d-f758-40df-8e2f-e2fb84fe6aad tempest-VolumesSnapshotsTestJSON-217314340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b8c92263-0758-4529-99d1-5ce02aed4022.3abcee1b-d19b-41da-a852-6dd00f32aa5d {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:22:57 devstack sudo[84902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b8c92263-0758-4529-99d1-5ce02aed4022.3abcee1b-d19b-41da-a852-6dd00f32aa5d
Feb 27 01:22:57 devstack sudo[84902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:22:57 devstack sudo[84896]: pam_unix(sudo:session): session closed for user root
Feb 27 01:22:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.605s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:22:57 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:22:57 devstack sudo[84902]: pam_unix(sudo:session): session closed for user root
Feb 27 01:22:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-36455036-22e7-4b7f-b83a-7e725ead95e9 req-0c8bf33d-f758-40df-8e2f-e2fb84fe6aad tempest-VolumesSnapshotsTestJSON-217314340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b8c92263-0758-4529-99d1-5ce02aed4022.3abcee1b-d19b-41da-a852-6dd00f32aa5d" returned: 0 in 0.578s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:22:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-36455036-22e7-4b7f-b83a-7e725ead95e9 req-0c8bf33d-f758-40df-8e2f-e2fb84fe6aad tempest-VolumesSnapshotsTestJSON-217314340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b8c92263-0758-4529-99d1-5ce02aed4022.3abcee1b-d19b-41da-a852-6dd00f32aa5d {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:22:57 devstack sudo[84908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b8c92263-0758-4529-99d1-5ce02aed4022.3abcee1b-d19b-41da-a852-6dd00f32aa5d
Feb 27 01:22:57 devstack sudo[84908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:22:58 devstack sudo[84908]: pam_unix(sudo:session): session closed for user root
Feb 27 01:22:58 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-36455036-22e7-4b7f-b83a-7e725ead95e9 req-0c8bf33d-f758-40df-8e2f-e2fb84fe6aad tempest-VolumesSnapshotsTestJSON-217314340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b8c92263-0758-4529-99d1-5ce02aed4022.3abcee1b-d19b-41da-a852-6dd00f32aa5d" returned: 0 in 0.529s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:22:58 devstack cinder-volume[83106]: DEBUG cinder.coordination [req-36455036-22e7-4b7f-b83a-7e725ead95e9 req-0c8bf33d-f758-40df-8e2f-e2fb84fe6aad tempest-VolumesSnapshotsTestJSON-217314340 None] Lock "cinder-quobyte-3abcee1b-d19b-41da-a852-6dd00f32aa5d" released by "_delete_snapshot" :: held 2.450s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:22:58 devstack cinder-volume[83106]: DEBUG cinder.coordination [req-36455036-22e7-4b7f-b83a-7e725ead95e9 req-0c8bf33d-f758-40df-8e2f-e2fb84fe6aad tempest-VolumesSnapshotsTestJSON-217314340 None] Lock "cinder-quobyte-b8c92263-0758-4529-99d1-5ce02aed4022" released by "delete_snapshot" :: held 2.471s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:22:58 devstack cinder-volume[83106]: WARNING cinder.quota [req-36455036-22e7-4b7f-b83a-7e725ead95e9 req-0c8bf33d-f758-40df-8e2f-e2fb84fe6aad tempest-VolumesSnapshotsTestJSON-217314340 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Feb 27 01:22:58 devstack cinder-volume[83106]: DEBUG cinder.quota [req-36455036-22e7-4b7f-b83a-7e725ead95e9 req-0c8bf33d-f758-40df-8e2f-e2fb84fe6aad tempest-VolumesSnapshotsTestJSON-217314340 None] Created reservations ['cd40d6f5-9b94-4e40-865c-73ff55878238', '576d25cb-1fee-4595-a3c7-9b43fe18da25', '82a6599f-229f-45a1-b1f8-3e9d7eca6bdf', '6135271d-da45-4900-9dc5-6986389de5e5'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:22:58 devstack cinder-volume[83106]: INFO cinder.volume.manager [req-36455036-22e7-4b7f-b83a-7e725ead95e9 req-0c8bf33d-f758-40df-8e2f-e2fb84fe6aad tempest-VolumesSnapshotsTestJSON-217314340 None] Delete snapshot completed successfully.
Feb 27 01:22:58 devstack cinder-volume[83106]: DEBUG cinder.coordination [req-36455036-22e7-4b7f-b83a-7e725ead95e9 req-0c8bf33d-f758-40df-8e2f-e2fb84fe6aad tempest-VolumesSnapshotsTestJSON-217314340 None] Lock "cinder-3abcee1b-d19b-41da-a852-6dd00f32aa5d-delete_snapshot" released by "delete_snapshot" :: held 2.668s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:22:59 devstack cinder-volume[83106]: DEBUG cinder.coordination [req-124e2a6d-1c6e-4754-8a82-3d329014131d req-b0c8120f-6cf0-46af-ae32-56378af2809d tempest-VolumesSnapshotsTestJSON-217314340 None] Acquiring lock "cinder-b8c92263-0758-4529-99d1-5ce02aed4022-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:22:59 devstack cinder-volume[83106]: DEBUG cinder.coordination [req-124e2a6d-1c6e-4754-8a82-3d329014131d req-b0c8120f-6cf0-46af-ae32-56378af2809d tempest-VolumesSnapshotsTestJSON-217314340 None] Lock "cinder-b8c92263-0758-4529-99d1-5ce02aed4022-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:22:59 devstack cinder-volume[83106]: DEBUG cinder.coordination [req-124e2a6d-1c6e-4754-8a82-3d329014131d req-b0c8120f-6cf0-46af-ae32-56378af2809d tempest-VolumesSnapshotsTestJSON-217314340 None] Acquiring lock "cinder-quobyte-b8c92263-0758-4529-99d1-5ce02aed4022" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:22:59 devstack cinder-volume[83106]: DEBUG cinder.coordination [req-124e2a6d-1c6e-4754-8a82-3d329014131d req-b0c8120f-6cf0-46af-ae32-56378af2809d tempest-VolumesSnapshotsTestJSON-217314340 None] Lock "cinder-quobyte-b8c92263-0758-4529-99d1-5ce02aed4022" acquired by "delete_volume" :: waited 0.011s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:22:59 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[388ab86b-c1af-48f2-bf77-c68357843018]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:22:59 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-124e2a6d-1c6e-4754-8a82-3d329014131d req-b0c8120f-6cf0-46af-ae32-56378af2809d tempest-VolumesSnapshotsTestJSON-217314340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b8c92263-0758-4529-99d1-5ce02aed4022 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:22:59 devstack sudo[84945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b8c92263-0758-4529-99d1-5ce02aed4022
Feb 27 01:22:59 devstack sudo[84945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:22:59 devstack sudo[84945]: pam_unix(sudo:session): session closed for user root
Feb 27 01:22:59 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-124e2a6d-1c6e-4754-8a82-3d329014131d req-b0c8120f-6cf0-46af-ae32-56378af2809d tempest-VolumesSnapshotsTestJSON-217314340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b8c92263-0758-4529-99d1-5ce02aed4022" returned: 0 in 0.892s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:22:59 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-124e2a6d-1c6e-4754-8a82-3d329014131d req-b0c8120f-6cf0-46af-ae32-56378af2809d tempest-VolumesSnapshotsTestJSON-217314340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b8c92263-0758-4529-99d1-5ce02aed4022 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:23:00 devstack sudo[84950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b8c92263-0758-4529-99d1-5ce02aed4022
Feb 27 01:23:00 devstack sudo[84950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:23:00 devstack sudo[84950]: pam_unix(sudo:session): session closed for user root
Feb 27 01:23:00 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-124e2a6d-1c6e-4754-8a82-3d329014131d req-b0c8120f-6cf0-46af-ae32-56378af2809d tempest-VolumesSnapshotsTestJSON-217314340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b8c92263-0758-4529-99d1-5ce02aed4022" returned: 0 in 0.596s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:23:00 devstack cinder-volume[83106]: DEBUG cinder.coordination [req-124e2a6d-1c6e-4754-8a82-3d329014131d req-b0c8120f-6cf0-46af-ae32-56378af2809d tempest-VolumesSnapshotsTestJSON-217314340 None] Lock "cinder-quobyte-b8c92263-0758-4529-99d1-5ce02aed4022" released by "delete_volume" :: held 1.527s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:23:00 devstack cinder-volume[83106]: DEBUG cinder.quota [req-124e2a6d-1c6e-4754-8a82-3d329014131d req-b0c8120f-6cf0-46af-ae32-56378af2809d tempest-VolumesSnapshotsTestJSON-217314340 None] Created reservations ['2d4e1517-7940-4085-84be-204d79c923c9', '4594afe8-c366-4edf-a353-64580f4e18d1', 'ea3ed9bf-c538-489e-a4c4-00b3b3bab26e', 'c77d60cf-fc3e-4619-b165-75054ea8a7de'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:23:00 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [req-124e2a6d-1c6e-4754-8a82-3d329014131d req-b0c8120f-6cf0-46af-ae32-56378af2809d tempest-VolumesSnapshotsTestJSON-217314340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:23:00 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [req-124e2a6d-1c6e-4754-8a82-3d329014131d req-b0c8120f-6cf0-46af-ae32-56378af2809d tempest-VolumesSnapshotsTestJSON-217314340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:23:00 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [req-124e2a6d-1c6e-4754-8a82-3d329014131d req-b0c8120f-6cf0-46af-ae32-56378af2809d tempest-VolumesSnapshotsTestJSON-217314340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:23:00 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [req-124e2a6d-1c6e-4754-8a82-3d329014131d req-b0c8120f-6cf0-46af-ae32-56378af2809d tempest-VolumesSnapshotsTestJSON-217314340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:23:00 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [req-124e2a6d-1c6e-4754-8a82-3d329014131d req-b0c8120f-6cf0-46af-ae32-56378af2809d tempest-VolumesSnapshotsTestJSON-217314340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:23:00 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-124e2a6d-1c6e-4754-8a82-3d329014131d req-b0c8120f-6cf0-46af-ae32-56378af2809d tempest-VolumesSnapshotsTestJSON-217314340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:23:00 devstack sudo[84960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:23:00 devstack sudo[84960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:23:01 devstack sudo[84960]: pam_unix(sudo:session): session closed for user root
Feb 27 01:23:01 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-124e2a6d-1c6e-4754-8a82-3d329014131d req-b0c8120f-6cf0-46af-ae32-56378af2809d tempest-VolumesSnapshotsTestJSON-217314340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 1.084s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:23:01 devstack cinder-volume[83106]: DEBUG cinder.manager [req-124e2a6d-1c6e-4754-8a82-3d329014131d req-b0c8120f-6cf0-46af-ae32-56378af2809d tempest-VolumesSnapshotsTestJSON-217314340 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:23:01 devstack cinder-volume[83106]: INFO cinder.volume.manager [req-124e2a6d-1c6e-4754-8a82-3d329014131d req-b0c8120f-6cf0-46af-ae32-56378af2809d tempest-VolumesSnapshotsTestJSON-217314340 None] Deleted volume successfully.
Feb 27 01:23:01 devstack cinder-volume[83106]: DEBUG cinder.coordination [req-124e2a6d-1c6e-4754-8a82-3d329014131d req-b0c8120f-6cf0-46af-ae32-56378af2809d tempest-VolumesSnapshotsTestJSON-217314340 None] Lock "cinder-b8c92263-0758-4529-99d1-5ce02aed4022-delete_volume" released by "delete_volume" :: held 2.885s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:23:08 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [req-a0ad294d-4b27-4842-b90a-95a05ed65f5f req-bd4fb842-8c3c-4eb0-a41a-39cad6fa3ae2 tempest-VolumesGetTestJSON-1841825273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:23:08 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [req-a0ad294d-4b27-4842-b90a-95a05ed65f5f req-bd4fb842-8c3c-4eb0-a41a-39cad6fa3ae2 tempest-VolumesGetTestJSON-1841825273 None] Flow 'volume_create_manager' (80ad4890-ac67-427e-a265-af6d59f9640c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:23:08 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [req-a0ad294d-4b27-4842-b90a-95a05ed65f5f req-bd4fb842-8c3c-4eb0-a41a-39cad6fa3ae2 tempest-VolumesGetTestJSON-1841825273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b7cd7f4-3ec4-4512-a1c5-36b7775c5c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:23:08 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [req-a0ad294d-4b27-4842-b90a-95a05ed65f5f req-bd4fb842-8c3c-4eb0-a41a-39cad6fa3ae2 tempest-VolumesGetTestJSON-1841825273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b7cd7f4-3ec4-4512-a1c5-36b7775c5c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:23:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1309137768',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=577a05a0-c305-4843-8a13-551bbb78c170,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7acfabe6f28c4c97831586d9862fc49d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:23:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:23:08Z,use_quota=True,user_id='3d92a3847a1241448c47705e3a33361b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:23:08 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [req-a0ad294d-4b27-4842-b90a-95a05ed65f5f req-bd4fb842-8c3c-4eb0-a41a-39cad6fa3ae2 tempest-VolumesGetTestJSON-1841825273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d905cc57-945e-4f22-847b-4feb4889a17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:23:08 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [req-a0ad294d-4b27-4842-b90a-95a05ed65f5f req-bd4fb842-8c3c-4eb0-a41a-39cad6fa3ae2 tempest-VolumesGetTestJSON-1841825273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d905cc57-945e-4f22-847b-4feb4889a17d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:23:08 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [req-a0ad294d-4b27-4842-b90a-95a05ed65f5f req-bd4fb842-8c3c-4eb0-a41a-39cad6fa3ae2 tempest-VolumesGetTestJSON-1841825273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c9e08bd-e268-4e27-852c-ad5871a01492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:23:08 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [req-a0ad294d-4b27-4842-b90a-95a05ed65f5f req-bd4fb842-8c3c-4eb0-a41a-39cad6fa3ae2 tempest-VolumesGetTestJSON-1841825273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c9e08bd-e268-4e27-852c-ad5871a01492) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '577a05a0-c305-4843-8a13-551bbb78c170', 'volume_name': 'volume-577a05a0-c305-4843-8a13-551bbb78c170', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:23:08 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [req-a0ad294d-4b27-4842-b90a-95a05ed65f5f req-bd4fb842-8c3c-4eb0-a41a-39cad6fa3ae2 tempest-VolumesGetTestJSON-1841825273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68db29d7-8731-4a57-af7f-51cd77c49852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:23:08 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [req-a0ad294d-4b27-4842-b90a-95a05ed65f5f req-bd4fb842-8c3c-4eb0-a41a-39cad6fa3ae2 tempest-VolumesGetTestJSON-1841825273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68db29d7-8731-4a57-af7f-51cd77c49852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:23:08 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [req-a0ad294d-4b27-4842-b90a-95a05ed65f5f req-bd4fb842-8c3c-4eb0-a41a-39cad6fa3ae2 tempest-VolumesGetTestJSON-1841825273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e2eca4e-b5a5-4bbf-9434-bf47bad8ad45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:23:08 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [req-a0ad294d-4b27-4842-b90a-95a05ed65f5f req-bd4fb842-8c3c-4eb0-a41a-39cad6fa3ae2 tempest-VolumesGetTestJSON-1841825273 None] Volume 577a05a0-c305-4843-8a13-551bbb78c170: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-577a05a0-c305-4843-8a13-551bbb78c170', 'volume_size': 1}
Feb 27 01:23:08 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [req-a0ad294d-4b27-4842-b90a-95a05ed65f5f req-bd4fb842-8c3c-4eb0-a41a-39cad6fa3ae2 tempest-VolumesGetTestJSON-1841825273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:23:08 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [req-a0ad294d-4b27-4842-b90a-95a05ed65f5f req-bd4fb842-8c3c-4eb0-a41a-39cad6fa3ae2 tempest-VolumesGetTestJSON-1841825273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:23:08 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [req-a0ad294d-4b27-4842-b90a-95a05ed65f5f req-bd4fb842-8c3c-4eb0-a41a-39cad6fa3ae2 tempest-VolumesGetTestJSON-1841825273 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:23:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1309137768',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=577a05a0-c305-4843-8a13-551bbb78c170,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7acfabe6f28c4c97831586d9862fc49d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:23:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:23:08Z,use_quota=True,user_id='3d92a3847a1241448c47705e3a33361b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:23:08 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [req-a0ad294d-4b27-4842-b90a-95a05ed65f5f req-bd4fb842-8c3c-4eb0-a41a-39cad6fa3ae2 tempest-VolumesGetTestJSON-1841825273 None] Creating volume 577a05a0-c305-4843-8a13-551bbb78c170 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:23:08 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [req-a0ad294d-4b27-4842-b90a-95a05ed65f5f req-bd4fb842-8c3c-4eb0-a41a-39cad6fa3ae2 tempest-VolumesGetTestJSON-1841825273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:23:08 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [req-a0ad294d-4b27-4842-b90a-95a05ed65f5f req-bd4fb842-8c3c-4eb0-a41a-39cad6fa3ae2 tempest-VolumesGetTestJSON-1841825273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:23:08 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [req-a0ad294d-4b27-4842-b90a-95a05ed65f5f req-bd4fb842-8c3c-4eb0-a41a-39cad6fa3ae2 tempest-VolumesGetTestJSON-1841825273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:23:08 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [req-a0ad294d-4b27-4842-b90a-95a05ed65f5f req-bd4fb842-8c3c-4eb0-a41a-39cad6fa3ae2 tempest-VolumesGetTestJSON-1841825273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:23:08 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [req-a0ad294d-4b27-4842-b90a-95a05ed65f5f req-bd4fb842-8c3c-4eb0-a41a-39cad6fa3ae2 tempest-VolumesGetTestJSON-1841825273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:23:08 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [req-a0ad294d-4b27-4842-b90a-95a05ed65f5f req-bd4fb842-8c3c-4eb0-a41a-39cad6fa3ae2 tempest-VolumesGetTestJSON-1841825273 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:23:08 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [req-a0ad294d-4b27-4842-b90a-95a05ed65f5f req-bd4fb842-8c3c-4eb0-a41a-39cad6fa3ae2 tempest-VolumesGetTestJSON-1841825273 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:23:08 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-a0ad294d-4b27-4842-b90a-95a05ed65f5f req-bd4fb842-8c3c-4eb0-a41a-39cad6fa3ae2 tempest-VolumesGetTestJSON-1841825273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-577a05a0-c305-4843-8a13-551bbb78c170 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:23:08 devstack sudo[84983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-577a05a0-c305-4843-8a13-551bbb78c170 1073741824
Feb 27 01:23:08 devstack sudo[84983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:23:08 devstack sudo[84983]: pam_unix(sudo:session): session closed for user root
Feb 27 01:23:08 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-a0ad294d-4b27-4842-b90a-95a05ed65f5f req-bd4fb842-8c3c-4eb0-a41a-39cad6fa3ae2 tempest-VolumesGetTestJSON-1841825273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-577a05a0-c305-4843-8a13-551bbb78c170 1073741824" returned: 0 in 0.681s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:23:08 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-a0ad294d-4b27-4842-b90a-95a05ed65f5f req-bd4fb842-8c3c-4eb0-a41a-39cad6fa3ae2 tempest-VolumesGetTestJSON-1841825273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-577a05a0-c305-4843-8a13-551bbb78c170 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:23:08 devstack sudo[84988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-577a05a0-c305-4843-8a13-551bbb78c170
Feb 27 01:23:08 devstack sudo[84988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:23:09 devstack sudo[84988]: pam_unix(sudo:session): session closed for user root
Feb 27 01:23:09 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-a0ad294d-4b27-4842-b90a-95a05ed65f5f req-bd4fb842-8c3c-4eb0-a41a-39cad6fa3ae2 tempest-VolumesGetTestJSON-1841825273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-577a05a0-c305-4843-8a13-551bbb78c170" returned: 0 in 0.574s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:23:09 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [req-a0ad294d-4b27-4842-b90a-95a05ed65f5f req-bd4fb842-8c3c-4eb0-a41a-39cad6fa3ae2 tempest-VolumesGetTestJSON-1841825273 None] <== create_volume: return (1308ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:23:09 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [req-a0ad294d-4b27-4842-b90a-95a05ed65f5f req-bd4fb842-8c3c-4eb0-a41a-39cad6fa3ae2 tempest-VolumesGetTestJSON-1841825273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.311s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:23:09 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [req-a0ad294d-4b27-4842-b90a-95a05ed65f5f req-bd4fb842-8c3c-4eb0-a41a-39cad6fa3ae2 tempest-VolumesGetTestJSON-1841825273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e2eca4e-b5a5-4bbf-9434-bf47bad8ad45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-577a05a0-c305-4843-8a13-551bbb78c170', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:23:09 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [req-a0ad294d-4b27-4842-b90a-95a05ed65f5f req-bd4fb842-8c3c-4eb0-a41a-39cad6fa3ae2 tempest-VolumesGetTestJSON-1841825273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b829dd9-fc68-4940-9b9f-e352df4f5405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:23:09 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [req-a0ad294d-4b27-4842-b90a-95a05ed65f5f req-bd4fb842-8c3c-4eb0-a41a-39cad6fa3ae2 tempest-VolumesGetTestJSON-1841825273 None] Volume volume-577a05a0-c305-4843-8a13-551bbb78c170 (577a05a0-c305-4843-8a13-551bbb78c170): created successfully
Feb 27 01:23:09 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [req-a0ad294d-4b27-4842-b90a-95a05ed65f5f req-bd4fb842-8c3c-4eb0-a41a-39cad6fa3ae2 tempest-VolumesGetTestJSON-1841825273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b829dd9-fc68-4940-9b9f-e352df4f5405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:23:09 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [req-a0ad294d-4b27-4842-b90a-95a05ed65f5f req-bd4fb842-8c3c-4eb0-a41a-39cad6fa3ae2 tempest-VolumesGetTestJSON-1841825273 None] Flow 'volume_create_manager' (80ad4890-ac67-427e-a265-af6d59f9640c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:23:09 devstack cinder-volume[83106]: INFO cinder.volume.manager [req-a0ad294d-4b27-4842-b90a-95a05ed65f5f req-bd4fb842-8c3c-4eb0-a41a-39cad6fa3ae2 tempest-VolumesGetTestJSON-1841825273 None] Created volume successfully.
Feb 27 01:23:10 devstack cinder-volume[83106]: DEBUG cinder.coordination [req-aa93725d-294e-4d4d-89ab-3ac3061143c6 req-cfbff1cc-8c1c-45e8-a3e0-43218da1919a tempest-VolumesGetTestJSON-1841825273 None] Acquiring lock "cinder-577a05a0-c305-4843-8a13-551bbb78c170-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:23:10 devstack cinder-volume[83106]: DEBUG cinder.coordination [req-aa93725d-294e-4d4d-89ab-3ac3061143c6 req-cfbff1cc-8c1c-45e8-a3e0-43218da1919a tempest-VolumesGetTestJSON-1841825273 None] Lock "cinder-577a05a0-c305-4843-8a13-551bbb78c170-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:23:10 devstack cinder-volume[83106]: DEBUG cinder.coordination [req-aa93725d-294e-4d4d-89ab-3ac3061143c6 req-cfbff1cc-8c1c-45e8-a3e0-43218da1919a tempest-VolumesGetTestJSON-1841825273 None] Acquiring lock "cinder-quobyte-577a05a0-c305-4843-8a13-551bbb78c170" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:23:10 devstack cinder-volume[83106]: DEBUG cinder.coordination [req-aa93725d-294e-4d4d-89ab-3ac3061143c6 req-cfbff1cc-8c1c-45e8-a3e0-43218da1919a tempest-VolumesGetTestJSON-1841825273 None] Lock "cinder-quobyte-577a05a0-c305-4843-8a13-551bbb78c170" acquired by "delete_volume" :: waited 0.022s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:23:10 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[809f6291-b24e-48b4-b740-ae8ae83fef0a]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:23:10 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-aa93725d-294e-4d4d-89ab-3ac3061143c6 req-cfbff1cc-8c1c-45e8-a3e0-43218da1919a tempest-VolumesGetTestJSON-1841825273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-577a05a0-c305-4843-8a13-551bbb78c170 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:23:10 devstack sudo[84992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-577a05a0-c305-4843-8a13-551bbb78c170
Feb 27 01:23:10 devstack sudo[84992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:23:11 devstack sudo[84992]: pam_unix(sudo:session): session closed for user root
Feb 27 01:23:11 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-aa93725d-294e-4d4d-89ab-3ac3061143c6 req-cfbff1cc-8c1c-45e8-a3e0-43218da1919a tempest-VolumesGetTestJSON-1841825273 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-577a05a0-c305-4843-8a13-551bbb78c170" returned: 0 in 0.611s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:23:11 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-aa93725d-294e-4d4d-89ab-3ac3061143c6 req-cfbff1cc-8c1c-45e8-a3e0-43218da1919a tempest-VolumesGetTestJSON-1841825273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-577a05a0-c305-4843-8a13-551bbb78c170 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:23:11 devstack sudo[85001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-577a05a0-c305-4843-8a13-551bbb78c170
Feb 27 01:23:11 devstack sudo[85001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:23:11 devstack sudo[85001]: pam_unix(sudo:session): session closed for user root
Feb 27 01:23:11 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-aa93725d-294e-4d4d-89ab-3ac3061143c6 req-cfbff1cc-8c1c-45e8-a3e0-43218da1919a tempest-VolumesGetTestJSON-1841825273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-577a05a0-c305-4843-8a13-551bbb78c170" returned: 0 in 0.612s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:23:11 devstack cinder-volume[83106]: DEBUG cinder.coordination [req-aa93725d-294e-4d4d-89ab-3ac3061143c6 req-cfbff1cc-8c1c-45e8-a3e0-43218da1919a tempest-VolumesGetTestJSON-1841825273 None] Lock "cinder-quobyte-577a05a0-c305-4843-8a13-551bbb78c170" released by "delete_volume" :: held 1.262s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:23:11 devstack cinder-volume[83106]: DEBUG cinder.quota [req-aa93725d-294e-4d4d-89ab-3ac3061143c6 req-cfbff1cc-8c1c-45e8-a3e0-43218da1919a tempest-VolumesGetTestJSON-1841825273 None] Created reservations ['af53bb32-470e-444b-9df5-c69dded6f15a', '62278713-16dd-4eed-8ebd-5c69bd733f2f', 'da3bf1ea-c314-4045-b741-67e57f7cd7b4', '6e52a3f8-f047-46ec-989c-b3fd63bcd7c5'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:23:11 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [req-aa93725d-294e-4d4d-89ab-3ac3061143c6 req-cfbff1cc-8c1c-45e8-a3e0-43218da1919a tempest-VolumesGetTestJSON-1841825273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:23:11 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [req-aa93725d-294e-4d4d-89ab-3ac3061143c6 req-cfbff1cc-8c1c-45e8-a3e0-43218da1919a tempest-VolumesGetTestJSON-1841825273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:23:11 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [req-aa93725d-294e-4d4d-89ab-3ac3061143c6 req-cfbff1cc-8c1c-45e8-a3e0-43218da1919a tempest-VolumesGetTestJSON-1841825273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:23:11 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [req-aa93725d-294e-4d4d-89ab-3ac3061143c6 req-cfbff1cc-8c1c-45e8-a3e0-43218da1919a tempest-VolumesGetTestJSON-1841825273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:23:11 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [req-aa93725d-294e-4d4d-89ab-3ac3061143c6 req-cfbff1cc-8c1c-45e8-a3e0-43218da1919a tempest-VolumesGetTestJSON-1841825273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:23:11 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-aa93725d-294e-4d4d-89ab-3ac3061143c6 req-cfbff1cc-8c1c-45e8-a3e0-43218da1919a tempest-VolumesGetTestJSON-1841825273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:23:11 devstack sudo[85038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:23:11 devstack sudo[85038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:23:12 devstack sudo[85038]: pam_unix(sudo:session): session closed for user root
Feb 27 01:23:12 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-aa93725d-294e-4d4d-89ab-3ac3061143c6 req-cfbff1cc-8c1c-45e8-a3e0-43218da1919a tempest-VolumesGetTestJSON-1841825273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.546s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:23:12 devstack cinder-volume[83106]: DEBUG cinder.manager [req-aa93725d-294e-4d4d-89ab-3ac3061143c6 req-cfbff1cc-8c1c-45e8-a3e0-43218da1919a tempest-VolumesGetTestJSON-1841825273 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:23:12 devstack cinder-volume[83106]: INFO cinder.volume.manager [req-aa93725d-294e-4d4d-89ab-3ac3061143c6 req-cfbff1cc-8c1c-45e8-a3e0-43218da1919a tempest-VolumesGetTestJSON-1841825273 None] Deleted volume successfully.
Feb 27 01:23:12 devstack cinder-volume[83106]: DEBUG cinder.coordination [req-aa93725d-294e-4d4d-89ab-3ac3061143c6 req-cfbff1cc-8c1c-45e8-a3e0-43218da1919a tempest-VolumesGetTestJSON-1841825273 None] Lock "cinder-577a05a0-c305-4843-8a13-551bbb78c170-delete_volume" released by "delete_volume" :: held 2.017s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:23:16 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-9eed26ce-58cb-4909-ae5d-715138959f9f tempest-GroupSnapshotsTest-208290777 None] Group tempest-GroupSnapshotsTest-Group-374002952: creating
Feb 27 01:23:16 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-9eed26ce-58cb-4909-ae5d-715138959f9f tempest-GroupSnapshotsTest-208290777 None] Group tempest-GroupSnapshotsTest-Group-374002952: created successfully
Feb 27 01:23:16 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-9eed26ce-58cb-4909-ae5d-715138959f9f tempest-GroupSnapshotsTest-208290777 None] Create group completed successfully.
Feb 27 01:23:18 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9c73dc9-8002-4373-bb9f-e555252bc1e3 tempest-GroupSnapshotsTest-208290777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:23:18 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a9c73dc9-8002-4373-bb9f-e555252bc1e3 tempest-GroupSnapshotsTest-208290777 None] Flow 'volume_create_manager' (7421929c-8192-4195-b016-44b4eed8c178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:23:18 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a9c73dc9-8002-4373-bb9f-e555252bc1e3 tempest-GroupSnapshotsTest-208290777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81df46f0-602f-462e-9526-cb5c3fccf163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:23:18 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a9c73dc9-8002-4373-bb9f-e555252bc1e3 tempest-GroupSnapshotsTest-208290777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81df46f0-602f-462e-9526-cb5c3fccf163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:23:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1736983981',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b4c4d3d0-4c8c-4163-80c7-5ae47903a817,host='devstack@QuobyteHD#QuobyteHD',id=099dfa46-f079-4f42-9482-c27563b74f54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac472ce010b34a03b2fb9217cfad031e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:23:18Z,use_quota=True,user_id='0219e94a4390484f905ea633322ed978',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc3116cb-9d0f-401c-bb80-d5402fd06735),volume_type_id=dc3116cb-9d0f-401c-bb80-d5402fd06735)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:23:18 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a9c73dc9-8002-4373-bb9f-e555252bc1e3 tempest-GroupSnapshotsTest-208290777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b009c02e-3dcf-4bf0-8375-373aff726f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:23:18 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a9c73dc9-8002-4373-bb9f-e555252bc1e3 tempest-GroupSnapshotsTest-208290777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b009c02e-3dcf-4bf0-8375-373aff726f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:23:18 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a9c73dc9-8002-4373-bb9f-e555252bc1e3 tempest-GroupSnapshotsTest-208290777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (968ce263-381a-406e-92ef-d400dfea960f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:23:18 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a9c73dc9-8002-4373-bb9f-e555252bc1e3 tempest-GroupSnapshotsTest-208290777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (968ce263-381a-406e-92ef-d400dfea960f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '099dfa46-f079-4f42-9482-c27563b74f54', 'volume_name': 'volume-099dfa46-f079-4f42-9482-c27563b74f54', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:23:18 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a9c73dc9-8002-4373-bb9f-e555252bc1e3 tempest-GroupSnapshotsTest-208290777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94a00ddc-159a-4851-b7f5-b22307be419d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:23:18 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a9c73dc9-8002-4373-bb9f-e555252bc1e3 tempest-GroupSnapshotsTest-208290777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94a00ddc-159a-4851-b7f5-b22307be419d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:23:18 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a9c73dc9-8002-4373-bb9f-e555252bc1e3 tempest-GroupSnapshotsTest-208290777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d358586a-3ead-4479-b95c-01bb4c3c7646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:23:18 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-a9c73dc9-8002-4373-bb9f-e555252bc1e3 tempest-GroupSnapshotsTest-208290777 None] Volume 099dfa46-f079-4f42-9482-c27563b74f54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-099dfa46-f079-4f42-9482-c27563b74f54', 'volume_size': 1}
Feb 27 01:23:18 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-a9c73dc9-8002-4373-bb9f-e555252bc1e3 tempest-GroupSnapshotsTest-208290777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:23:18 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-a9c73dc9-8002-4373-bb9f-e555252bc1e3 tempest-GroupSnapshotsTest-208290777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:23:18 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-a9c73dc9-8002-4373-bb9f-e555252bc1e3 tempest-GroupSnapshotsTest-208290777 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=b4c4d3d0-4c8c-4163-80c7-5ae47903a817,created_at=2026-02-27T00:23:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1736983981',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b4c4d3d0-4c8c-4163-80c7-5ae47903a817,host='devstack@QuobyteHD#QuobyteHD',id=099dfa46-f079-4f42-9482-c27563b74f54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac472ce010b34a03b2fb9217cfad031e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:23:18Z,use_quota=True,user_id='0219e94a4390484f905ea633322ed978',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc3116cb-9d0f-401c-bb80-d5402fd06735),volume_type_id=dc3116cb-9d0f-401c-bb80-d5402fd06735)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:23:18 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-a9c73dc9-8002-4373-bb9f-e555252bc1e3 tempest-GroupSnapshotsTest-208290777 None] Creating volume 099dfa46-f079-4f42-9482-c27563b74f54 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:23:18 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-a9c73dc9-8002-4373-bb9f-e555252bc1e3 tempest-GroupSnapshotsTest-208290777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:23:18 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-a9c73dc9-8002-4373-bb9f-e555252bc1e3 tempest-GroupSnapshotsTest-208290777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:23:18 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-a9c73dc9-8002-4373-bb9f-e555252bc1e3 tempest-GroupSnapshotsTest-208290777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:23:18 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-a9c73dc9-8002-4373-bb9f-e555252bc1e3 tempest-GroupSnapshotsTest-208290777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:23:18 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-a9c73dc9-8002-4373-bb9f-e555252bc1e3 tempest-GroupSnapshotsTest-208290777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:23:18 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-a9c73dc9-8002-4373-bb9f-e555252bc1e3 tempest-GroupSnapshotsTest-208290777 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:23:18 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-a9c73dc9-8002-4373-bb9f-e555252bc1e3 tempest-GroupSnapshotsTest-208290777 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:23:18 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a9c73dc9-8002-4373-bb9f-e555252bc1e3 tempest-GroupSnapshotsTest-208290777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-099dfa46-f079-4f42-9482-c27563b74f54 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:23:18 devstack sudo[85059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-099dfa46-f079-4f42-9482-c27563b74f54 1073741824
Feb 27 01:23:18 devstack sudo[85059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:23:19 devstack sudo[85059]: pam_unix(sudo:session): session closed for user root
Feb 27 01:23:19 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a9c73dc9-8002-4373-bb9f-e555252bc1e3 tempest-GroupSnapshotsTest-208290777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-099dfa46-f079-4f42-9482-c27563b74f54 1073741824" returned: 0 in 0.886s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:23:19 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a9c73dc9-8002-4373-bb9f-e555252bc1e3 tempest-GroupSnapshotsTest-208290777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-099dfa46-f079-4f42-9482-c27563b74f54 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:23:19 devstack sudo[85067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-099dfa46-f079-4f42-9482-c27563b74f54
Feb 27 01:23:19 devstack sudo[85067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:23:19 devstack sudo[85067]: pam_unix(sudo:session): session closed for user root
Feb 27 01:23:19 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a9c73dc9-8002-4373-bb9f-e555252bc1e3 tempest-GroupSnapshotsTest-208290777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-099dfa46-f079-4f42-9482-c27563b74f54" returned: 0 in 0.512s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:23:19 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-a9c73dc9-8002-4373-bb9f-e555252bc1e3 tempest-GroupSnapshotsTest-208290777 None] <== create_volume: return (1449ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:23:19 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-a9c73dc9-8002-4373-bb9f-e555252bc1e3 tempest-GroupSnapshotsTest-208290777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.455s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:23:19 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a9c73dc9-8002-4373-bb9f-e555252bc1e3 tempest-GroupSnapshotsTest-208290777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d358586a-3ead-4479-b95c-01bb4c3c7646) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-099dfa46-f079-4f42-9482-c27563b74f54', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:23:19 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a9c73dc9-8002-4373-bb9f-e555252bc1e3 tempest-GroupSnapshotsTest-208290777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e06f45a-2496-4f3f-b478-6161fc68111c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:23:19 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-a9c73dc9-8002-4373-bb9f-e555252bc1e3 tempest-GroupSnapshotsTest-208290777 None] Volume volume-099dfa46-f079-4f42-9482-c27563b74f54 (099dfa46-f079-4f42-9482-c27563b74f54): created successfully
Feb 27 01:23:19 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a9c73dc9-8002-4373-bb9f-e555252bc1e3 tempest-GroupSnapshotsTest-208290777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e06f45a-2496-4f3f-b478-6161fc68111c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:23:19 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a9c73dc9-8002-4373-bb9f-e555252bc1e3 tempest-GroupSnapshotsTest-208290777 None] Flow 'volume_create_manager' (7421929c-8192-4195-b016-44b4eed8c178) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:23:19 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-a9c73dc9-8002-4373-bb9f-e555252bc1e3 tempest-GroupSnapshotsTest-208290777 None] Created volume successfully.
Feb 27 01:23:20 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-29126c09-1d06-4ea3-9378-7ff438c7ac46 tempest-GroupSnapshotsTest-208290777 None] GroupSnapshot 9d1c1868-0cb4-4269-92c8-8f29a81486ca: creating.
Feb 27 01:23:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-29126c09-1d06-4ea3-9378-7ff438c7ac46 tempest-GroupSnapshotsTest-208290777 None] Group snapshot 9d1c1868-0cb4-4269-92c8-8f29a81486ca: creating. {{(pid=83106) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Feb 27 01:23:20 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-29126c09-1d06-4ea3-9378-7ff438c7ac46 tempest-GroupSnapshotsTest-208290777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:23:20 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-29126c09-1d06-4ea3-9378-7ff438c7ac46 tempest-GroupSnapshotsTest-208290777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:23:20 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-29126c09-1d06-4ea3-9378-7ff438c7ac46 tempest-GroupSnapshotsTest-208290777 None] Creating offline snapshot a034a247-0b90-4ac8-bd99-da08205d9694 of volume 099dfa46-f079-4f42-9482-c27563b74f54 {{(pid=83106) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:23:20 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[808ec239-cad4-45e5-bb4a-27126235302d]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:23:20 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-29126c09-1d06-4ea3-9378-7ff438c7ac46 tempest-GroupSnapshotsTest-208290777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-099dfa46-f079-4f42-9482-c27563b74f54 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:23:20 devstack sudo[85073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-099dfa46-f079-4f42-9482-c27563b74f54
Feb 27 01:23:20 devstack sudo[85073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:23:21 devstack sudo[85073]: pam_unix(sudo:session): session closed for user root
Feb 27 01:23:21 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-29126c09-1d06-4ea3-9378-7ff438c7ac46 tempest-GroupSnapshotsTest-208290777 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-099dfa46-f079-4f42-9482-c27563b74f54" returned: 0 in 0.515s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:23:21 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-29126c09-1d06-4ea3-9378-7ff438c7ac46 tempest-GroupSnapshotsTest-208290777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-099dfa46-f079-4f42-9482-c27563b74f54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-099dfa46-f079-4f42-9482-c27563b74f54.a034a247-0b90-4ac8-bd99-da08205d9694 1G {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:23:21 devstack sudo[85078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-099dfa46-f079-4f42-9482-c27563b74f54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-099dfa46-f079-4f42-9482-c27563b74f54.a034a247-0b90-4ac8-bd99-da08205d9694 1G
Feb 27 01:23:21 devstack sudo[85078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:23:21 devstack sudo[85078]: pam_unix(sudo:session): session closed for user root
Feb 27 01:23:21 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-29126c09-1d06-4ea3-9378-7ff438c7ac46 tempest-GroupSnapshotsTest-208290777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-099dfa46-f079-4f42-9482-c27563b74f54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-099dfa46-f079-4f42-9482-c27563b74f54.a034a247-0b90-4ac8-bd99-da08205d9694 1G" returned: 0 in 0.613s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:23:21 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-29126c09-1d06-4ea3-9378-7ff438c7ac46 tempest-GroupSnapshotsTest-208290777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-099dfa46-f079-4f42-9482-c27563b74f54 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-099dfa46-f079-4f42-9482-c27563b74f54.a034a247-0b90-4ac8-bd99-da08205d9694 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:23:21 devstack sudo[85087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-099dfa46-f079-4f42-9482-c27563b74f54 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-099dfa46-f079-4f42-9482-c27563b74f54.a034a247-0b90-4ac8-bd99-da08205d9694
Feb 27 01:23:21 devstack sudo[85087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:23:22 devstack sudo[85087]: pam_unix(sudo:session): session closed for user root
Feb 27 01:23:22 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-29126c09-1d06-4ea3-9378-7ff438c7ac46 tempest-GroupSnapshotsTest-208290777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-099dfa46-f079-4f42-9482-c27563b74f54 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-099dfa46-f079-4f42-9482-c27563b74f54.a034a247-0b90-4ac8-bd99-da08205d9694" returned: 0 in 0.474s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:23:22 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-29126c09-1d06-4ea3-9378-7ff438c7ac46 tempest-GroupSnapshotsTest-208290777 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-099dfa46-f079-4f42-9482-c27563b74f54.a034a247-0b90-4ac8-bd99-da08205d9694 is being set with open permissions: ugo+rw: NotImplementedError
Feb 27 01:23:22 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-29126c09-1d06-4ea3-9378-7ff438c7ac46 tempest-GroupSnapshotsTest-208290777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-099dfa46-f079-4f42-9482-c27563b74f54.a034a247-0b90-4ac8-bd99-da08205d9694 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:23:22 devstack sudo[85092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-099dfa46-f079-4f42-9482-c27563b74f54.a034a247-0b90-4ac8-bd99-da08205d9694
Feb 27 01:23:22 devstack sudo[85092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:23:22 devstack sudo[85092]: pam_unix(sudo:session): session closed for user root
Feb 27 01:23:22 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-29126c09-1d06-4ea3-9378-7ff438c7ac46 tempest-GroupSnapshotsTest-208290777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-099dfa46-f079-4f42-9482-c27563b74f54.a034a247-0b90-4ac8-bd99-da08205d9694" returned: 0 in 0.429s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:23:22 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-29126c09-1d06-4ea3-9378-7ff438c7ac46 tempest-GroupSnapshotsTest-208290777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-099dfa46-f079-4f42-9482-c27563b74f54.info {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:23:22 devstack sudo[85101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-099dfa46-f079-4f42-9482-c27563b74f54.info
Feb 27 01:23:22 devstack sudo[85101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:23:23 devstack sudo[85101]: pam_unix(sudo:session): session closed for user root
Feb 27 01:23:23 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-29126c09-1d06-4ea3-9378-7ff438c7ac46 tempest-GroupSnapshotsTest-208290777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-099dfa46-f079-4f42-9482-c27563b74f54.info" returned: 0 in 0.509s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:23:23 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-29126c09-1d06-4ea3-9378-7ff438c7ac46 tempest-GroupSnapshotsTest-208290777 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-099dfa46-f079-4f42-9482-c27563b74f54.info is being set with open permissions: ugo+rw: NotImplementedError
Feb 27 01:23:23 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-29126c09-1d06-4ea3-9378-7ff438c7ac46 tempest-GroupSnapshotsTest-208290777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-099dfa46-f079-4f42-9482-c27563b74f54.info {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:23:23 devstack sudo[85121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-099dfa46-f079-4f42-9482-c27563b74f54.info
Feb 27 01:23:23 devstack sudo[85121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:23:24 devstack sudo[85121]: pam_unix(sudo:session): session closed for user root
Feb 27 01:23:24 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-29126c09-1d06-4ea3-9378-7ff438c7ac46 tempest-GroupSnapshotsTest-208290777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-099dfa46-f079-4f42-9482-c27563b74f54.info" returned: 0 in 1.034s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:23:24 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-29126c09-1d06-4ea3-9378-7ff438c7ac46 tempest-GroupSnapshotsTest-208290777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.698s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:23:24 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-29126c09-1d06-4ea3-9378-7ff438c7ac46 tempest-GroupSnapshotsTest-208290777 None] group_snapshot 9d1c1868-0cb4-4269-92c8-8f29a81486ca: created successfully
Feb 27 01:23:26 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-34c8fee4-0072-4863-99e7-a749310499c9 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:23:26 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-34c8fee4-0072-4863-99e7-a749310499c9 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Flow 'volume_create_manager' (7354af90-ff86-47af-90b7-80a3d811e5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:23:26 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-34c8fee4-0072-4863-99e7-a749310499c9 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1eddf2a-b568-422e-934f-594d726bd08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:23:26 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-34c8fee4-0072-4863-99e7-a749310499c9 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1eddf2a-b568-422e-934f-594d726bd08f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:23:26Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=363bbf57-d127-4cf7-b12f-197fa82f28d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c84a1e54202b4f1f807e8c66d048eb05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:23:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:23:27Z,use_quota=True,user_id='4a34621a36c34d768c38e8622a355585',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:23:26 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-34c8fee4-0072-4863-99e7-a749310499c9 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd9e4458-ebf9-4579-8f78-f6f9f79d59a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:23:26 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-34c8fee4-0072-4863-99e7-a749310499c9 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd9e4458-ebf9-4579-8f78-f6f9f79d59a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:23:26 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-34c8fee4-0072-4863-99e7-a749310499c9 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83c67bd7-c1ad-432b-ab16-5fbb90c65d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:23:26 devstack cinder-volume[83106]: DEBUG cinder.image.glance [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-34c8fee4-0072-4863-99e7-a749310499c9 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Creating Keystone auth plugin from conf {{(pid=83106) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Feb 27 01:23:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-8e81c456-0145-4239-a1ad-1bed3155f39a tempest-GroupSnapshotsTest-208290777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:23:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-8e81c456-0145-4239-a1ad-1bed3155f39a tempest-GroupSnapshotsTest-208290777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:23:27 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-8e81c456-0145-4239-a1ad-1bed3155f39a tempest-GroupSnapshotsTest-208290777 None] Acquiring lock "cinder-quobyte-a034a247-0b90-4ac8-bd99-da08205d9694-bf51754a-5178-4743-9944-c01babe87b83" by "_create_volume_from_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:23:27 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-8e81c456-0145-4239-a1ad-1bed3155f39a tempest-GroupSnapshotsTest-208290777 None] Lock "cinder-quobyte-a034a247-0b90-4ac8-bd99-da08205d9694-bf51754a-5178-4743-9944-c01babe87b83" acquired by "_create_volume_from_snapshot" :: waited 0.047s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:23:27 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-8e81c456-0145-4239-a1ad-1bed3155f39a tempest-GroupSnapshotsTest-208290777 None] Creating volume bf51754a-5178-4743-9944-c01babe87b83 from snapshot a034a247-0b90-4ac8-bd99-da08205d9694 {{(pid=83106) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Feb 27 01:23:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-8e81c456-0145-4239-a1ad-1bed3155f39a tempest-GroupSnapshotsTest-208290777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:23:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-8e81c456-0145-4239-a1ad-1bed3155f39a tempest-GroupSnapshotsTest-208290777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:23:27 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-8e81c456-0145-4239-a1ad-1bed3155f39a tempest-GroupSnapshotsTest-208290777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:23:27 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-8e81c456-0145-4239-a1ad-1bed3155f39a tempest-GroupSnapshotsTest-208290777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:23:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-8e81c456-0145-4239-a1ad-1bed3155f39a tempest-GroupSnapshotsTest-208290777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:23:27 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-8e81c456-0145-4239-a1ad-1bed3155f39a tempest-GroupSnapshotsTest-208290777 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:23:27 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-8e81c456-0145-4239-a1ad-1bed3155f39a tempest-GroupSnapshotsTest-208290777 None] Acquiring lock "cinder-quobyte-bf51754a-5178-4743-9944-c01babe87b83" by "_copy_volume_from_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:23:27 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-8e81c456-0145-4239-a1ad-1bed3155f39a tempest-GroupSnapshotsTest-208290777 None] Lock "cinder-quobyte-bf51754a-5178-4743-9944-c01babe87b83" acquired by "_copy_volume_from_snapshot" :: waited 0.109s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:23:27 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-8e81c456-0145-4239-a1ad-1bed3155f39a tempest-GroupSnapshotsTest-208290777 None] snapshot: a034a247-0b90-4ac8-bd99-da08205d9694, volume: bf51754a-5178-4743-9944-c01babe87b83,  {{(pid=83106) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Feb 27 01:23:27 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-7045faef-09d3-40c6-a31d-147ac7a71f3f tempest-VolumesAdminNegativeTest-1545613327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:23:27 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7045faef-09d3-40c6-a31d-147ac7a71f3f tempest-VolumesAdminNegativeTest-1545613327 None] Flow 'volume_create_manager' (f38dfa75-6f00-4314-8a1d-34e6b2b1d9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:23:27 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7045faef-09d3-40c6-a31d-147ac7a71f3f tempest-VolumesAdminNegativeTest-1545613327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1257bea-6547-4dfc-81d5-20a411903307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:23:27 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7045faef-09d3-40c6-a31d-147ac7a71f3f tempest-VolumesAdminNegativeTest-1545613327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1257bea-6547-4dfc-81d5-20a411903307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:23:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-576375916',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aabebf5-da60-46be-940a-ebebf9d0bd2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a374b6824f324231898cbfba90c88fbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:23:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:23:27Z,use_quota=True,user_id='0515e36b12a54913ab2371e9c507cc76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:23:27 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7045faef-09d3-40c6-a31d-147ac7a71f3f tempest-VolumesAdminNegativeTest-1545613327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c70f26f0-3b25-4640-904d-ccbe91d1120b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:23:27 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7045faef-09d3-40c6-a31d-147ac7a71f3f tempest-VolumesAdminNegativeTest-1545613327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c70f26f0-3b25-4640-904d-ccbe91d1120b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:23:27 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7045faef-09d3-40c6-a31d-147ac7a71f3f tempest-VolumesAdminNegativeTest-1545613327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a00948f-842a-4aa0-b201-ea12db65e90d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:23:27 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7045faef-09d3-40c6-a31d-147ac7a71f3f tempest-VolumesAdminNegativeTest-1545613327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a00948f-842a-4aa0-b201-ea12db65e90d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6aabebf5-da60-46be-940a-ebebf9d0bd2e', 'volume_name': 'volume-6aabebf5-da60-46be-940a-ebebf9d0bd2e', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:23:27 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7045faef-09d3-40c6-a31d-147ac7a71f3f tempest-VolumesAdminNegativeTest-1545613327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fc7b3dd-74e6-4a14-bda9-e3719d830957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:23:27 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7045faef-09d3-40c6-a31d-147ac7a71f3f tempest-VolumesAdminNegativeTest-1545613327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fc7b3dd-74e6-4a14-bda9-e3719d830957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:23:27 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7045faef-09d3-40c6-a31d-147ac7a71f3f tempest-VolumesAdminNegativeTest-1545613327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03c76392-c94e-43ed-bcaf-3335104a69d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:23:27 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-7045faef-09d3-40c6-a31d-147ac7a71f3f tempest-VolumesAdminNegativeTest-1545613327 None] Volume 6aabebf5-da60-46be-940a-ebebf9d0bd2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6aabebf5-da60-46be-940a-ebebf9d0bd2e', 'volume_size': 1}
Feb 27 01:23:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-7045faef-09d3-40c6-a31d-147ac7a71f3f tempest-VolumesAdminNegativeTest-1545613327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:23:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-8e81c456-0145-4239-a1ad-1bed3155f39a tempest-GroupSnapshotsTest-208290777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:23:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-8e81c456-0145-4239-a1ad-1bed3155f39a tempest-GroupSnapshotsTest-208290777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:23:27 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-8e81c456-0145-4239-a1ad-1bed3155f39a tempest-GroupSnapshotsTest-208290777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:23:27 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-8e81c456-0145-4239-a1ad-1bed3155f39a tempest-GroupSnapshotsTest-208290777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:23:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-8e81c456-0145-4239-a1ad-1bed3155f39a tempest-GroupSnapshotsTest-208290777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:23:27 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d0be03-07a5-4f79-9846-927bef9d29c3]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:23:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-8e81c456-0145-4239-a1ad-1bed3155f39a tempest-GroupSnapshotsTest-208290777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-099dfa46-f079-4f42-9482-c27563b74f54.a034a247-0b90-4ac8-bd99-da08205d9694 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:23:27 devstack sudo[85158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-099dfa46-f079-4f42-9482-c27563b74f54.a034a247-0b90-4ac8-bd99-da08205d9694
Feb 27 01:23:27 devstack sudo[85158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:23:27 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-34c8fee4-0072-4863-99e7-a749310499c9 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83c67bd7-c1ad-432b-ab16-5fbb90c65d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '363bbf57-d127-4cf7-b12f-197fa82f28d8', 'volume_name': 'volume-363bbf57-d127-4cf7-b12f-197fa82f28d8', 'volume_size': 1, 'image_id': '4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd105600f18404a29b5061e7b75a5bfe1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca', 'created_at': datetime.datetime(2026, 2, 27, 0, 17, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 17, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f07e936a7a0>}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:23:27 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-34c8fee4-0072-4863-99e7-a749310499c9 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (034c5e83-a5a0-42ce-9399-c4a453a98bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:23:27 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-34c8fee4-0072-4863-99e7-a749310499c9 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (034c5e83-a5a0-42ce-9399-c4a453a98bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:23:27 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-34c8fee4-0072-4863-99e7-a749310499c9 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c52fb7c9-8491-4c12-b87c-2461516e4409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:23:27 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-34c8fee4-0072-4863-99e7-a749310499c9 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Volume 363bbf57-d127-4cf7-b12f-197fa82f28d8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-363bbf57-d127-4cf7-b12f-197fa82f28d8', 'volume_size': 1, 'image_id': '4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd105600f18404a29b5061e7b75a5bfe1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca', 'created_at': datetime.datetime(2026, 2, 27, 0, 17, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 17, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f07e936a7a0>}
Feb 27 01:23:27 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-34c8fee4-0072-4863-99e7-a749310499c9 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Trying to clone 363bbf57-d127-4cf7-b12f-197fa82f28d8 from image 4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca at location (None, [{'url': 'file:///opt/stack/data/glance/images/4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca', 'metadata': {}}]). {{(pid=83106) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Feb 27 01:23:28 devstack cinder-volume[83106]: DEBUG cinder.image.image_utils [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-34c8fee4-0072-4863-99e7-a749310499c9 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_oev5lnvtdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83106) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Feb 27 01:23:28 devstack cinder-volume[83106]: INFO cinder.image.image_utils [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-34c8fee4-0072-4863-99e7-a749310499c9 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Image download 20.69 MB at 20.69 MB/s
Feb 27 01:23:28 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9cae76d-3c08-4c9b-a4b8-676b64f9db62]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:23:28 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-34c8fee4-0072-4863-99e7-a749310499c9 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_oev5lnvtdevstack@QuobyteHD {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:23:28 devstack sudo[85158]: pam_unix(sudo:session): session closed for user root
Feb 27 01:23:28 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-8e81c456-0145-4239-a1ad-1bed3155f39a tempest-GroupSnapshotsTest-208290777 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-099dfa46-f079-4f42-9482-c27563b74f54.a034a247-0b90-4ac8-bd99-da08205d9694" returned: 0 in 1.031s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:23:28 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-8e81c456-0145-4239-a1ad-1bed3155f39a tempest-GroupSnapshotsTest-208290777 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-099dfa46-f079-4f42-9482-c27563b74f54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83106) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:23:28 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-8e81c456-0145-4239-a1ad-1bed3155f39a tempest-GroupSnapshotsTest-208290777 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-099dfa46-f079-4f42-9482-c27563b74f54 {{(pid=83106) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Feb 27 01:23:28 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-8e81c456-0145-4239-a1ad-1bed3155f39a tempest-GroupSnapshotsTest-208290777 None] Creating direct copy from snapshot {{(pid=83106) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Feb 27 01:23:28 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50a98e8-4553-48f0-a8b3-71f757c091b9]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:23:28 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-8e81c456-0145-4239-a1ad-1bed3155f39a tempest-GroupSnapshotsTest-208290777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-099dfa46-f079-4f42-9482-c27563b74f54 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:23:28 devstack sudo[85189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_oev5lnvtdevstack@QuobyteHD
Feb 27 01:23:28 devstack sudo[85189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:23:28 devstack sudo[85195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-099dfa46-f079-4f42-9482-c27563b74f54
Feb 27 01:23:28 devstack sudo[85195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:23:29 devstack sudo[85195]: pam_unix(sudo:session): session closed for user root
Feb 27 01:23:29 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-8e81c456-0145-4239-a1ad-1bed3155f39a tempest-GroupSnapshotsTest-208290777 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-099dfa46-f079-4f42-9482-c27563b74f54" returned: 0 in 0.923s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:23:29 devstack cinder-volume[83106]: DEBUG cinder.utils [None req-8e81c456-0145-4239-a1ad-1bed3155f39a tempest-GroupSnapshotsTest-208290777 None] Path /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-bf51754a-5178-4743-9944-c01babe87b83 not found in is_blk_device check {{(pid=83106) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Feb 27 01:23:29 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-8e81c456-0145-4239-a1ad-1bed3155f39a tempest-GroupSnapshotsTest-208290777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-099dfa46-f079-4f42-9482-c27563b74f54 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-bf51754a-5178-4743-9944-c01babe87b83 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:23:29 devstack sudo[85189]: pam_unix(sudo:session): session closed for user root
Feb 27 01:23:29 devstack sudo[85210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-099dfa46-f079-4f42-9482-c27563b74f54 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-bf51754a-5178-4743-9944-c01babe87b83
Feb 27 01:23:29 devstack sudo[85210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:23:29 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-34c8fee4-0072-4863-99e7-a749310499c9 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_oev5lnvtdevstack@QuobyteHD" returned: 0 in 1.124s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:23:29 devstack cinder-volume[83106]: DEBUG cinder.image.image_utils [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-34c8fee4-0072-4863-99e7-a749310499c9 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Temporary image 4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca is fetched for user 4a34621a36c34d768c38e8622a355585. {{(pid=83106) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Feb 27 01:23:29 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e64cca-5075-4214-b0f4-292f1b11731b]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:23:29 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-34c8fee4-0072-4863-99e7-a749310499c9 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_oev5lnvtdevstack@QuobyteHD {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:23:29 devstack sudo[85212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_oev5lnvtdevstack@QuobyteHD
Feb 27 01:23:29 devstack sudo[85212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:23:30 devstack sudo[85212]: pam_unix(sudo:session): session closed for user root
Feb 27 01:23:30 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-34c8fee4-0072-4863-99e7-a749310499c9 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_oev5lnvtdevstack@QuobyteHD" returned: 0 in 0.678s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:23:30 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-34c8fee4-0072-4863-99e7-a749310499c9 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:23:34 devstack sudo[85210]: pam_unix(sudo:session): session closed for user root
Feb 27 01:23:34 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-8e81c456-0145-4239-a1ad-1bed3155f39a tempest-GroupSnapshotsTest-208290777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-099dfa46-f079-4f42-9482-c27563b74f54 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-bf51754a-5178-4743-9944-c01babe87b83" returned: 0 in 4.870s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:23:34 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76c40b6-4b6e-4164-9cf1-620f11e6b85c]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:23:34 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-8e81c456-0145-4239-a1ad-1bed3155f39a tempest-GroupSnapshotsTest-208290777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-099dfa46-f079-4f42-9482-c27563b74f54 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:23:34 devstack sudo[85263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-099dfa46-f079-4f42-9482-c27563b74f54
Feb 27 01:23:34 devstack sudo[85263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:23:35 devstack sudo[85263]: pam_unix(sudo:session): session closed for user root
Feb 27 01:23:35 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-8e81c456-0145-4239-a1ad-1bed3155f39a tempest-GroupSnapshotsTest-208290777 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-099dfa46-f079-4f42-9482-c27563b74f54" returned: 0 in 0.687s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:23:35 devstack cinder-volume[83106]: DEBUG cinder.image.image_utils [None req-8e81c456-0145-4239-a1ad-1bed3155f39a tempest-GroupSnapshotsTest-208290777 None] Image conversion details: src /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-099dfa46-f079-4f42-9482-c27563b74f54, size 1024.00 MB, duration 4.87 sec, destination /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-bf51754a-5178-4743-9944-c01babe87b83 {{(pid=83106) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 27 01:23:35 devstack cinder-volume[83106]: INFO cinder.image.image_utils [None req-8e81c456-0145-4239-a1ad-1bed3155f39a tempest-GroupSnapshotsTest-208290777 None] Converted 1024.00 MB image at 210.21 MB/s
Feb 27 01:23:35 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-8e81c456-0145-4239-a1ad-1bed3155f39a tempest-GroupSnapshotsTest-208290777 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-bf51754a-5178-4743-9944-c01babe87b83 is being set with open permissions: ugo+rw: NotImplementedError
Feb 27 01:23:35 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-8e81c456-0145-4239-a1ad-1bed3155f39a tempest-GroupSnapshotsTest-208290777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-bf51754a-5178-4743-9944-c01babe87b83 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:23:35 devstack sudo[85268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-bf51754a-5178-4743-9944-c01babe87b83
Feb 27 01:23:35 devstack sudo[85268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:23:35 devstack sudo[85268]: pam_unix(sudo:session): session closed for user root
Feb 27 01:23:35 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-8e81c456-0145-4239-a1ad-1bed3155f39a tempest-GroupSnapshotsTest-208290777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-bf51754a-5178-4743-9944-c01babe87b83" returned: 0 in 0.461s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:23:35 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-8e81c456-0145-4239-a1ad-1bed3155f39a tempest-GroupSnapshotsTest-208290777 None] Lock "cinder-quobyte-bf51754a-5178-4743-9944-c01babe87b83" released by "_copy_volume_from_snapshot" :: held 8.299s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:23:35 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-8e81c456-0145-4239-a1ad-1bed3155f39a tempest-GroupSnapshotsTest-208290777 None] Lock "cinder-quobyte-a034a247-0b90-4ac8-bd99-da08205d9694-bf51754a-5178-4743-9944-c01babe87b83" released by "_create_volume_from_snapshot" :: held 8.443s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:23:35 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-8e81c456-0145-4239-a1ad-1bed3155f39a tempest-GroupSnapshotsTest-208290777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.492s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:23:35 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-7045faef-09d3-40c6-a31d-147ac7a71f3f tempest-VolumesAdminNegativeTest-1545613327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.185s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:23:35 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-7045faef-09d3-40c6-a31d-147ac7a71f3f tempest-VolumesAdminNegativeTest-1545613327 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:23:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-576375916',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aabebf5-da60-46be-940a-ebebf9d0bd2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a374b6824f324231898cbfba90c88fbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:23:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:23:27Z,use_quota=True,user_id='0515e36b12a54913ab2371e9c507cc76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:23:35 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-7045faef-09d3-40c6-a31d-147ac7a71f3f tempest-VolumesAdminNegativeTest-1545613327 None] Creating volume 6aabebf5-da60-46be-940a-ebebf9d0bd2e {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:23:35 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-7045faef-09d3-40c6-a31d-147ac7a71f3f tempest-VolumesAdminNegativeTest-1545613327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:23:35 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-7045faef-09d3-40c6-a31d-147ac7a71f3f tempest-VolumesAdminNegativeTest-1545613327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:23:35 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-7045faef-09d3-40c6-a31d-147ac7a71f3f tempest-VolumesAdminNegativeTest-1545613327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:23:35 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-7045faef-09d3-40c6-a31d-147ac7a71f3f tempest-VolumesAdminNegativeTest-1545613327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:23:35 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-7045faef-09d3-40c6-a31d-147ac7a71f3f tempest-VolumesAdminNegativeTest-1545613327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:23:35 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-7045faef-09d3-40c6-a31d-147ac7a71f3f tempest-VolumesAdminNegativeTest-1545613327 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:23:35 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-7045faef-09d3-40c6-a31d-147ac7a71f3f tempest-VolumesAdminNegativeTest-1545613327 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:23:35 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7045faef-09d3-40c6-a31d-147ac7a71f3f tempest-VolumesAdminNegativeTest-1545613327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-6aabebf5-da60-46be-940a-ebebf9d0bd2e 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:23:35 devstack sudo[85271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-6aabebf5-da60-46be-940a-ebebf9d0bd2e 1073741824
Feb 27 01:23:35 devstack sudo[85271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:23:35 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-8e81c456-0145-4239-a1ad-1bed3155f39a tempest-GroupSnapshotsTest-208290777 None] Create group from source-snapshot-9d1c1868-0cb4-4269-92c8-8f29a81486ca completed successfully.
Feb 27 01:23:37 devstack sudo[85271]: pam_unix(sudo:session): session closed for user root
Feb 27 01:23:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7045faef-09d3-40c6-a31d-147ac7a71f3f tempest-VolumesAdminNegativeTest-1545613327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-6aabebf5-da60-46be-940a-ebebf9d0bd2e 1073741824" returned: 0 in 1.343s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:23:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7045faef-09d3-40c6-a31d-147ac7a71f3f tempest-VolumesAdminNegativeTest-1545613327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-6aabebf5-da60-46be-940a-ebebf9d0bd2e {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:23:37 devstack sudo[85303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-6aabebf5-da60-46be-940a-ebebf9d0bd2e
Feb 27 01:23:37 devstack sudo[85303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:23:37 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-71fde32a-a7ed-4766-8136-97be6b63d2bc tempest-GroupSnapshotsTest-208290777 None] Acquiring lock "cinder-quobyte-bf51754a-5178-4743-9944-c01babe87b83" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:23:37 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-71fde32a-a7ed-4766-8136-97be6b63d2bc tempest-GroupSnapshotsTest-208290777 None] Lock "cinder-quobyte-bf51754a-5178-4743-9944-c01babe87b83" acquired by "delete_volume" :: waited 0.020s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:23:37 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab98f4b5-4276-4ad3-b2ae-41e5a470ef8d]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:23:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-71fde32a-a7ed-4766-8136-97be6b63d2bc tempest-GroupSnapshotsTest-208290777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-bf51754a-5178-4743-9944-c01babe87b83 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:23:37 devstack sudo[85305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-bf51754a-5178-4743-9944-c01babe87b83
Feb 27 01:23:37 devstack sudo[85305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:23:37 devstack sudo[85303]: pam_unix(sudo:session): session closed for user root
Feb 27 01:23:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7045faef-09d3-40c6-a31d-147ac7a71f3f tempest-VolumesAdminNegativeTest-1545613327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-6aabebf5-da60-46be-940a-ebebf9d0bd2e" returned: 0 in 0.594s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:23:37 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-7045faef-09d3-40c6-a31d-147ac7a71f3f tempest-VolumesAdminNegativeTest-1545613327 None] <== create_volume: return (1969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:23:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-7045faef-09d3-40c6-a31d-147ac7a71f3f tempest-VolumesAdminNegativeTest-1545613327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.973s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:23:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-34c8fee4-0072-4863-99e7-a749310499c9 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.179s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:23:37 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-34c8fee4-0072-4863-99e7-a749310499c9 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:23:26Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=363bbf57-d127-4cf7-b12f-197fa82f28d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c84a1e54202b4f1f807e8c66d048eb05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:23:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:23:27Z,use_quota=True,user_id='4a34621a36c34d768c38e8622a355585',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:23:37 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-34c8fee4-0072-4863-99e7-a749310499c9 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Creating volume 363bbf57-d127-4cf7-b12f-197fa82f28d8 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:23:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-34c8fee4-0072-4863-99e7-a749310499c9 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:23:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-34c8fee4-0072-4863-99e7-a749310499c9 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:23:37 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-34c8fee4-0072-4863-99e7-a749310499c9 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:23:37 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-34c8fee4-0072-4863-99e7-a749310499c9 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:23:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-34c8fee4-0072-4863-99e7-a749310499c9 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:23:37 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-34c8fee4-0072-4863-99e7-a749310499c9 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:23:37 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-34c8fee4-0072-4863-99e7-a749310499c9 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:23:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-34c8fee4-0072-4863-99e7-a749310499c9 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-363bbf57-d127-4cf7-b12f-197fa82f28d8 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:23:37 devstack sudo[85308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-363bbf57-d127-4cf7-b12f-197fa82f28d8 1073741824
Feb 27 01:23:37 devstack sudo[85308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:23:37 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7045faef-09d3-40c6-a31d-147ac7a71f3f tempest-VolumesAdminNegativeTest-1545613327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03c76392-c94e-43ed-bcaf-3335104a69d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6aabebf5-da60-46be-940a-ebebf9d0bd2e', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:23:37 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7045faef-09d3-40c6-a31d-147ac7a71f3f tempest-VolumesAdminNegativeTest-1545613327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cf66a67-ff6c-467f-b34d-38e23642709c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:23:37 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-7045faef-09d3-40c6-a31d-147ac7a71f3f tempest-VolumesAdminNegativeTest-1545613327 None] Volume volume-6aabebf5-da60-46be-940a-ebebf9d0bd2e (6aabebf5-da60-46be-940a-ebebf9d0bd2e): created successfully
Feb 27 01:23:37 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7045faef-09d3-40c6-a31d-147ac7a71f3f tempest-VolumesAdminNegativeTest-1545613327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cf66a67-ff6c-467f-b34d-38e23642709c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:23:37 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7045faef-09d3-40c6-a31d-147ac7a71f3f tempest-VolumesAdminNegativeTest-1545613327 None] Flow 'volume_create_manager' (f38dfa75-6f00-4314-8a1d-34e6b2b1d9fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:23:37 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-7045faef-09d3-40c6-a31d-147ac7a71f3f tempest-VolumesAdminNegativeTest-1545613327 None] Created volume successfully.
Feb 27 01:23:38 devstack sudo[85305]: pam_unix(sudo:session): session closed for user root
Feb 27 01:23:38 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-71fde32a-a7ed-4766-8136-97be6b63d2bc tempest-GroupSnapshotsTest-208290777 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-bf51754a-5178-4743-9944-c01babe87b83" returned: 0 in 0.894s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:23:38 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-71fde32a-a7ed-4766-8136-97be6b63d2bc tempest-GroupSnapshotsTest-208290777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-bf51754a-5178-4743-9944-c01babe87b83 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:23:38 devstack sudo[85316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-bf51754a-5178-4743-9944-c01babe87b83
Feb 27 01:23:38 devstack sudo[85316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:23:38 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-afa5d4d5-2672-4f9e-8d48-f5f666f04a44 tempest-VolumesAdminNegativeTest-1545613327 None] Acquiring lock "cinder-6aabebf5-da60-46be-940a-ebebf9d0bd2e-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:23:38 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-afa5d4d5-2672-4f9e-8d48-f5f666f04a44 tempest-VolumesAdminNegativeTest-1545613327 None] Lock "cinder-6aabebf5-da60-46be-940a-ebebf9d0bd2e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:23:38 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-afa5d4d5-2672-4f9e-8d48-f5f666f04a44 tempest-VolumesAdminNegativeTest-1545613327 None] Acquiring lock "cinder-quobyte-6aabebf5-da60-46be-940a-ebebf9d0bd2e" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:23:38 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-afa5d4d5-2672-4f9e-8d48-f5f666f04a44 tempest-VolumesAdminNegativeTest-1545613327 None] Lock "cinder-quobyte-6aabebf5-da60-46be-940a-ebebf9d0bd2e" acquired by "delete_volume" :: waited 0.009s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:23:38 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf10918-b643-49e0-b926-97bf604c1634]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:23:38 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-afa5d4d5-2672-4f9e-8d48-f5f666f04a44 tempest-VolumesAdminNegativeTest-1545613327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-6aabebf5-da60-46be-940a-ebebf9d0bd2e {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:23:38 devstack sudo[85308]: pam_unix(sudo:session): session closed for user root
Feb 27 01:23:38 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-34c8fee4-0072-4863-99e7-a749310499c9 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-363bbf57-d127-4cf7-b12f-197fa82f28d8 1073741824" returned: 0 in 1.107s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:23:38 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-34c8fee4-0072-4863-99e7-a749310499c9 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-363bbf57-d127-4cf7-b12f-197fa82f28d8 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:23:38 devstack sudo[85319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-6aabebf5-da60-46be-940a-ebebf9d0bd2e
Feb 27 01:23:38 devstack sudo[85319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:23:38 devstack sudo[85320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-363bbf57-d127-4cf7-b12f-197fa82f28d8
Feb 27 01:23:38 devstack sudo[85320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:23:39 devstack sudo[85316]: pam_unix(sudo:session): session closed for user root
Feb 27 01:23:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-71fde32a-a7ed-4766-8136-97be6b63d2bc tempest-GroupSnapshotsTest-208290777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-bf51754a-5178-4743-9944-c01babe87b83" returned: 0 in 0.799s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:23:39 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-71fde32a-a7ed-4766-8136-97be6b63d2bc tempest-GroupSnapshotsTest-208290777 None] Lock "cinder-quobyte-bf51754a-5178-4743-9944-c01babe87b83" released by "delete_volume" :: held 1.790s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:23:39 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-71fde32a-a7ed-4766-8136-97be6b63d2bc tempest-GroupSnapshotsTest-208290777 None] Created reservations ['c6269537-6638-47a1-9c50-a2d02e88b493'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:23:39 devstack sudo[85320]: pam_unix(sudo:session): session closed for user root
Feb 27 01:23:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-34c8fee4-0072-4863-99e7-a749310499c9 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-363bbf57-d127-4cf7-b12f-197fa82f28d8" returned: 0 in 0.534s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:23:39 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-34c8fee4-0072-4863-99e7-a749310499c9 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] <== create_volume: return (1689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:23:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-34c8fee4-0072-4863-99e7-a749310499c9 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.692s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:23:39 devstack cinder-volume[83106]: WARNING cinder.quota [None req-71fde32a-a7ed-4766-8136-97be6b63d2bc tempest-GroupSnapshotsTest-208290777 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1822591746 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1822591746, it is now deprecated. Please use the default quota class for default quota.
Feb 27 01:23:39 devstack cinder-volume[83106]: WARNING cinder.quota [None req-71fde32a-a7ed-4766-8136-97be6b63d2bc tempest-GroupSnapshotsTest-208290777 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1822591746 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1822591746, it is now deprecated. Please use the default quota class for default quota.
Feb 27 01:23:39 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-71fde32a-a7ed-4766-8136-97be6b63d2bc tempest-GroupSnapshotsTest-208290777 None] Created reservations ['59637c1a-04b8-43ee-b68a-2b69382c807f', 'd8015860-ef0a-4e52-82ea-2cdbbd104b28', 'bb79f5cc-57bf-447a-a2e3-e2a17dfb3eec', '8daefd8e-042d-425a-b440-8a5d2af13570'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:23:39 devstack cinder-volume[83106]: DEBUG cinder.volume.volume_utils [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-34c8fee4-0072-4863-99e7-a749310499c9 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Attempting download of 4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca ((None, [{'url': 'file:///opt/stack/data/glance/images/4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca', 'metadata': {}}])) to volume 363bbf57-d127-4cf7-b12f-197fa82f28d8. {{(pid=83106) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Feb 27 01:23:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-71fde32a-a7ed-4766-8136-97be6b63d2bc tempest-GroupSnapshotsTest-208290777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:23:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-71fde32a-a7ed-4766-8136-97be6b63d2bc tempest-GroupSnapshotsTest-208290777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:23:39 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-71fde32a-a7ed-4766-8136-97be6b63d2bc tempest-GroupSnapshotsTest-208290777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:23:39 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-71fde32a-a7ed-4766-8136-97be6b63d2bc tempest-GroupSnapshotsTest-208290777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:23:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-71fde32a-a7ed-4766-8136-97be6b63d2bc tempest-GroupSnapshotsTest-208290777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:23:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-71fde32a-a7ed-4766-8136-97be6b63d2bc tempest-GroupSnapshotsTest-208290777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:23:39 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb6d213-051c-423d-883a-21821e4b01af]: (4, 'raw') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:23:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-34c8fee4-0072-4863-99e7-a749310499c9 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_njlsb2iv {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:23:39 devstack sudo[85328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:23:39 devstack sudo[85328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:23:39 devstack sudo[85319]: pam_unix(sudo:session): session closed for user root
Feb 27 01:23:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-afa5d4d5-2672-4f9e-8d48-f5f666f04a44 tempest-VolumesAdminNegativeTest-1545613327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-6aabebf5-da60-46be-940a-ebebf9d0bd2e" returned: 0 in 0.980s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:23:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-afa5d4d5-2672-4f9e-8d48-f5f666f04a44 tempest-VolumesAdminNegativeTest-1545613327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-6aabebf5-da60-46be-940a-ebebf9d0bd2e {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:23:39 devstack sudo[85330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_njlsb2iv
Feb 27 01:23:39 devstack sudo[85331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-6aabebf5-da60-46be-940a-ebebf9d0bd2e
Feb 27 01:23:39 devstack sudo[85331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:23:39 devstack sudo[85330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:23:39 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-66ae51e3-903d-4c10-8965-e278a7310af7 tempest-GroupSnapshotsTest-208290777 None] group_snapshot 9d1c1868-0cb4-4269-92c8-8f29a81486ca: deleting
Feb 27 01:23:39 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-66ae51e3-903d-4c10-8965-e278a7310af7 tempest-GroupSnapshotsTest-208290777 None] group_snapshot 9d1c1868-0cb4-4269-92c8-8f29a81486ca: deleting {{(pid=83106) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Feb 27 01:23:39 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-66ae51e3-903d-4c10-8965-e278a7310af7 tempest-GroupSnapshotsTest-208290777 None] Acquiring lock "cinder-quobyte-099dfa46-f079-4f42-9482-c27563b74f54" by "delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:23:39 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-66ae51e3-903d-4c10-8965-e278a7310af7 tempest-GroupSnapshotsTest-208290777 None] Lock "cinder-quobyte-099dfa46-f079-4f42-9482-c27563b74f54" acquired by "delete_snapshot" :: waited 0.037s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:23:39 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-66ae51e3-903d-4c10-8965-e278a7310af7 tempest-GroupSnapshotsTest-208290777 None] Acquiring lock "cinder-quobyte-a034a247-0b90-4ac8-bd99-da08205d9694" by "_delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:23:39 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-66ae51e3-903d-4c10-8965-e278a7310af7 tempest-GroupSnapshotsTest-208290777 None] Lock "cinder-quobyte-a034a247-0b90-4ac8-bd99-da08205d9694" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:23:39 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-66ae51e3-903d-4c10-8965-e278a7310af7 tempest-GroupSnapshotsTest-208290777 None] Deleting offline snapshot a034a247-0b90-4ac8-bd99-da08205d9694 of volume 099dfa46-f079-4f42-9482-c27563b74f54 {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:23:40 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-66ae51e3-903d-4c10-8965-e278a7310af7 tempest-GroupSnapshotsTest-208290777 None] snapshot_file for this snap is: volume-099dfa46-f079-4f42-9482-c27563b74f54.a034a247-0b90-4ac8-bd99-da08205d9694 {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:23:40 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[5141a689-4649-468b-bd89-9ef91f5cba74]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:23:40 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-66ae51e3-903d-4c10-8965-e278a7310af7 tempest-GroupSnapshotsTest-208290777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-099dfa46-f079-4f42-9482-c27563b74f54.a034a247-0b90-4ac8-bd99-da08205d9694 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:23:40 devstack sudo[85334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-099dfa46-f079-4f42-9482-c27563b74f54.a034a247-0b90-4ac8-bd99-da08205d9694
Feb 27 01:23:40 devstack sudo[85334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:23:40 devstack sudo[85331]: pam_unix(sudo:session): session closed for user root
Feb 27 01:23:40 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-afa5d4d5-2672-4f9e-8d48-f5f666f04a44 tempest-VolumesAdminNegativeTest-1545613327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-6aabebf5-da60-46be-940a-ebebf9d0bd2e" returned: 0 in 1.025s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:23:40 devstack sudo[85328]: pam_unix(sudo:session): session closed for user root
Feb 27 01:23:40 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-71fde32a-a7ed-4766-8136-97be6b63d2bc tempest-GroupSnapshotsTest-208290777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 1.216s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:23:40 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-71fde32a-a7ed-4766-8136-97be6b63d2bc tempest-GroupSnapshotsTest-208290777 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:23:40 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-afa5d4d5-2672-4f9e-8d48-f5f666f04a44 tempest-VolumesAdminNegativeTest-1545613327 None] Lock "cinder-quobyte-6aabebf5-da60-46be-940a-ebebf9d0bd2e" released by "delete_volume" :: held 2.075s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:23:40 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-71fde32a-a7ed-4766-8136-97be6b63d2bc tempest-GroupSnapshotsTest-208290777 None] Delete group completed successfully.
Feb 27 01:23:40 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-afa5d4d5-2672-4f9e-8d48-f5f666f04a44 tempest-VolumesAdminNegativeTest-1545613327 None] Created reservations ['78bfe079-52bb-4ee2-b551-3e3f44ec27c3', 'c13726a8-3877-4d95-bb45-80e89047d130', 'bb4e6ba0-d5eb-4bdf-89eb-3738e5a1fb87', 'eca94dd6-ef8f-4fdb-9956-274b844ca00d'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:23:40 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-afa5d4d5-2672-4f9e-8d48-f5f666f04a44 tempest-VolumesAdminNegativeTest-1545613327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:23:40 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-afa5d4d5-2672-4f9e-8d48-f5f666f04a44 tempest-VolumesAdminNegativeTest-1545613327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:23:40 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-afa5d4d5-2672-4f9e-8d48-f5f666f04a44 tempest-VolumesAdminNegativeTest-1545613327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:23:40 devstack sudo[85330]: pam_unix(sudo:session): session closed for user root
Feb 27 01:23:40 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-afa5d4d5-2672-4f9e-8d48-f5f666f04a44 tempest-VolumesAdminNegativeTest-1545613327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:23:40 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-afa5d4d5-2672-4f9e-8d48-f5f666f04a44 tempest-VolumesAdminNegativeTest-1545613327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:23:40 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-afa5d4d5-2672-4f9e-8d48-f5f666f04a44 tempest-VolumesAdminNegativeTest-1545613327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:23:40 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-34c8fee4-0072-4863-99e7-a749310499c9 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_njlsb2iv" returned: 0 in 1.368s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:23:40 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-34c8fee4-0072-4863-99e7-a749310499c9 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_njlsb2iv {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:23:40 devstack sudo[85343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:23:40 devstack sudo[85343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:23:41 devstack sudo[85344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_njlsb2iv
Feb 27 01:23:41 devstack sudo[85344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:23:41 devstack sudo[85334]: pam_unix(sudo:session): session closed for user root
Feb 27 01:23:41 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-66ae51e3-903d-4c10-8965-e278a7310af7 tempest-GroupSnapshotsTest-208290777 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-099dfa46-f079-4f42-9482-c27563b74f54.a034a247-0b90-4ac8-bd99-da08205d9694" returned: 0 in 1.470s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:23:41 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-66ae51e3-903d-4c10-8965-e278a7310af7 tempest-GroupSnapshotsTest-208290777 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-099dfa46-f079-4f42-9482-c27563b74f54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83106) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:23:41 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4ebb4e-1198-492a-9317-4a649f3b7652]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:23:41 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-66ae51e3-903d-4c10-8965-e278a7310af7 tempest-GroupSnapshotsTest-208290777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-099dfa46-f079-4f42-9482-c27563b74f54 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:23:41 devstack sudo[85350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-099dfa46-f079-4f42-9482-c27563b74f54
Feb 27 01:23:41 devstack sudo[85350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:23:42 devstack sudo[85344]: pam_unix(sudo:session): session closed for user root
Feb 27 01:23:42 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-34c8fee4-0072-4863-99e7-a749310499c9 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_njlsb2iv" returned: 1 in 1.119s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:23:42 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-34c8fee4-0072-4863-99e7-a749310499c9 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_njlsb2iv' failed. Not Retrying. {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 27 01:23:42 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[14303cc6-b63e-4301-9761-c11a6b07058d]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:23:42 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-34c8fee4-0072-4863-99e7-a749310499c9 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_oev5lnvtdevstack@QuobyteHD {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:23:42 devstack sudo[85343]: pam_unix(sudo:session): session closed for user root
Feb 27 01:23:42 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-afa5d4d5-2672-4f9e-8d48-f5f666f04a44 tempest-VolumesAdminNegativeTest-1545613327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 1.196s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:23:42 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-afa5d4d5-2672-4f9e-8d48-f5f666f04a44 tempest-VolumesAdminNegativeTest-1545613327 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:23:42 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-afa5d4d5-2672-4f9e-8d48-f5f666f04a44 tempest-VolumesAdminNegativeTest-1545613327 None] Deleted volume successfully.
Feb 27 01:23:42 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-afa5d4d5-2672-4f9e-8d48-f5f666f04a44 tempest-VolumesAdminNegativeTest-1545613327 None] Lock "cinder-6aabebf5-da60-46be-940a-ebebf9d0bd2e-delete_volume" released by "delete_volume" :: held 3.510s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:23:42 devstack sudo[85355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_oev5lnvtdevstack@QuobyteHD
Feb 27 01:23:42 devstack sudo[85355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:23:42 devstack sudo[85350]: pam_unix(sudo:session): session closed for user root
Feb 27 01:23:42 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-66ae51e3-903d-4c10-8965-e278a7310af7 tempest-GroupSnapshotsTest-208290777 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-099dfa46-f079-4f42-9482-c27563b74f54" returned: 0 in 1.035s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:23:42 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-66ae51e3-903d-4c10-8965-e278a7310af7 tempest-GroupSnapshotsTest-208290777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-099dfa46-f079-4f42-9482-c27563b74f54.a034a247-0b90-4ac8-bd99-da08205d9694 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:23:42 devstack sudo[85388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-099dfa46-f079-4f42-9482-c27563b74f54.a034a247-0b90-4ac8-bd99-da08205d9694
Feb 27 01:23:42 devstack sudo[85388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:23:42 devstack sudo[85355]: pam_unix(sudo:session): session closed for user root
Feb 27 01:23:42 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-34c8fee4-0072-4863-99e7-a749310499c9 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_oev5lnvtdevstack@QuobyteHD" returned: 0 in 0.974s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:23:42 devstack cinder-volume[83106]: DEBUG cinder.image.image_utils [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-34c8fee4-0072-4863-99e7-a749310499c9 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] 4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca was qcow2, converting to raw {{(pid=83106) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Feb 27 01:23:43 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-34c8fee4-0072-4863-99e7-a749310499c9 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_oev5lnvtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-363bbf57-d127-4cf7-b12f-197fa82f28d8 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:23:43 devstack sudo[85391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_oev5lnvtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-363bbf57-d127-4cf7-b12f-197fa82f28d8
Feb 27 01:23:43 devstack sudo[85391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:23:43 devstack sudo[85388]: pam_unix(sudo:session): session closed for user root
Feb 27 01:23:43 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-66ae51e3-903d-4c10-8965-e278a7310af7 tempest-GroupSnapshotsTest-208290777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-099dfa46-f079-4f42-9482-c27563b74f54.a034a247-0b90-4ac8-bd99-da08205d9694" returned: 0 in 1.246s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:23:43 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-66ae51e3-903d-4c10-8965-e278a7310af7 tempest-GroupSnapshotsTest-208290777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-099dfa46-f079-4f42-9482-c27563b74f54.a034a247-0b90-4ac8-bd99-da08205d9694 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:23:43 devstack sudo[85400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-099dfa46-f079-4f42-9482-c27563b74f54.a034a247-0b90-4ac8-bd99-da08205d9694
Feb 27 01:23:43 devstack sudo[85400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:23:44 devstack sudo[85400]: pam_unix(sudo:session): session closed for user root
Feb 27 01:23:44 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-66ae51e3-903d-4c10-8965-e278a7310af7 tempest-GroupSnapshotsTest-208290777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-099dfa46-f079-4f42-9482-c27563b74f54.a034a247-0b90-4ac8-bd99-da08205d9694" returned: 0 in 0.819s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:23:44 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-66ae51e3-903d-4c10-8965-e278a7310af7 tempest-GroupSnapshotsTest-208290777 None] Lock "cinder-quobyte-a034a247-0b90-4ac8-bd99-da08205d9694" released by "_delete_snapshot" :: held 4.775s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:23:44 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-66ae51e3-903d-4c10-8965-e278a7310af7 tempest-GroupSnapshotsTest-208290777 None] Lock "cinder-quobyte-099dfa46-f079-4f42-9482-c27563b74f54" released by "delete_snapshot" :: held 4.808s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:23:44 devstack cinder-volume[83106]: WARNING cinder.quota [None req-66ae51e3-903d-4c10-8965-e278a7310af7 tempest-GroupSnapshotsTest-208290777 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1822591746 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1822591746, it is now deprecated. Please use the default quota class for default quota.
Feb 27 01:23:44 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-66ae51e3-903d-4c10-8965-e278a7310af7 tempest-GroupSnapshotsTest-208290777 None] Created reservations ['1ac76d1c-f217-4593-ac9d-0f394128163b', 'c4abf74a-be9d-49a6-8ce4-470ddcb812d2', '7bec1734-1c30-4efd-a2b5-9af729e181dd', '3b240885-195c-4403-aac5-89331b8be67d'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:23:44 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-66ae51e3-903d-4c10-8965-e278a7310af7 tempest-GroupSnapshotsTest-208290777 None] group_snapshot 9d1c1868-0cb4-4269-92c8-8f29a81486ca: deleted successfully
Feb 27 01:23:44 devstack sudo[85391]: pam_unix(sudo:session): session closed for user root
Feb 27 01:23:44 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-34c8fee4-0072-4863-99e7-a749310499c9 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_oev5lnvtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-363bbf57-d127-4cf7-b12f-197fa82f28d8" returned: 0 in 1.909s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:23:44 devstack cinder-volume[83106]: DEBUG cinder.image.image_utils [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-34c8fee4-0072-4863-99e7-a749310499c9 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_oev5lnvtdevstack@QuobyteHD, size 112.00 MB, duration 1.91 sec, destination /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-363bbf57-d127-4cf7-b12f-197fa82f28d8 {{(pid=83106) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 27 01:23:44 devstack cinder-volume[83106]: INFO cinder.image.image_utils [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-34c8fee4-0072-4863-99e7-a749310499c9 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Converted 112.00 MB image at 58.65 MB/s
Feb 27 01:23:44 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-34c8fee4-0072-4863-99e7-a749310499c9 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-363bbf57-d127-4cf7-b12f-197fa82f28d8 1G {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:23:44 devstack sudo[85409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-363bbf57-d127-4cf7-b12f-197fa82f28d8 1G
Feb 27 01:23:44 devstack sudo[85409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:23:45 devstack sudo[85409]: pam_unix(sudo:session): session closed for user root
Feb 27 01:23:45 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-34c8fee4-0072-4863-99e7-a749310499c9 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-363bbf57-d127-4cf7-b12f-197fa82f28d8 1G" returned: 0 in 0.511s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:23:45 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[fddf0689-957f-448a-8407-eb950a06d3e0]: (4, 'raw') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:23:45 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-34c8fee4-0072-4863-99e7-a749310499c9 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-363bbf57-d127-4cf7-b12f-197fa82f28d8 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:23:45 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-a9dc11c2-a301-4dcc-a5f8-4a5f47911867 tempest-GroupSnapshotsTest-208290777 None] Acquiring lock "cinder-quobyte-099dfa46-f079-4f42-9482-c27563b74f54" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:23:45 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-a9dc11c2-a301-4dcc-a5f8-4a5f47911867 tempest-GroupSnapshotsTest-208290777 None] Lock "cinder-quobyte-099dfa46-f079-4f42-9482-c27563b74f54" acquired by "delete_volume" :: waited 0.014s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:23:45 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[5940be73-194e-4be1-a693-9daba4f76ae0]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:23:45 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a9dc11c2-a301-4dcc-a5f8-4a5f47911867 tempest-GroupSnapshotsTest-208290777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-099dfa46-f079-4f42-9482-c27563b74f54 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:23:45 devstack sudo[85414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-363bbf57-d127-4cf7-b12f-197fa82f28d8
Feb 27 01:23:45 devstack sudo[85414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:23:45 devstack sudo[85415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-099dfa46-f079-4f42-9482-c27563b74f54
Feb 27 01:23:45 devstack sudo[85415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:23:46 devstack sudo[85415]: pam_unix(sudo:session): session closed for user root
Feb 27 01:23:46 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a9dc11c2-a301-4dcc-a5f8-4a5f47911867 tempest-GroupSnapshotsTest-208290777 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-099dfa46-f079-4f42-9482-c27563b74f54" returned: 0 in 0.798s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:23:46 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a9dc11c2-a301-4dcc-a5f8-4a5f47911867 tempest-GroupSnapshotsTest-208290777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-099dfa46-f079-4f42-9482-c27563b74f54 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:23:46 devstack sudo[85421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-099dfa46-f079-4f42-9482-c27563b74f54
Feb 27 01:23:46 devstack sudo[85421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:23:46 devstack sudo[85414]: pam_unix(sudo:session): session closed for user root
Feb 27 01:23:46 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-34c8fee4-0072-4863-99e7-a749310499c9 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-363bbf57-d127-4cf7-b12f-197fa82f28d8" returned: 0 in 1.159s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:23:46 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-34c8fee4-0072-4863-99e7-a749310499c9 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-363bbf57-d127-4cf7-b12f-197fa82f28d8 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:23:46 devstack sudo[85425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-363bbf57-d127-4cf7-b12f-197fa82f28d8
Feb 27 01:23:46 devstack sudo[85425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:23:47 devstack sudo[85421]: pam_unix(sudo:session): session closed for user root
Feb 27 01:23:47 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a9dc11c2-a301-4dcc-a5f8-4a5f47911867 tempest-GroupSnapshotsTest-208290777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-099dfa46-f079-4f42-9482-c27563b74f54" returned: 0 in 1.076s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:23:47 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-a9dc11c2-a301-4dcc-a5f8-4a5f47911867 tempest-GroupSnapshotsTest-208290777 None] Lock "cinder-quobyte-099dfa46-f079-4f42-9482-c27563b74f54" released by "delete_volume" :: held 1.937s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:23:47 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-a9dc11c2-a301-4dcc-a5f8-4a5f47911867 tempest-GroupSnapshotsTest-208290777 None] Created reservations ['f6e90c7f-ece2-455e-93f3-dde31f0945dc'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:23:47 devstack cinder-volume[83106]: WARNING cinder.db.sqlalchemy.api [None req-a9dc11c2-a301-4dcc-a5f8-4a5f47911867 tempest-GroupSnapshotsTest-208290777 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1822591746']
Feb 27 01:23:47 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-a9dc11c2-a301-4dcc-a5f8-4a5f47911867 tempest-GroupSnapshotsTest-208290777 None] Created reservations ['0839385a-3c80-44d8-96b2-1ae3e09ed156', 'bba473ab-9a7d-4a0a-a7b5-195f701816f4', '868f6aee-c8b0-449a-b3d6-6e2b5a5e6503', '21ca6e08-7b5f-4012-86f2-8e814095ae2e'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:23:47 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-a9dc11c2-a301-4dcc-a5f8-4a5f47911867 tempest-GroupSnapshotsTest-208290777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:23:47 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-a9dc11c2-a301-4dcc-a5f8-4a5f47911867 tempest-GroupSnapshotsTest-208290777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:23:47 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-a9dc11c2-a301-4dcc-a5f8-4a5f47911867 tempest-GroupSnapshotsTest-208290777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:23:47 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-a9dc11c2-a301-4dcc-a5f8-4a5f47911867 tempest-GroupSnapshotsTest-208290777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:23:47 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-a9dc11c2-a301-4dcc-a5f8-4a5f47911867 tempest-GroupSnapshotsTest-208290777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:23:47 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a9dc11c2-a301-4dcc-a5f8-4a5f47911867 tempest-GroupSnapshotsTest-208290777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:23:47 devstack sudo[85425]: pam_unix(sudo:session): session closed for user root
Feb 27 01:23:47 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-34c8fee4-0072-4863-99e7-a749310499c9 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-363bbf57-d127-4cf7-b12f-197fa82f28d8" returned: 1 in 1.016s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:23:47 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-34c8fee4-0072-4863-99e7-a749310499c9 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-363bbf57-d127-4cf7-b12f-197fa82f28d8' failed. Not Retrying. {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 27 01:23:47 devstack cinder-volume[83106]: DEBUG cinder.volume.volume_utils [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-34c8fee4-0072-4863-99e7-a749310499c9 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Downloaded image 4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca ((None, [{'url': 'file:///opt/stack/data/glance/images/4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca', 'metadata': {}}])) to volume 363bbf57-d127-4cf7-b12f-197fa82f28d8 successfully. {{(pid=83106) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Feb 27 01:23:47 devstack sudo[85431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:23:47 devstack sudo[85431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:23:47 devstack cinder-volume[83106]: DEBUG cinder.image.image_utils [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-34c8fee4-0072-4863-99e7-a749310499c9 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Temporary image 4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca for user 4a34621a36c34d768c38e8622a355585 is deleted. {{(pid=83106) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Feb 27 01:23:47 devstack cinder-volume[83106]: DEBUG cinder.volume.volume_utils [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-34c8fee4-0072-4863-99e7-a749310499c9 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Marking volume 363bbf57-d127-4cf7-b12f-197fa82f28d8 as bootable. {{(pid=83106) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Feb 27 01:23:47 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-34c8fee4-0072-4863-99e7-a749310499c9 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Copying metadata from image 4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca to 363bbf57-d127-4cf7-b12f-197fa82f28d8. {{(pid=83106) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Feb 27 01:23:47 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-34c8fee4-0072-4863-99e7-a749310499c9 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Creating volume glance metadata for volume 363bbf57-d127-4cf7-b12f-197fa82f28d8 backed by image 4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83106) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Feb 27 01:23:47 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-34c8fee4-0072-4863-99e7-a749310499c9 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c52fb7c9-8491-4c12-b87c-2461516e4409) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-363bbf57-d127-4cf7-b12f-197fa82f28d8', 'volume_size': 1, 'image_id': '4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd105600f18404a29b5061e7b75a5bfe1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca', 'created_at': datetime.datetime(2026, 2, 27, 0, 17, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 17, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f07e936a7a0>}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:23:47 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-34c8fee4-0072-4863-99e7-a749310499c9 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07262688-7d16-4a57-991a-632ca03b9a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:23:47 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-34c8fee4-0072-4863-99e7-a749310499c9 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Volume volume-363bbf57-d127-4cf7-b12f-197fa82f28d8 (363bbf57-d127-4cf7-b12f-197fa82f28d8): created successfully
Feb 27 01:23:47 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-34c8fee4-0072-4863-99e7-a749310499c9 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07262688-7d16-4a57-991a-632ca03b9a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:23:47 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-34c8fee4-0072-4863-99e7-a749310499c9 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Flow 'volume_create_manager' (7354af90-ff86-47af-90b7-80a3d811e5a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:23:47 devstack cinder-volume[83106]: INFO cinder.volume.manager [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-34c8fee4-0072-4863-99e7-a749310499c9 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Created volume successfully.
Feb 27 01:23:48 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-1e682373-ddb5-4e5f-8888-3907c8a7df5b tempest-GroupSnapshotsTest-208290777 None] Group tempest-GroupSnapshotsTest-Group-1675309163: creating
Feb 27 01:23:48 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-1e682373-ddb5-4e5f-8888-3907c8a7df5b tempest-GroupSnapshotsTest-208290777 None] Group tempest-GroupSnapshotsTest-Group-1675309163: created successfully
Feb 27 01:23:48 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-1e682373-ddb5-4e5f-8888-3907c8a7df5b tempest-GroupSnapshotsTest-208290777 None] Create group completed successfully.
Feb 27 01:23:48 devstack sudo[85431]: pam_unix(sudo:session): session closed for user root
Feb 27 01:23:48 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a9dc11c2-a301-4dcc-a5f8-4a5f47911867 tempest-GroupSnapshotsTest-208290777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.803s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:23:48 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-a9dc11c2-a301-4dcc-a5f8-4a5f47911867 tempest-GroupSnapshotsTest-208290777 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:23:48 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-a9dc11c2-a301-4dcc-a5f8-4a5f47911867 tempest-GroupSnapshotsTest-208290777 None] Delete group completed successfully.
Feb 27 01:23:49 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-2041e7b5-9f19-4a04-b91b-0e8daf2e3938 tempest-GroupSnapshotsTest-208290777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:23:49 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-2041e7b5-9f19-4a04-b91b-0e8daf2e3938 tempest-GroupSnapshotsTest-208290777 None] Flow 'volume_create_manager' (d0206042-08f4-4c31-ad82-7c9348fd3762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:23:49 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-2041e7b5-9f19-4a04-b91b-0e8daf2e3938 tempest-GroupSnapshotsTest-208290777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a528b68-7e9c-43e2-92d0-60a9b56f65e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:23:49 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-2041e7b5-9f19-4a04-b91b-0e8daf2e3938 tempest-GroupSnapshotsTest-208290777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a528b68-7e9c-43e2-92d0-60a9b56f65e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:23:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1393824877',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=05b960cb-d977-4f3c-ad6a-416676816c72,host='devstack@QuobyteHD#QuobyteHD',id=18ea0d56-f7d8-486f-afe8-e04809c872a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac472ce010b34a03b2fb9217cfad031e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:23:50Z,use_quota=True,user_id='0219e94a4390484f905ea633322ed978',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(32c2eda6-a53a-4310-be35-0ce6d7bb761f),volume_type_id=32c2eda6-a53a-4310-be35-0ce6d7bb761f)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:23:49 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-2041e7b5-9f19-4a04-b91b-0e8daf2e3938 tempest-GroupSnapshotsTest-208290777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa8fe263-9a7d-4c50-85ad-5a925ab3c05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:23:49 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-2041e7b5-9f19-4a04-b91b-0e8daf2e3938 tempest-GroupSnapshotsTest-208290777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa8fe263-9a7d-4c50-85ad-5a925ab3c05f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:23:49 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-2041e7b5-9f19-4a04-b91b-0e8daf2e3938 tempest-GroupSnapshotsTest-208290777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53c5df9d-9a95-41ac-9dc1-aabd1c98781d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:23:49 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-2041e7b5-9f19-4a04-b91b-0e8daf2e3938 tempest-GroupSnapshotsTest-208290777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53c5df9d-9a95-41ac-9dc1-aabd1c98781d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18ea0d56-f7d8-486f-afe8-e04809c872a5', 'volume_name': 'volume-18ea0d56-f7d8-486f-afe8-e04809c872a5', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:23:49 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-2041e7b5-9f19-4a04-b91b-0e8daf2e3938 tempest-GroupSnapshotsTest-208290777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (225e785b-5b4c-48f6-9b95-db3ff0c7bb0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:23:49 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-2041e7b5-9f19-4a04-b91b-0e8daf2e3938 tempest-GroupSnapshotsTest-208290777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (225e785b-5b4c-48f6-9b95-db3ff0c7bb0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:23:49 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-2041e7b5-9f19-4a04-b91b-0e8daf2e3938 tempest-GroupSnapshotsTest-208290777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef6ef30a-9746-4048-9b5c-e084754fe68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:23:49 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-2041e7b5-9f19-4a04-b91b-0e8daf2e3938 tempest-GroupSnapshotsTest-208290777 None] Volume 18ea0d56-f7d8-486f-afe8-e04809c872a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18ea0d56-f7d8-486f-afe8-e04809c872a5', 'volume_size': 1}
Feb 27 01:23:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-2041e7b5-9f19-4a04-b91b-0e8daf2e3938 tempest-GroupSnapshotsTest-208290777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:23:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-2041e7b5-9f19-4a04-b91b-0e8daf2e3938 tempest-GroupSnapshotsTest-208290777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:23:49 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-2041e7b5-9f19-4a04-b91b-0e8daf2e3938 tempest-GroupSnapshotsTest-208290777 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=05b960cb-d977-4f3c-ad6a-416676816c72,created_at=2026-02-27T00:23:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1393824877',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=05b960cb-d977-4f3c-ad6a-416676816c72,host='devstack@QuobyteHD#QuobyteHD',id=18ea0d56-f7d8-486f-afe8-e04809c872a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac472ce010b34a03b2fb9217cfad031e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:23:50Z,use_quota=True,user_id='0219e94a4390484f905ea633322ed978',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(32c2eda6-a53a-4310-be35-0ce6d7bb761f),volume_type_id=32c2eda6-a53a-4310-be35-0ce6d7bb761f)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:23:49 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-2041e7b5-9f19-4a04-b91b-0e8daf2e3938 tempest-GroupSnapshotsTest-208290777 None] Creating volume 18ea0d56-f7d8-486f-afe8-e04809c872a5 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:23:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-2041e7b5-9f19-4a04-b91b-0e8daf2e3938 tempest-GroupSnapshotsTest-208290777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:23:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-2041e7b5-9f19-4a04-b91b-0e8daf2e3938 tempest-GroupSnapshotsTest-208290777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:23:49 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-2041e7b5-9f19-4a04-b91b-0e8daf2e3938 tempest-GroupSnapshotsTest-208290777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:23:49 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-2041e7b5-9f19-4a04-b91b-0e8daf2e3938 tempest-GroupSnapshotsTest-208290777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:23:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-2041e7b5-9f19-4a04-b91b-0e8daf2e3938 tempest-GroupSnapshotsTest-208290777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:23:49 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-2041e7b5-9f19-4a04-b91b-0e8daf2e3938 tempest-GroupSnapshotsTest-208290777 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:23:49 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-2041e7b5-9f19-4a04-b91b-0e8daf2e3938 tempest-GroupSnapshotsTest-208290777 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:23:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-2041e7b5-9f19-4a04-b91b-0e8daf2e3938 tempest-GroupSnapshotsTest-208290777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-18ea0d56-f7d8-486f-afe8-e04809c872a5 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:23:49 devstack sudo[85459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-18ea0d56-f7d8-486f-afe8-e04809c872a5 1073741824
Feb 27 01:23:49 devstack sudo[85459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:23:50 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-9c258c4f-8c1f-40cd-9910-a35d33731e90 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:23:50 devstack sudo[85459]: pam_unix(sudo:session): session closed for user root
Feb 27 01:23:50 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-2041e7b5-9f19-4a04-b91b-0e8daf2e3938 tempest-GroupSnapshotsTest-208290777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-18ea0d56-f7d8-486f-afe8-e04809c872a5 1073741824" returned: 0 in 0.669s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:23:50 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-2041e7b5-9f19-4a04-b91b-0e8daf2e3938 tempest-GroupSnapshotsTest-208290777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-18ea0d56-f7d8-486f-afe8-e04809c872a5 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:23:50 devstack sudo[85464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-18ea0d56-f7d8-486f-afe8-e04809c872a5
Feb 27 01:23:50 devstack sudo[85464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:23:51 devstack sudo[85464]: pam_unix(sudo:session): session closed for user root
Feb 27 01:23:51 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-2041e7b5-9f19-4a04-b91b-0e8daf2e3938 tempest-GroupSnapshotsTest-208290777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-18ea0d56-f7d8-486f-afe8-e04809c872a5" returned: 0 in 0.575s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:23:51 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-2041e7b5-9f19-4a04-b91b-0e8daf2e3938 tempest-GroupSnapshotsTest-208290777 None] <== create_volume: return (1272ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:23:51 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-2041e7b5-9f19-4a04-b91b-0e8daf2e3938 tempest-GroupSnapshotsTest-208290777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.276s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:23:51 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-9c258c4f-8c1f-40cd-9910-a35d33731e90 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.052s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:23:51 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-2041e7b5-9f19-4a04-b91b-0e8daf2e3938 tempest-GroupSnapshotsTest-208290777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef6ef30a-9746-4048-9b5c-e084754fe68b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18ea0d56-f7d8-486f-afe8-e04809c872a5', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:23:51 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-2041e7b5-9f19-4a04-b91b-0e8daf2e3938 tempest-GroupSnapshotsTest-208290777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbe2afcf-677c-4627-bcd9-31239cbbbc3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:23:51 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b09a7b5-430f-4deb-af4b-444c2d004505]: (4, 'raw') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:23:51 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-9c258c4f-8c1f-40cd-9910-a35d33731e90 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-363bbf57-d127-4cf7-b12f-197fa82f28d8 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:23:51 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-2041e7b5-9f19-4a04-b91b-0e8daf2e3938 tempest-GroupSnapshotsTest-208290777 None] Volume volume-18ea0d56-f7d8-486f-afe8-e04809c872a5 (18ea0d56-f7d8-486f-afe8-e04809c872a5): created successfully
Feb 27 01:23:51 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-2041e7b5-9f19-4a04-b91b-0e8daf2e3938 tempest-GroupSnapshotsTest-208290777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbe2afcf-677c-4627-bcd9-31239cbbbc3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:23:51 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-2041e7b5-9f19-4a04-b91b-0e8daf2e3938 tempest-GroupSnapshotsTest-208290777 None] Flow 'volume_create_manager' (d0206042-08f4-4c31-ad82-7c9348fd3762) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:23:51 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-2041e7b5-9f19-4a04-b91b-0e8daf2e3938 tempest-GroupSnapshotsTest-208290777 None] Created volume successfully.
Feb 27 01:23:51 devstack sudo[85467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-363bbf57-d127-4cf7-b12f-197fa82f28d8
Feb 27 01:23:51 devstack sudo[85467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:23:51 devstack sudo[85467]: pam_unix(sudo:session): session closed for user root
Feb 27 01:23:51 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-9c258c4f-8c1f-40cd-9910-a35d33731e90 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-363bbf57-d127-4cf7-b12f-197fa82f28d8" returned: 0 in 0.621s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:23:51 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-9c258c4f-8c1f-40cd-9910-a35d33731e90 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-363bbf57-d127-4cf7-b12f-197fa82f28d8 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:23:51 devstack sudo[85475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-363bbf57-d127-4cf7-b12f-197fa82f28d8
Feb 27 01:23:51 devstack sudo[85475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:23:52 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-cad71022-880a-499e-9ff3-265ec7858939 tempest-GroupSnapshotsTest-208290777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:23:52 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-cad71022-880a-499e-9ff3-265ec7858939 tempest-GroupSnapshotsTest-208290777 None] Flow 'volume_create_manager' (59589d5b-df79-4dab-9e34-3b02fda2cfe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:23:52 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-cad71022-880a-499e-9ff3-265ec7858939 tempest-GroupSnapshotsTest-208290777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (add9cf5a-066f-4378-92d2-ec27f43a56aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:23:52 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-cad71022-880a-499e-9ff3-265ec7858939 tempest-GroupSnapshotsTest-208290777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (add9cf5a-066f-4378-92d2-ec27f43a56aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:23:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1980883998',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=05b960cb-d977-4f3c-ad6a-416676816c72,host='devstack@QuobyteHD#QuobyteHD',id=793305e7-37f9-4924-b41a-6dbe6af81352,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac472ce010b34a03b2fb9217cfad031e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:23:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:23:52Z,use_quota=True,user_id='0219e94a4390484f905ea633322ed978',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(32c2eda6-a53a-4310-be35-0ce6d7bb761f),volume_type_id=32c2eda6-a53a-4310-be35-0ce6d7bb761f)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:23:52 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-cad71022-880a-499e-9ff3-265ec7858939 tempest-GroupSnapshotsTest-208290777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0133bef6-0b46-4269-b5e1-5a130be11fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:23:52 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-cad71022-880a-499e-9ff3-265ec7858939 tempest-GroupSnapshotsTest-208290777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0133bef6-0b46-4269-b5e1-5a130be11fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:23:52 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-cad71022-880a-499e-9ff3-265ec7858939 tempest-GroupSnapshotsTest-208290777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6a83c33-f1dc-44e3-b72d-f42d9fece0ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:23:52 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-cad71022-880a-499e-9ff3-265ec7858939 tempest-GroupSnapshotsTest-208290777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6a83c33-f1dc-44e3-b72d-f42d9fece0ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '793305e7-37f9-4924-b41a-6dbe6af81352', 'volume_name': 'volume-793305e7-37f9-4924-b41a-6dbe6af81352', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:23:52 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-cad71022-880a-499e-9ff3-265ec7858939 tempest-GroupSnapshotsTest-208290777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (296d1af3-b51f-4638-8471-414babff4351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:23:52 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-cad71022-880a-499e-9ff3-265ec7858939 tempest-GroupSnapshotsTest-208290777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (296d1af3-b51f-4638-8471-414babff4351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:23:52 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-cad71022-880a-499e-9ff3-265ec7858939 tempest-GroupSnapshotsTest-208290777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (993f0a84-578e-42b7-9725-8c7811ca1053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:23:52 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-cad71022-880a-499e-9ff3-265ec7858939 tempest-GroupSnapshotsTest-208290777 None] Volume 793305e7-37f9-4924-b41a-6dbe6af81352: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-793305e7-37f9-4924-b41a-6dbe6af81352', 'volume_size': 1}
Feb 27 01:23:52 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-cad71022-880a-499e-9ff3-265ec7858939 tempest-GroupSnapshotsTest-208290777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:23:52 devstack sudo[85475]: pam_unix(sudo:session): session closed for user root
Feb 27 01:23:52 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-9c258c4f-8c1f-40cd-9910-a35d33731e90 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-363bbf57-d127-4cf7-b12f-197fa82f28d8" returned: 1 in 0.894s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:23:52 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-9c258c4f-8c1f-40cd-9910-a35d33731e90 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-363bbf57-d127-4cf7-b12f-197fa82f28d8' failed. Not Retrying. {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 27 01:23:52 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-9c258c4f-8c1f-40cd-9910-a35d33731e90 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.548s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:23:52 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-cad71022-880a-499e-9ff3-265ec7858939 tempest-GroupSnapshotsTest-208290777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.191s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:23:52 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-cad71022-880a-499e-9ff3-265ec7858939 tempest-GroupSnapshotsTest-208290777 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=05b960cb-d977-4f3c-ad6a-416676816c72,created_at=2026-02-27T00:23:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1980883998',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=05b960cb-d977-4f3c-ad6a-416676816c72,host='devstack@QuobyteHD#QuobyteHD',id=793305e7-37f9-4924-b41a-6dbe6af81352,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac472ce010b34a03b2fb9217cfad031e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:23:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:23:52Z,use_quota=True,user_id='0219e94a4390484f905ea633322ed978',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(32c2eda6-a53a-4310-be35-0ce6d7bb761f),volume_type_id=32c2eda6-a53a-4310-be35-0ce6d7bb761f)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:23:52 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-cad71022-880a-499e-9ff3-265ec7858939 tempest-GroupSnapshotsTest-208290777 None] Creating volume 793305e7-37f9-4924-b41a-6dbe6af81352 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:23:52 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-cad71022-880a-499e-9ff3-265ec7858939 tempest-GroupSnapshotsTest-208290777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:23:52 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-cad71022-880a-499e-9ff3-265ec7858939 tempest-GroupSnapshotsTest-208290777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:23:52 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-cad71022-880a-499e-9ff3-265ec7858939 tempest-GroupSnapshotsTest-208290777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:23:52 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-cad71022-880a-499e-9ff3-265ec7858939 tempest-GroupSnapshotsTest-208290777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:23:52 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-cad71022-880a-499e-9ff3-265ec7858939 tempest-GroupSnapshotsTest-208290777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:23:52 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-cad71022-880a-499e-9ff3-265ec7858939 tempest-GroupSnapshotsTest-208290777 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:23:52 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-cad71022-880a-499e-9ff3-265ec7858939 tempest-GroupSnapshotsTest-208290777 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:23:52 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-cad71022-880a-499e-9ff3-265ec7858939 tempest-GroupSnapshotsTest-208290777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-793305e7-37f9-4924-b41a-6dbe6af81352 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:23:52 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-9c258c4f-8c1f-40cd-9910-a35d33731e90 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c', 'name': 'volume-363bbf57-d127-4cf7-b12f-197fa82f28d8', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f9cc37e6-cc08-43b3-b32e-31b4a2b55602', 'enforce_multipath': True} {{(pid=83106) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Feb 27 01:23:52 devstack sudo[85481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-793305e7-37f9-4924-b41a-6dbe6af81352 1073741824
Feb 27 01:23:52 devstack sudo[85481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:23:52 devstack cinder-volume[83106]: INFO cinder.volume.manager [req-09d46957-c153-4170-ad91-d1ac92e6aaf2 req-9c258c4f-8c1f-40cd-9910-a35d33731e90 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] attachment_update completed successfully.
Feb 27 01:23:54 devstack sudo[85481]: pam_unix(sudo:session): session closed for user root
Feb 27 01:23:54 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-cad71022-880a-499e-9ff3-265ec7858939 tempest-GroupSnapshotsTest-208290777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-793305e7-37f9-4924-b41a-6dbe6af81352 1073741824" returned: 0 in 1.250s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:23:54 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-cad71022-880a-499e-9ff3-265ec7858939 tempest-GroupSnapshotsTest-208290777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-793305e7-37f9-4924-b41a-6dbe6af81352 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:23:54 devstack sudo[85513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-793305e7-37f9-4924-b41a-6dbe6af81352
Feb 27 01:23:54 devstack sudo[85513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:23:55 devstack sudo[85513]: pam_unix(sudo:session): session closed for user root
Feb 27 01:23:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-cad71022-880a-499e-9ff3-265ec7858939 tempest-GroupSnapshotsTest-208290777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-793305e7-37f9-4924-b41a-6dbe6af81352" returned: 0 in 1.109s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:23:55 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-cad71022-880a-499e-9ff3-265ec7858939 tempest-GroupSnapshotsTest-208290777 None] <== create_volume: return (2434ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:23:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-cad71022-880a-499e-9ff3-265ec7858939 tempest-GroupSnapshotsTest-208290777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.440s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:23:55 devstack cinder-volume[83106]: DEBUG dbcounter [-] [83106] Writing DB stats cinder:SELECT=87,cinder:UPDATE=77,cinder:INSERT=29,cinder:DELETE=5 {{(pid=83106) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 01:23:55 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-cad71022-880a-499e-9ff3-265ec7858939 tempest-GroupSnapshotsTest-208290777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (993f0a84-578e-42b7-9725-8c7811ca1053) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-793305e7-37f9-4924-b41a-6dbe6af81352', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:23:55 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-cad71022-880a-499e-9ff3-265ec7858939 tempest-GroupSnapshotsTest-208290777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8166144-88e3-44e0-b644-9c93eb224f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:23:55 devstack cinder-volume[83106]: DEBUG dbcounter [-] [83106] Writing DB stats cinder:UPDATE=91,cinder:SELECT=86,cinder:INSERT=22,cinder:DELETE=4 {{(pid=83106) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 01:23:55 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-cad71022-880a-499e-9ff3-265ec7858939 tempest-GroupSnapshotsTest-208290777 None] Volume volume-793305e7-37f9-4924-b41a-6dbe6af81352 (793305e7-37f9-4924-b41a-6dbe6af81352): created successfully
Feb 27 01:23:55 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-cad71022-880a-499e-9ff3-265ec7858939 tempest-GroupSnapshotsTest-208290777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8166144-88e3-44e0-b644-9c93eb224f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:23:55 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-cad71022-880a-499e-9ff3-265ec7858939 tempest-GroupSnapshotsTest-208290777 None] Flow 'volume_create_manager' (59589d5b-df79-4dab-9e34-3b02fda2cfe5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:23:55 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-cad71022-880a-499e-9ff3-265ec7858939 tempest-GroupSnapshotsTest-208290777 None] Created volume successfully.
Feb 27 01:23:56 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-9db9ddd7-5bd9-4c4f-b26e-78a57245c775 tempest-GroupSnapshotsTest-208290777 None] Update group completed successfully.
Feb 27 01:23:56 devstack cinder-volume[83106]: DEBUG oslo_service.periodic_task [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83106) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Feb 27 01:23:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:23:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:23:56 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:23:56 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:23:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:23:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:23:56 devstack sudo[85587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:23:56 devstack sudo[85587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:23:57 devstack sudo[85587]: pam_unix(sudo:session): session closed for user root
Feb 27 01:23:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.618s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:23:57 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:23:57 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-1164994c-1d1d-406e-8182-c0e99998c413 tempest-GroupSnapshotsTest-208290777 None] Update group completed successfully.
Feb 27 01:23:58 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-4b2ccacf-d675-4a89-bf49-852e91266b04 tempest-GroupSnapshotsTest-208290777 None] Update group completed successfully.
Feb 27 01:23:59 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-a327b23a-bb40-4b21-8521-536e6f83e8e4 tempest-GroupSnapshotsTest-208290777 None] Update group completed successfully.
Feb 27 01:24:01 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-9906ab14-f40e-4259-b219-c16397bfe47c tempest-GroupSnapshotsTest-208290777 None] GroupSnapshot 1be2ca9a-c9d3-440c-b09e-7e305afdd921: creating.
Feb 27 01:24:01 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-9906ab14-f40e-4259-b219-c16397bfe47c tempest-GroupSnapshotsTest-208290777 None] Group snapshot 1be2ca9a-c9d3-440c-b09e-7e305afdd921: creating. {{(pid=83106) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Feb 27 01:24:01 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-9906ab14-f40e-4259-b219-c16397bfe47c tempest-GroupSnapshotsTest-208290777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:24:01 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-9906ab14-f40e-4259-b219-c16397bfe47c tempest-GroupSnapshotsTest-208290777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:24:01 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-9906ab14-f40e-4259-b219-c16397bfe47c tempest-GroupSnapshotsTest-208290777 None] Creating offline snapshot 05a4a4d9-5083-4793-af2a-214d2f6041ad of volume 18ea0d56-f7d8-486f-afe8-e04809c872a5 {{(pid=83106) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:24:01 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8115002-ecc4-4bea-87f7-f177ad8d58bc]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:24:01 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9906ab14-f40e-4259-b219-c16397bfe47c tempest-GroupSnapshotsTest-208290777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-18ea0d56-f7d8-486f-afe8-e04809c872a5 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:02 devstack sudo[86010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-18ea0d56-f7d8-486f-afe8-e04809c872a5
Feb 27 01:24:02 devstack sudo[86010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:03 devstack sudo[86010]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:03 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9906ab14-f40e-4259-b219-c16397bfe47c tempest-GroupSnapshotsTest-208290777 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-18ea0d56-f7d8-486f-afe8-e04809c872a5" returned: 0 in 1.432s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:03 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9906ab14-f40e-4259-b219-c16397bfe47c tempest-GroupSnapshotsTest-208290777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-18ea0d56-f7d8-486f-afe8-e04809c872a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-18ea0d56-f7d8-486f-afe8-e04809c872a5.05a4a4d9-5083-4793-af2a-214d2f6041ad 1G {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:03 devstack sudo[86017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-18ea0d56-f7d8-486f-afe8-e04809c872a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-18ea0d56-f7d8-486f-afe8-e04809c872a5.05a4a4d9-5083-4793-af2a-214d2f6041ad 1G
Feb 27 01:24:03 devstack sudo[86017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:04 devstack sudo[86017]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:04 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9906ab14-f40e-4259-b219-c16397bfe47c tempest-GroupSnapshotsTest-208290777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-18ea0d56-f7d8-486f-afe8-e04809c872a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-18ea0d56-f7d8-486f-afe8-e04809c872a5.05a4a4d9-5083-4793-af2a-214d2f6041ad 1G" returned: 0 in 1.340s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:04 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9906ab14-f40e-4259-b219-c16397bfe47c tempest-GroupSnapshotsTest-208290777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18ea0d56-f7d8-486f-afe8-e04809c872a5 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-18ea0d56-f7d8-486f-afe8-e04809c872a5.05a4a4d9-5083-4793-af2a-214d2f6041ad {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:04 devstack sudo[86028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18ea0d56-f7d8-486f-afe8-e04809c872a5 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-18ea0d56-f7d8-486f-afe8-e04809c872a5.05a4a4d9-5083-4793-af2a-214d2f6041ad
Feb 27 01:24:04 devstack sudo[86028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:05 devstack sudo[86028]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:05 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9906ab14-f40e-4259-b219-c16397bfe47c tempest-GroupSnapshotsTest-208290777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18ea0d56-f7d8-486f-afe8-e04809c872a5 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-18ea0d56-f7d8-486f-afe8-e04809c872a5.05a4a4d9-5083-4793-af2a-214d2f6041ad" returned: 0 in 0.875s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:05 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-9906ab14-f40e-4259-b219-c16397bfe47c tempest-GroupSnapshotsTest-208290777 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-18ea0d56-f7d8-486f-afe8-e04809c872a5.05a4a4d9-5083-4793-af2a-214d2f6041ad is being set with open permissions: ugo+rw: NotImplementedError
Feb 27 01:24:05 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9906ab14-f40e-4259-b219-c16397bfe47c tempest-GroupSnapshotsTest-208290777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-18ea0d56-f7d8-486f-afe8-e04809c872a5.05a4a4d9-5083-4793-af2a-214d2f6041ad {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:05 devstack sudo[86033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-18ea0d56-f7d8-486f-afe8-e04809c872a5.05a4a4d9-5083-4793-af2a-214d2f6041ad
Feb 27 01:24:05 devstack sudo[86033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:06 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c10d95b-dab3-4c12-8442-6f3f4d5cf520 tempest-ServersNegativeTestJSON-1393661834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:24:06 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7c10d95b-dab3-4c12-8442-6f3f4d5cf520 tempest-ServersNegativeTestJSON-1393661834 None] Flow 'volume_create_manager' (79c9d492-3743-435e-939d-c863bf6c3742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:24:06 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7c10d95b-dab3-4c12-8442-6f3f4d5cf520 tempest-ServersNegativeTestJSON-1393661834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cc9e972-004c-44da-8862-8b0287ebd961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:06 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7c10d95b-dab3-4c12-8442-6f3f4d5cf520 tempest-ServersNegativeTestJSON-1393661834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cc9e972-004c-44da-8862-8b0287ebd961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:24:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-426509726',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c59d67f0-eb7f-404d-9006-2dab96b99b8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a82b826f7df74cf1a817b12f17b63eff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:24:06Z,use_quota=True,user_id='b5f85e8b87a940fba75d6b28672559c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:06 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7c10d95b-dab3-4c12-8442-6f3f4d5cf520 tempest-ServersNegativeTestJSON-1393661834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3227c99d-8d3d-4f32-814f-8bc333ee8298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:06 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7c10d95b-dab3-4c12-8442-6f3f4d5cf520 tempest-ServersNegativeTestJSON-1393661834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3227c99d-8d3d-4f32-814f-8bc333ee8298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:06 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7c10d95b-dab3-4c12-8442-6f3f4d5cf520 tempest-ServersNegativeTestJSON-1393661834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64fb2d2b-22bf-4fe7-8712-6fb7a02cb851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:06 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7c10d95b-dab3-4c12-8442-6f3f4d5cf520 tempest-ServersNegativeTestJSON-1393661834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64fb2d2b-22bf-4fe7-8712-6fb7a02cb851) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c59d67f0-eb7f-404d-9006-2dab96b99b8e', 'volume_name': 'volume-c59d67f0-eb7f-404d-9006-2dab96b99b8e', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:06 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7c10d95b-dab3-4c12-8442-6f3f4d5cf520 tempest-ServersNegativeTestJSON-1393661834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad6c9c63-81a1-4f0f-b421-69be5a9ed2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:06 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7c10d95b-dab3-4c12-8442-6f3f4d5cf520 tempest-ServersNegativeTestJSON-1393661834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad6c9c63-81a1-4f0f-b421-69be5a9ed2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:06 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7c10d95b-dab3-4c12-8442-6f3f4d5cf520 tempest-ServersNegativeTestJSON-1393661834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f194448-3480-401d-9444-2afc9e3c27c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:06 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-7c10d95b-dab3-4c12-8442-6f3f4d5cf520 tempest-ServersNegativeTestJSON-1393661834 None] Volume c59d67f0-eb7f-404d-9006-2dab96b99b8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c59d67f0-eb7f-404d-9006-2dab96b99b8e', 'volume_size': 1}
Feb 27 01:24:06 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-7c10d95b-dab3-4c12-8442-6f3f4d5cf520 tempest-ServersNegativeTestJSON-1393661834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:24:06 devstack sudo[86033]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:06 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9906ab14-f40e-4259-b219-c16397bfe47c tempest-GroupSnapshotsTest-208290777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-18ea0d56-f7d8-486f-afe8-e04809c872a5.05a4a4d9-5083-4793-af2a-214d2f6041ad" returned: 0 in 1.211s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:06 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9906ab14-f40e-4259-b219-c16397bfe47c tempest-GroupSnapshotsTest-208290777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-18ea0d56-f7d8-486f-afe8-e04809c872a5.info {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:06 devstack sudo[86036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-18ea0d56-f7d8-486f-afe8-e04809c872a5.info
Feb 27 01:24:06 devstack sudo[86036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:07 devstack sudo[86036]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:07 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9906ab14-f40e-4259-b219-c16397bfe47c tempest-GroupSnapshotsTest-208290777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-18ea0d56-f7d8-486f-afe8-e04809c872a5.info" returned: 0 in 0.637s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:07 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-9906ab14-f40e-4259-b219-c16397bfe47c tempest-GroupSnapshotsTest-208290777 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-18ea0d56-f7d8-486f-afe8-e04809c872a5.info is being set with open permissions: ugo+rw: NotImplementedError
Feb 27 01:24:07 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9906ab14-f40e-4259-b219-c16397bfe47c tempest-GroupSnapshotsTest-208290777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-18ea0d56-f7d8-486f-afe8-e04809c872a5.info {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:07 devstack sudo[86039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-18ea0d56-f7d8-486f-afe8-e04809c872a5.info
Feb 27 01:24:07 devstack sudo[86039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:08 devstack sudo[86039]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:08 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9906ab14-f40e-4259-b219-c16397bfe47c tempest-GroupSnapshotsTest-208290777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-18ea0d56-f7d8-486f-afe8-e04809c872a5.info" returned: 0 in 0.708s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:08 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-9906ab14-f40e-4259-b219-c16397bfe47c tempest-GroupSnapshotsTest-208290777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.338s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:24:08 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-9906ab14-f40e-4259-b219-c16397bfe47c tempest-GroupSnapshotsTest-208290777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:24:08 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-9906ab14-f40e-4259-b219-c16397bfe47c tempest-GroupSnapshotsTest-208290777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:24:08 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-9906ab14-f40e-4259-b219-c16397bfe47c tempest-GroupSnapshotsTest-208290777 None] Creating offline snapshot c42c8941-29ce-4098-bcaa-0fec56d81370 of volume 793305e7-37f9-4924-b41a-6dbe6af81352 {{(pid=83106) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:24:08 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[0254616c-7e36-4e5d-a7e3-e403c6367975]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:24:08 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9906ab14-f40e-4259-b219-c16397bfe47c tempest-GroupSnapshotsTest-208290777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-793305e7-37f9-4924-b41a-6dbe6af81352 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:08 devstack sudo[86042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-793305e7-37f9-4924-b41a-6dbe6af81352
Feb 27 01:24:08 devstack sudo[86042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:08 devstack sudo[86042]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:08 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9906ab14-f40e-4259-b219-c16397bfe47c tempest-GroupSnapshotsTest-208290777 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-793305e7-37f9-4924-b41a-6dbe6af81352" returned: 0 in 0.592s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:08 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9906ab14-f40e-4259-b219-c16397bfe47c tempest-GroupSnapshotsTest-208290777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-793305e7-37f9-4924-b41a-6dbe6af81352,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-793305e7-37f9-4924-b41a-6dbe6af81352.c42c8941-29ce-4098-bcaa-0fec56d81370 1G {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:08 devstack sudo[86047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-793305e7-37f9-4924-b41a-6dbe6af81352,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-793305e7-37f9-4924-b41a-6dbe6af81352.c42c8941-29ce-4098-bcaa-0fec56d81370 1G
Feb 27 01:24:08 devstack sudo[86047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:09 devstack sudo[86047]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:09 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9906ab14-f40e-4259-b219-c16397bfe47c tempest-GroupSnapshotsTest-208290777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-793305e7-37f9-4924-b41a-6dbe6af81352,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-793305e7-37f9-4924-b41a-6dbe6af81352.c42c8941-29ce-4098-bcaa-0fec56d81370 1G" returned: 0 in 0.812s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:09 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9906ab14-f40e-4259-b219-c16397bfe47c tempest-GroupSnapshotsTest-208290777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-793305e7-37f9-4924-b41a-6dbe6af81352 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-793305e7-37f9-4924-b41a-6dbe6af81352.c42c8941-29ce-4098-bcaa-0fec56d81370 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:09 devstack sudo[86075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-793305e7-37f9-4924-b41a-6dbe6af81352 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-793305e7-37f9-4924-b41a-6dbe6af81352.c42c8941-29ce-4098-bcaa-0fec56d81370
Feb 27 01:24:09 devstack sudo[86075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:10 devstack sudo[86075]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:10 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9906ab14-f40e-4259-b219-c16397bfe47c tempest-GroupSnapshotsTest-208290777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-793305e7-37f9-4924-b41a-6dbe6af81352 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-793305e7-37f9-4924-b41a-6dbe6af81352.c42c8941-29ce-4098-bcaa-0fec56d81370" returned: 0 in 0.606s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:10 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-9906ab14-f40e-4259-b219-c16397bfe47c tempest-GroupSnapshotsTest-208290777 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-793305e7-37f9-4924-b41a-6dbe6af81352.c42c8941-29ce-4098-bcaa-0fec56d81370 is being set with open permissions: ugo+rw: NotImplementedError
Feb 27 01:24:10 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9906ab14-f40e-4259-b219-c16397bfe47c tempest-GroupSnapshotsTest-208290777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-793305e7-37f9-4924-b41a-6dbe6af81352.c42c8941-29ce-4098-bcaa-0fec56d81370 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:10 devstack sudo[86082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-793305e7-37f9-4924-b41a-6dbe6af81352.c42c8941-29ce-4098-bcaa-0fec56d81370
Feb 27 01:24:10 devstack sudo[86082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:10 devstack sudo[86082]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:10 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9906ab14-f40e-4259-b219-c16397bfe47c tempest-GroupSnapshotsTest-208290777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-793305e7-37f9-4924-b41a-6dbe6af81352.c42c8941-29ce-4098-bcaa-0fec56d81370" returned: 0 in 0.611s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:10 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9906ab14-f40e-4259-b219-c16397bfe47c tempest-GroupSnapshotsTest-208290777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-793305e7-37f9-4924-b41a-6dbe6af81352.info {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:10 devstack sudo[86088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-793305e7-37f9-4924-b41a-6dbe6af81352.info
Feb 27 01:24:10 devstack sudo[86088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:11 devstack sudo[86088]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:11 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9906ab14-f40e-4259-b219-c16397bfe47c tempest-GroupSnapshotsTest-208290777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-793305e7-37f9-4924-b41a-6dbe6af81352.info" returned: 0 in 0.524s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:11 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-9906ab14-f40e-4259-b219-c16397bfe47c tempest-GroupSnapshotsTest-208290777 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-793305e7-37f9-4924-b41a-6dbe6af81352.info is being set with open permissions: ugo+rw: NotImplementedError
Feb 27 01:24:11 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9906ab14-f40e-4259-b219-c16397bfe47c tempest-GroupSnapshotsTest-208290777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-793305e7-37f9-4924-b41a-6dbe6af81352.info {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:11 devstack sudo[86100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-793305e7-37f9-4924-b41a-6dbe6af81352.info
Feb 27 01:24:11 devstack sudo[86100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:12 devstack sudo[86100]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:12 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9906ab14-f40e-4259-b219-c16397bfe47c tempest-GroupSnapshotsTest-208290777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-793305e7-37f9-4924-b41a-6dbe6af81352.info" returned: 0 in 0.565s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:12 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-9906ab14-f40e-4259-b219-c16397bfe47c tempest-GroupSnapshotsTest-208290777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.835s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:24:12 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-7c10d95b-dab3-4c12-8442-6f3f4d5cf520 tempest-ServersNegativeTestJSON-1393661834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.613s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:24:12 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-7c10d95b-dab3-4c12-8442-6f3f4d5cf520 tempest-ServersNegativeTestJSON-1393661834 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:24:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-426509726',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c59d67f0-eb7f-404d-9006-2dab96b99b8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a82b826f7df74cf1a817b12f17b63eff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:24:06Z,use_quota=True,user_id='b5f85e8b87a940fba75d6b28672559c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:24:12 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-7c10d95b-dab3-4c12-8442-6f3f4d5cf520 tempest-ServersNegativeTestJSON-1393661834 None] Creating volume c59d67f0-eb7f-404d-9006-2dab96b99b8e {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:24:12 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-7c10d95b-dab3-4c12-8442-6f3f4d5cf520 tempest-ServersNegativeTestJSON-1393661834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:24:12 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-7c10d95b-dab3-4c12-8442-6f3f4d5cf520 tempest-ServersNegativeTestJSON-1393661834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:24:12 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-7c10d95b-dab3-4c12-8442-6f3f4d5cf520 tempest-ServersNegativeTestJSON-1393661834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:24:12 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-7c10d95b-dab3-4c12-8442-6f3f4d5cf520 tempest-ServersNegativeTestJSON-1393661834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:24:12 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-7c10d95b-dab3-4c12-8442-6f3f4d5cf520 tempest-ServersNegativeTestJSON-1393661834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:24:12 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-7c10d95b-dab3-4c12-8442-6f3f4d5cf520 tempest-ServersNegativeTestJSON-1393661834 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:24:12 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-7c10d95b-dab3-4c12-8442-6f3f4d5cf520 tempest-ServersNegativeTestJSON-1393661834 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:24:12 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7c10d95b-dab3-4c12-8442-6f3f4d5cf520 tempest-ServersNegativeTestJSON-1393661834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c59d67f0-eb7f-404d-9006-2dab96b99b8e 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:12 devstack sudo[86110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c59d67f0-eb7f-404d-9006-2dab96b99b8e 1073741824
Feb 27 01:24:12 devstack sudo[86110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:12 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-9906ab14-f40e-4259-b219-c16397bfe47c tempest-GroupSnapshotsTest-208290777 None] group_snapshot 1be2ca9a-c9d3-440c-b09e-7e305afdd921: created successfully
Feb 27 01:24:12 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-807e477a-b286-412a-bc66-df1cce77154c tempest-GroupsV320Test-1112428731 None] Group tempest-GroupsV320Test-Group-155481231: creating
Feb 27 01:24:12 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-807e477a-b286-412a-bc66-df1cce77154c tempest-GroupsV320Test-1112428731 None] Group tempest-GroupsV320Test-Group-155481231: created successfully
Feb 27 01:24:12 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-807e477a-b286-412a-bc66-df1cce77154c tempest-GroupsV320Test-1112428731 None] Create group completed successfully.
Feb 27 01:24:12 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-3ad454a0-98a4-4711-82aa-c5164f37c026 tempest-GroupSnapshotsTest-208290777 None] group_snapshot 1be2ca9a-c9d3-440c-b09e-7e305afdd921: deleting
Feb 27 01:24:12 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-3ad454a0-98a4-4711-82aa-c5164f37c026 tempest-GroupSnapshotsTest-208290777 None] group_snapshot 1be2ca9a-c9d3-440c-b09e-7e305afdd921: deleting {{(pid=83106) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Feb 27 01:24:12 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-3ad454a0-98a4-4711-82aa-c5164f37c026 tempest-GroupSnapshotsTest-208290777 None] Acquiring lock "cinder-quobyte-18ea0d56-f7d8-486f-afe8-e04809c872a5" by "delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:24:12 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-3ad454a0-98a4-4711-82aa-c5164f37c026 tempest-GroupSnapshotsTest-208290777 None] Lock "cinder-quobyte-18ea0d56-f7d8-486f-afe8-e04809c872a5" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:24:12 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-3ad454a0-98a4-4711-82aa-c5164f37c026 tempest-GroupSnapshotsTest-208290777 None] Acquiring lock "cinder-quobyte-05a4a4d9-5083-4793-af2a-214d2f6041ad" by "_delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:24:12 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-3ad454a0-98a4-4711-82aa-c5164f37c026 tempest-GroupSnapshotsTest-208290777 None] Lock "cinder-quobyte-05a4a4d9-5083-4793-af2a-214d2f6041ad" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:24:12 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-3ad454a0-98a4-4711-82aa-c5164f37c026 tempest-GroupSnapshotsTest-208290777 None] Deleting offline snapshot 05a4a4d9-5083-4793-af2a-214d2f6041ad of volume 18ea0d56-f7d8-486f-afe8-e04809c872a5 {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:24:12 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-3ad454a0-98a4-4711-82aa-c5164f37c026 tempest-GroupSnapshotsTest-208290777 None] snapshot_file for this snap is: volume-18ea0d56-f7d8-486f-afe8-e04809c872a5.05a4a4d9-5083-4793-af2a-214d2f6041ad {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:24:12 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[6085c81a-6d62-4d0c-ab14-2691b58eb552]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:24:12 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-3ad454a0-98a4-4711-82aa-c5164f37c026 tempest-GroupSnapshotsTest-208290777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-18ea0d56-f7d8-486f-afe8-e04809c872a5.05a4a4d9-5083-4793-af2a-214d2f6041ad {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:12 devstack sudo[86127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-18ea0d56-f7d8-486f-afe8-e04809c872a5.05a4a4d9-5083-4793-af2a-214d2f6041ad
Feb 27 01:24:12 devstack sudo[86127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:12 devstack sudo[86110]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:12 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7c10d95b-dab3-4c12-8442-6f3f4d5cf520 tempest-ServersNegativeTestJSON-1393661834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c59d67f0-eb7f-404d-9006-2dab96b99b8e 1073741824" returned: 0 in 0.832s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:12 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7c10d95b-dab3-4c12-8442-6f3f4d5cf520 tempest-ServersNegativeTestJSON-1393661834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c59d67f0-eb7f-404d-9006-2dab96b99b8e {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:12 devstack sudo[86132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c59d67f0-eb7f-404d-9006-2dab96b99b8e
Feb 27 01:24:12 devstack sudo[86132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:13 devstack sudo[86127]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:13 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-3ad454a0-98a4-4711-82aa-c5164f37c026 tempest-GroupSnapshotsTest-208290777 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-18ea0d56-f7d8-486f-afe8-e04809c872a5.05a4a4d9-5083-4793-af2a-214d2f6041ad" returned: 0 in 0.691s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:13 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-3ad454a0-98a4-4711-82aa-c5164f37c026 tempest-GroupSnapshotsTest-208290777 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18ea0d56-f7d8-486f-afe8-e04809c872a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83106) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:24:13 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[928547d2-745d-4e91-b009-5823e060c5f6]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:24:13 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-3ad454a0-98a4-4711-82aa-c5164f37c026 tempest-GroupSnapshotsTest-208290777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-18ea0d56-f7d8-486f-afe8-e04809c872a5 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:13 devstack sudo[86132]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:13 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7c10d95b-dab3-4c12-8442-6f3f4d5cf520 tempest-ServersNegativeTestJSON-1393661834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c59d67f0-eb7f-404d-9006-2dab96b99b8e" returned: 0 in 0.498s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:13 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-7c10d95b-dab3-4c12-8442-6f3f4d5cf520 tempest-ServersNegativeTestJSON-1393661834 None] <== create_volume: return (1365ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:24:13 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-7c10d95b-dab3-4c12-8442-6f3f4d5cf520 tempest-ServersNegativeTestJSON-1393661834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.369s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:24:13 devstack sudo[86139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-18ea0d56-f7d8-486f-afe8-e04809c872a5
Feb 27 01:24:13 devstack sudo[86139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:13 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7c10d95b-dab3-4c12-8442-6f3f4d5cf520 tempest-ServersNegativeTestJSON-1393661834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f194448-3480-401d-9444-2afc9e3c27c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c59d67f0-eb7f-404d-9006-2dab96b99b8e', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:13 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7c10d95b-dab3-4c12-8442-6f3f4d5cf520 tempest-ServersNegativeTestJSON-1393661834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f03fade-2f1a-41d7-ae78-d5e600725073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:13 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-7c10d95b-dab3-4c12-8442-6f3f4d5cf520 tempest-ServersNegativeTestJSON-1393661834 None] Volume volume-c59d67f0-eb7f-404d-9006-2dab96b99b8e (c59d67f0-eb7f-404d-9006-2dab96b99b8e): created successfully
Feb 27 01:24:13 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7c10d95b-dab3-4c12-8442-6f3f4d5cf520 tempest-ServersNegativeTestJSON-1393661834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f03fade-2f1a-41d7-ae78-d5e600725073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:13 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7c10d95b-dab3-4c12-8442-6f3f4d5cf520 tempest-ServersNegativeTestJSON-1393661834 None] Flow 'volume_create_manager' (79c9d492-3743-435e-939d-c863bf6c3742) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:24:13 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-7c10d95b-dab3-4c12-8442-6f3f4d5cf520 tempest-ServersNegativeTestJSON-1393661834 None] Created volume successfully.
Feb 27 01:24:13 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-d55332c9-0bae-428e-bf29-aa191367be82 tempest-GroupsV320Test-1112428731 None] Created reservations ['476f0970-9458-4977-bcd6-011517267160'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:24:13 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-d55332c9-0bae-428e-bf29-aa191367be82 tempest-GroupsV320Test-1112428731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:24:13 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-d55332c9-0bae-428e-bf29-aa191367be82 tempest-GroupsV320Test-1112428731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:24:13 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-d55332c9-0bae-428e-bf29-aa191367be82 tempest-GroupsV320Test-1112428731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:24:13 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-d55332c9-0bae-428e-bf29-aa191367be82 tempest-GroupsV320Test-1112428731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:24:13 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-d55332c9-0bae-428e-bf29-aa191367be82 tempest-GroupsV320Test-1112428731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:24:13 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d55332c9-0bae-428e-bf29-aa191367be82 tempest-GroupsV320Test-1112428731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:14 devstack sudo[86139]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:14 devstack sudo[86144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:24:14 devstack sudo[86144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:14 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-3ad454a0-98a4-4711-82aa-c5164f37c026 tempest-GroupSnapshotsTest-208290777 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-18ea0d56-f7d8-486f-afe8-e04809c872a5" returned: 0 in 0.647s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:14 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-3ad454a0-98a4-4711-82aa-c5164f37c026 tempest-GroupSnapshotsTest-208290777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-18ea0d56-f7d8-486f-afe8-e04809c872a5.05a4a4d9-5083-4793-af2a-214d2f6041ad {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:14 devstack sudo[86146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-18ea0d56-f7d8-486f-afe8-e04809c872a5.05a4a4d9-5083-4793-af2a-214d2f6041ad
Feb 27 01:24:14 devstack sudo[86146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:14 devstack sudo[86144]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:14 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d55332c9-0bae-428e-bf29-aa191367be82 tempest-GroupsV320Test-1112428731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.683s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:14 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-d55332c9-0bae-428e-bf29-aa191367be82 tempest-GroupsV320Test-1112428731 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:24:14 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-d55332c9-0bae-428e-bf29-aa191367be82 tempest-GroupsV320Test-1112428731 None] Delete group completed successfully.
Feb 27 01:24:14 devstack sudo[86146]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:14 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-3ad454a0-98a4-4711-82aa-c5164f37c026 tempest-GroupSnapshotsTest-208290777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-18ea0d56-f7d8-486f-afe8-e04809c872a5.05a4a4d9-5083-4793-af2a-214d2f6041ad" returned: 0 in 0.696s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:14 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-3ad454a0-98a4-4711-82aa-c5164f37c026 tempest-GroupSnapshotsTest-208290777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-18ea0d56-f7d8-486f-afe8-e04809c872a5.05a4a4d9-5083-4793-af2a-214d2f6041ad {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:14 devstack sudo[86152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-18ea0d56-f7d8-486f-afe8-e04809c872a5.05a4a4d9-5083-4793-af2a-214d2f6041ad
Feb 27 01:24:14 devstack sudo[86152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:15 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e45cc6d-6729-409f-9ead-1c0cbe0cdbef tempest-ServersNegativeTestJSON-1393661834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:24:15 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7e45cc6d-6729-409f-9ead-1c0cbe0cdbef tempest-ServersNegativeTestJSON-1393661834 None] Flow 'volume_create_manager' (5e2c4b99-11ad-4db9-b10a-b51f3b641bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:24:15 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7e45cc6d-6729-409f-9ead-1c0cbe0cdbef tempest-ServersNegativeTestJSON-1393661834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21ada7bb-3a79-42df-b6e6-e3b917aaeaf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:15 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7e45cc6d-6729-409f-9ead-1c0cbe0cdbef tempest-ServersNegativeTestJSON-1393661834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21ada7bb-3a79-42df-b6e6-e3b917aaeaf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:24:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-488721163',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8792ad28-9e96-438d-8a61-ffe105a7e34e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a82b826f7df74cf1a817b12f17b63eff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:24:15Z,use_quota=True,user_id='b5f85e8b87a940fba75d6b28672559c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:15 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7e45cc6d-6729-409f-9ead-1c0cbe0cdbef tempest-ServersNegativeTestJSON-1393661834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dc203b2-3b42-4405-9bc8-60559886d95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:15 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7e45cc6d-6729-409f-9ead-1c0cbe0cdbef tempest-ServersNegativeTestJSON-1393661834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dc203b2-3b42-4405-9bc8-60559886d95b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:15 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7e45cc6d-6729-409f-9ead-1c0cbe0cdbef tempest-ServersNegativeTestJSON-1393661834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ca57cfa-f675-4fb8-8b63-a47c0280c08a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:15 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7e45cc6d-6729-409f-9ead-1c0cbe0cdbef tempest-ServersNegativeTestJSON-1393661834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ca57cfa-f675-4fb8-8b63-a47c0280c08a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8792ad28-9e96-438d-8a61-ffe105a7e34e', 'volume_name': 'volume-8792ad28-9e96-438d-8a61-ffe105a7e34e', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:15 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7e45cc6d-6729-409f-9ead-1c0cbe0cdbef tempest-ServersNegativeTestJSON-1393661834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c94d47af-f417-4207-88a3-f48963fc2204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:15 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7e45cc6d-6729-409f-9ead-1c0cbe0cdbef tempest-ServersNegativeTestJSON-1393661834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c94d47af-f417-4207-88a3-f48963fc2204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:15 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7e45cc6d-6729-409f-9ead-1c0cbe0cdbef tempest-ServersNegativeTestJSON-1393661834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68627527-d404-42fc-bc57-3caba140d52e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:15 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-7e45cc6d-6729-409f-9ead-1c0cbe0cdbef tempest-ServersNegativeTestJSON-1393661834 None] Volume 8792ad28-9e96-438d-8a61-ffe105a7e34e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8792ad28-9e96-438d-8a61-ffe105a7e34e', 'volume_size': 1}
Feb 27 01:24:15 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-7e45cc6d-6729-409f-9ead-1c0cbe0cdbef tempest-ServersNegativeTestJSON-1393661834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:24:15 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-7e45cc6d-6729-409f-9ead-1c0cbe0cdbef tempest-ServersNegativeTestJSON-1393661834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:24:15 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-7e45cc6d-6729-409f-9ead-1c0cbe0cdbef tempest-ServersNegativeTestJSON-1393661834 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:24:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-488721163',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8792ad28-9e96-438d-8a61-ffe105a7e34e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a82b826f7df74cf1a817b12f17b63eff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:24:15Z,use_quota=True,user_id='b5f85e8b87a940fba75d6b28672559c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:24:15 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-7e45cc6d-6729-409f-9ead-1c0cbe0cdbef tempest-ServersNegativeTestJSON-1393661834 None] Creating volume 8792ad28-9e96-438d-8a61-ffe105a7e34e {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:24:15 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-7e45cc6d-6729-409f-9ead-1c0cbe0cdbef tempest-ServersNegativeTestJSON-1393661834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:24:15 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-7e45cc6d-6729-409f-9ead-1c0cbe0cdbef tempest-ServersNegativeTestJSON-1393661834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:24:15 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-7e45cc6d-6729-409f-9ead-1c0cbe0cdbef tempest-ServersNegativeTestJSON-1393661834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:24:15 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-7e45cc6d-6729-409f-9ead-1c0cbe0cdbef tempest-ServersNegativeTestJSON-1393661834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:24:15 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-7e45cc6d-6729-409f-9ead-1c0cbe0cdbef tempest-ServersNegativeTestJSON-1393661834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:24:15 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-7e45cc6d-6729-409f-9ead-1c0cbe0cdbef tempest-ServersNegativeTestJSON-1393661834 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:24:15 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-7e45cc6d-6729-409f-9ead-1c0cbe0cdbef tempest-ServersNegativeTestJSON-1393661834 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:24:15 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7e45cc6d-6729-409f-9ead-1c0cbe0cdbef tempest-ServersNegativeTestJSON-1393661834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8792ad28-9e96-438d-8a61-ffe105a7e34e 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:15 devstack sudo[86154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8792ad28-9e96-438d-8a61-ffe105a7e34e 1073741824
Feb 27 01:24:15 devstack sudo[86154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:15 devstack sudo[86152]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:15 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-3ad454a0-98a4-4711-82aa-c5164f37c026 tempest-GroupSnapshotsTest-208290777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-18ea0d56-f7d8-486f-afe8-e04809c872a5.05a4a4d9-5083-4793-af2a-214d2f6041ad" returned: 0 in 0.485s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:15 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-3ad454a0-98a4-4711-82aa-c5164f37c026 tempest-GroupSnapshotsTest-208290777 None] Lock "cinder-quobyte-05a4a4d9-5083-4793-af2a-214d2f6041ad" released by "_delete_snapshot" :: held 2.592s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:24:15 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-3ad454a0-98a4-4711-82aa-c5164f37c026 tempest-GroupSnapshotsTest-208290777 None] Lock "cinder-quobyte-18ea0d56-f7d8-486f-afe8-e04809c872a5" released by "delete_snapshot" :: held 2.606s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:24:15 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-3ad454a0-98a4-4711-82aa-c5164f37c026 tempest-GroupSnapshotsTest-208290777 None] Acquiring lock "cinder-quobyte-793305e7-37f9-4924-b41a-6dbe6af81352" by "delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:24:15 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-3ad454a0-98a4-4711-82aa-c5164f37c026 tempest-GroupSnapshotsTest-208290777 None] Lock "cinder-quobyte-793305e7-37f9-4924-b41a-6dbe6af81352" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:24:15 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-3ad454a0-98a4-4711-82aa-c5164f37c026 tempest-GroupSnapshotsTest-208290777 None] Acquiring lock "cinder-quobyte-c42c8941-29ce-4098-bcaa-0fec56d81370" by "_delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:24:15 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-3ad454a0-98a4-4711-82aa-c5164f37c026 tempest-GroupSnapshotsTest-208290777 None] Lock "cinder-quobyte-c42c8941-29ce-4098-bcaa-0fec56d81370" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:24:15 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-3ad454a0-98a4-4711-82aa-c5164f37c026 tempest-GroupSnapshotsTest-208290777 None] Deleting offline snapshot c42c8941-29ce-4098-bcaa-0fec56d81370 of volume 793305e7-37f9-4924-b41a-6dbe6af81352 {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:24:15 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-3ad454a0-98a4-4711-82aa-c5164f37c026 tempest-GroupSnapshotsTest-208290777 None] snapshot_file for this snap is: volume-793305e7-37f9-4924-b41a-6dbe6af81352.c42c8941-29ce-4098-bcaa-0fec56d81370 {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:24:15 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[05cd76a0-6e1e-4b07-b606-cfe7e38a5e8c]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:24:15 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-3ad454a0-98a4-4711-82aa-c5164f37c026 tempest-GroupSnapshotsTest-208290777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-793305e7-37f9-4924-b41a-6dbe6af81352.c42c8941-29ce-4098-bcaa-0fec56d81370 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:15 devstack sudo[86182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-793305e7-37f9-4924-b41a-6dbe6af81352.c42c8941-29ce-4098-bcaa-0fec56d81370
Feb 27 01:24:15 devstack sudo[86182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:15 devstack sudo[86154]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:15 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7e45cc6d-6729-409f-9ead-1c0cbe0cdbef tempest-ServersNegativeTestJSON-1393661834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8792ad28-9e96-438d-8a61-ffe105a7e34e 1073741824" returned: 0 in 0.685s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:15 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7e45cc6d-6729-409f-9ead-1c0cbe0cdbef tempest-ServersNegativeTestJSON-1393661834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8792ad28-9e96-438d-8a61-ffe105a7e34e {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:15 devstack sudo[86210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8792ad28-9e96-438d-8a61-ffe105a7e34e
Feb 27 01:24:15 devstack sudo[86210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:16 devstack sudo[86182]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:16 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-3ad454a0-98a4-4711-82aa-c5164f37c026 tempest-GroupSnapshotsTest-208290777 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-793305e7-37f9-4924-b41a-6dbe6af81352.c42c8941-29ce-4098-bcaa-0fec56d81370" returned: 0 in 0.895s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:16 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-3ad454a0-98a4-4711-82aa-c5164f37c026 tempest-GroupSnapshotsTest-208290777 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-793305e7-37f9-4924-b41a-6dbe6af81352(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83106) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:24:16 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba91b69c-77ea-449f-971c-41b618bddd4c]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:24:16 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-3ad454a0-98a4-4711-82aa-c5164f37c026 tempest-GroupSnapshotsTest-208290777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-793305e7-37f9-4924-b41a-6dbe6af81352 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:16 devstack sudo[86219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-793305e7-37f9-4924-b41a-6dbe6af81352
Feb 27 01:24:16 devstack sudo[86219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:16 devstack sudo[86210]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:16 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7e45cc6d-6729-409f-9ead-1c0cbe0cdbef tempest-ServersNegativeTestJSON-1393661834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8792ad28-9e96-438d-8a61-ffe105a7e34e" returned: 0 in 0.660s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:16 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-7e45cc6d-6729-409f-9ead-1c0cbe0cdbef tempest-ServersNegativeTestJSON-1393661834 None] <== create_volume: return (1439ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:24:16 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-7e45cc6d-6729-409f-9ead-1c0cbe0cdbef tempest-ServersNegativeTestJSON-1393661834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.442s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:24:16 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7e45cc6d-6729-409f-9ead-1c0cbe0cdbef tempest-ServersNegativeTestJSON-1393661834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68627527-d404-42fc-bc57-3caba140d52e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8792ad28-9e96-438d-8a61-ffe105a7e34e', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:16 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7e45cc6d-6729-409f-9ead-1c0cbe0cdbef tempest-ServersNegativeTestJSON-1393661834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b0d1851-01e6-47b6-9c9e-b2e33ac2a1be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:16 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-7e45cc6d-6729-409f-9ead-1c0cbe0cdbef tempest-ServersNegativeTestJSON-1393661834 None] Volume volume-8792ad28-9e96-438d-8a61-ffe105a7e34e (8792ad28-9e96-438d-8a61-ffe105a7e34e): created successfully
Feb 27 01:24:16 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7e45cc6d-6729-409f-9ead-1c0cbe0cdbef tempest-ServersNegativeTestJSON-1393661834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b0d1851-01e6-47b6-9c9e-b2e33ac2a1be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:16 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7e45cc6d-6729-409f-9ead-1c0cbe0cdbef tempest-ServersNegativeTestJSON-1393661834 None] Flow 'volume_create_manager' (5e2c4b99-11ad-4db9-b10a-b51f3b641bdd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:24:16 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-7e45cc6d-6729-409f-9ead-1c0cbe0cdbef tempest-ServersNegativeTestJSON-1393661834 None] Created volume successfully.
Feb 27 01:24:17 devstack sudo[86219]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:17 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-3ad454a0-98a4-4711-82aa-c5164f37c026 tempest-GroupSnapshotsTest-208290777 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-793305e7-37f9-4924-b41a-6dbe6af81352" returned: 0 in 0.849s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:17 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-3ad454a0-98a4-4711-82aa-c5164f37c026 tempest-GroupSnapshotsTest-208290777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-793305e7-37f9-4924-b41a-6dbe6af81352.c42c8941-29ce-4098-bcaa-0fec56d81370 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:17 devstack sudo[86226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-793305e7-37f9-4924-b41a-6dbe6af81352.c42c8941-29ce-4098-bcaa-0fec56d81370
Feb 27 01:24:17 devstack sudo[86226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:17 devstack sudo[86226]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:17 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-3ad454a0-98a4-4711-82aa-c5164f37c026 tempest-GroupSnapshotsTest-208290777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-793305e7-37f9-4924-b41a-6dbe6af81352.c42c8941-29ce-4098-bcaa-0fec56d81370" returned: 0 in 0.573s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:17 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-3ad454a0-98a4-4711-82aa-c5164f37c026 tempest-GroupSnapshotsTest-208290777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-793305e7-37f9-4924-b41a-6dbe6af81352.c42c8941-29ce-4098-bcaa-0fec56d81370 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:17 devstack sudo[86232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-793305e7-37f9-4924-b41a-6dbe6af81352.c42c8941-29ce-4098-bcaa-0fec56d81370
Feb 27 01:24:17 devstack sudo[86232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:17 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-00ea4223-d744-4a12-92cf-5e4d4f6f9199 tempest-ServersNegativeTestJSON-1393661834 None] Acquiring lock "cinder-8792ad28-9e96-438d-8a61-ffe105a7e34e-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:24:17 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-00ea4223-d744-4a12-92cf-5e4d4f6f9199 tempest-ServersNegativeTestJSON-1393661834 None] Lock "cinder-8792ad28-9e96-438d-8a61-ffe105a7e34e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:24:17 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-00ea4223-d744-4a12-92cf-5e4d4f6f9199 tempest-ServersNegativeTestJSON-1393661834 None] Acquiring lock "cinder-quobyte-8792ad28-9e96-438d-8a61-ffe105a7e34e" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:24:17 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-00ea4223-d744-4a12-92cf-5e4d4f6f9199 tempest-ServersNegativeTestJSON-1393661834 None] Lock "cinder-quobyte-8792ad28-9e96-438d-8a61-ffe105a7e34e" acquired by "delete_volume" :: waited 0.009s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:24:17 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aadd1ad-1a86-4819-b1b8-3aed6afee17e]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:24:17 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-00ea4223-d744-4a12-92cf-5e4d4f6f9199 tempest-ServersNegativeTestJSON-1393661834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8792ad28-9e96-438d-8a61-ffe105a7e34e {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:18 devstack sudo[86234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8792ad28-9e96-438d-8a61-ffe105a7e34e
Feb 27 01:24:18 devstack sudo[86234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:18 devstack sudo[86232]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:18 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-3ad454a0-98a4-4711-82aa-c5164f37c026 tempest-GroupSnapshotsTest-208290777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-793305e7-37f9-4924-b41a-6dbe6af81352.c42c8941-29ce-4098-bcaa-0fec56d81370" returned: 0 in 0.914s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:18 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-3ad454a0-98a4-4711-82aa-c5164f37c026 tempest-GroupSnapshotsTest-208290777 None] Lock "cinder-quobyte-c42c8941-29ce-4098-bcaa-0fec56d81370" released by "_delete_snapshot" :: held 3.323s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:24:18 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-3ad454a0-98a4-4711-82aa-c5164f37c026 tempest-GroupSnapshotsTest-208290777 None] Lock "cinder-quobyte-793305e7-37f9-4924-b41a-6dbe6af81352" released by "delete_snapshot" :: held 3.344s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:24:18 devstack cinder-volume[83106]: WARNING cinder.quota [None req-3ad454a0-98a4-4711-82aa-c5164f37c026 tempest-GroupSnapshotsTest-208290777 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2057300925 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2057300925, it is now deprecated. Please use the default quota class for default quota.
Feb 27 01:24:18 devstack cinder-volume[83106]: WARNING cinder.quota [None req-3ad454a0-98a4-4711-82aa-c5164f37c026 tempest-GroupSnapshotsTest-208290777 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2057300925 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2057300925, it is now deprecated. Please use the default quota class for default quota.
Feb 27 01:24:18 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-3ad454a0-98a4-4711-82aa-c5164f37c026 tempest-GroupSnapshotsTest-208290777 None] Created reservations ['eff31ee2-aa4b-42ef-8684-a7cff9daa7fd', 'd0e29900-4bf9-496f-b581-e9626bb622d7', 'eed7da3b-fe2b-41d5-ba2c-742aa3392402', 'e5695448-c478-49fd-94c6-a23a503d8f1e'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:24:18 devstack sudo[86234]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:18 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-00ea4223-d744-4a12-92cf-5e4d4f6f9199 tempest-ServersNegativeTestJSON-1393661834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8792ad28-9e96-438d-8a61-ffe105a7e34e" returned: 0 in 0.781s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:18 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-00ea4223-d744-4a12-92cf-5e4d4f6f9199 tempest-ServersNegativeTestJSON-1393661834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8792ad28-9e96-438d-8a61-ffe105a7e34e {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:18 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-3ad454a0-98a4-4711-82aa-c5164f37c026 tempest-GroupSnapshotsTest-208290777 None] Created reservations ['a772bb90-ac00-45a2-acb4-6a712067eb1b', '6837afa6-bbda-43de-99eb-c13bd4a2abda', 'fe97280d-50d1-4215-b115-95d0032e54fc', '54301404-53ec-44eb-92b6-d9ae18bdbbdb'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:24:18 devstack sudo[86240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8792ad28-9e96-438d-8a61-ffe105a7e34e
Feb 27 01:24:18 devstack sudo[86240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:18 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-3ad454a0-98a4-4711-82aa-c5164f37c026 tempest-GroupSnapshotsTest-208290777 None] group_snapshot 1be2ca9a-c9d3-440c-b09e-7e305afdd921: deleted successfully
Feb 27 01:24:19 devstack sudo[86240]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:19 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-00ea4223-d744-4a12-92cf-5e4d4f6f9199 tempest-ServersNegativeTestJSON-1393661834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8792ad28-9e96-438d-8a61-ffe105a7e34e" returned: 0 in 0.690s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:19 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-00ea4223-d744-4a12-92cf-5e4d4f6f9199 tempest-ServersNegativeTestJSON-1393661834 None] Lock "cinder-quobyte-8792ad28-9e96-438d-8a61-ffe105a7e34e" released by "delete_volume" :: held 1.612s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:24:19 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-b574e598-99a9-4a8b-9ef8-3b1f09f37f2b tempest-GroupSnapshotsTest-208290777 None] Acquiring lock "cinder-quobyte-18ea0d56-f7d8-486f-afe8-e04809c872a5" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:24:19 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-b574e598-99a9-4a8b-9ef8-3b1f09f37f2b tempest-GroupSnapshotsTest-208290777 None] Lock "cinder-quobyte-18ea0d56-f7d8-486f-afe8-e04809c872a5" acquired by "delete_volume" :: waited 0.038s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:24:19 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d755ad-0d0e-4388-b792-4e382aca7f75]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:24:19 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b574e598-99a9-4a8b-9ef8-3b1f09f37f2b tempest-GroupSnapshotsTest-208290777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-18ea0d56-f7d8-486f-afe8-e04809c872a5 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:19 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-00ea4223-d744-4a12-92cf-5e4d4f6f9199 tempest-ServersNegativeTestJSON-1393661834 None] Created reservations ['77217f75-8466-4e24-9c18-86ed4e6953f2', 'cb903ebf-f3d0-431c-a2a9-1ba500b9e8a0', 'e4455de2-0858-4099-9b90-c221db18d04a', '12fb655c-35c2-42a9-b380-7c10dcf561c0'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:24:19 devstack sudo[86243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-18ea0d56-f7d8-486f-afe8-e04809c872a5
Feb 27 01:24:19 devstack sudo[86243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:19 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-00ea4223-d744-4a12-92cf-5e4d4f6f9199 tempest-ServersNegativeTestJSON-1393661834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:24:19 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-00ea4223-d744-4a12-92cf-5e4d4f6f9199 tempest-ServersNegativeTestJSON-1393661834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:24:19 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-00ea4223-d744-4a12-92cf-5e4d4f6f9199 tempest-ServersNegativeTestJSON-1393661834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:24:19 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-00ea4223-d744-4a12-92cf-5e4d4f6f9199 tempest-ServersNegativeTestJSON-1393661834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:24:19 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-00ea4223-d744-4a12-92cf-5e4d4f6f9199 tempest-ServersNegativeTestJSON-1393661834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:24:19 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-00ea4223-d744-4a12-92cf-5e4d4f6f9199 tempest-ServersNegativeTestJSON-1393661834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:19 devstack sudo[86245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:24:19 devstack sudo[86245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:20 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-1fc92ca1-aa4f-4d88-99d8-cf0d82d16715 tempest-ServersNegativeTestJSON-1393661834 None] Acquiring lock "cinder-c59d67f0-eb7f-404d-9006-2dab96b99b8e-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:24:20 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-1fc92ca1-aa4f-4d88-99d8-cf0d82d16715 tempest-ServersNegativeTestJSON-1393661834 None] Lock "cinder-c59d67f0-eb7f-404d-9006-2dab96b99b8e-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:24:20 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-1fc92ca1-aa4f-4d88-99d8-cf0d82d16715 tempest-ServersNegativeTestJSON-1393661834 None] Acquiring lock "cinder-quobyte-c59d67f0-eb7f-404d-9006-2dab96b99b8e" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:24:20 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-1fc92ca1-aa4f-4d88-99d8-cf0d82d16715 tempest-ServersNegativeTestJSON-1393661834 None] Lock "cinder-quobyte-c59d67f0-eb7f-404d-9006-2dab96b99b8e" acquired by "delete_volume" :: waited 0.014s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:24:20 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6716e7b-9652-4167-8c10-615c2f693013]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:24:20 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-1fc92ca1-aa4f-4d88-99d8-cf0d82d16715 tempest-ServersNegativeTestJSON-1393661834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c59d67f0-eb7f-404d-9006-2dab96b99b8e {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:20 devstack sudo[86243]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:20 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b574e598-99a9-4a8b-9ef8-3b1f09f37f2b tempest-GroupSnapshotsTest-208290777 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-18ea0d56-f7d8-486f-afe8-e04809c872a5" returned: 0 in 0.631s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:20 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b574e598-99a9-4a8b-9ef8-3b1f09f37f2b tempest-GroupSnapshotsTest-208290777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-18ea0d56-f7d8-486f-afe8-e04809c872a5 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:20 devstack sudo[86249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c59d67f0-eb7f-404d-9006-2dab96b99b8e
Feb 27 01:24:20 devstack sudo[86249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:20 devstack sudo[86251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-18ea0d56-f7d8-486f-afe8-e04809c872a5
Feb 27 01:24:20 devstack sudo[86251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:20 devstack sudo[86245]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:20 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-00ea4223-d744-4a12-92cf-5e4d4f6f9199 tempest-ServersNegativeTestJSON-1393661834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.696s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:20 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-00ea4223-d744-4a12-92cf-5e4d4f6f9199 tempest-ServersNegativeTestJSON-1393661834 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:24:20 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-00ea4223-d744-4a12-92cf-5e4d4f6f9199 tempest-ServersNegativeTestJSON-1393661834 None] Deleted volume successfully.
Feb 27 01:24:20 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-00ea4223-d744-4a12-92cf-5e4d4f6f9199 tempest-ServersNegativeTestJSON-1393661834 None] Lock "cinder-8792ad28-9e96-438d-8a61-ffe105a7e34e-delete_volume" released by "delete_volume" :: held 2.652s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:24:20 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-16a0374b-cc95-4e83-a5c6-38bece9e1655 tempest-VolumesServicesTestJSON-1524881626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:24:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-16a0374b-cc95-4e83-a5c6-38bece9e1655 tempest-VolumesServicesTestJSON-1524881626 None] Flow 'volume_create_manager' (ec3f1b30-20f5-42c9-b725-8180b03dc466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:24:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-16a0374b-cc95-4e83-a5c6-38bece9e1655 tempest-VolumesServicesTestJSON-1524881626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82faf155-d9bd-4f7a-8189-eced54c9ae66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-16a0374b-cc95-4e83-a5c6-38bece9e1655 tempest-VolumesServicesTestJSON-1524881626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82faf155-d9bd-4f7a-8189-eced54c9ae66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:24:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-25055940',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb6986e8-1184-4799-bfeb-a8fd3eec8377,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34c7176f73bb4a56ada5eca1e66938ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:24:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:24:21Z,use_quota=True,user_id='117c5f5646b4492a80da6e3ca6d0a11c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-16a0374b-cc95-4e83-a5c6-38bece9e1655 tempest-VolumesServicesTestJSON-1524881626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45370b14-649f-496c-a272-da4be5316144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-16a0374b-cc95-4e83-a5c6-38bece9e1655 tempest-VolumesServicesTestJSON-1524881626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45370b14-649f-496c-a272-da4be5316144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-16a0374b-cc95-4e83-a5c6-38bece9e1655 tempest-VolumesServicesTestJSON-1524881626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (094a52dc-ccaf-4826-a0c6-af07c742fbed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-16a0374b-cc95-4e83-a5c6-38bece9e1655 tempest-VolumesServicesTestJSON-1524881626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (094a52dc-ccaf-4826-a0c6-af07c742fbed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb6986e8-1184-4799-bfeb-a8fd3eec8377', 'volume_name': 'volume-fb6986e8-1184-4799-bfeb-a8fd3eec8377', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-16a0374b-cc95-4e83-a5c6-38bece9e1655 tempest-VolumesServicesTestJSON-1524881626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c258b357-7b3c-46a6-ad3e-2e06509d4857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-16a0374b-cc95-4e83-a5c6-38bece9e1655 tempest-VolumesServicesTestJSON-1524881626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c258b357-7b3c-46a6-ad3e-2e06509d4857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-16a0374b-cc95-4e83-a5c6-38bece9e1655 tempest-VolumesServicesTestJSON-1524881626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (987497e6-60d0-4f9d-b9d8-39691e8156b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:20 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-16a0374b-cc95-4e83-a5c6-38bece9e1655 tempest-VolumesServicesTestJSON-1524881626 None] Volume fb6986e8-1184-4799-bfeb-a8fd3eec8377: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb6986e8-1184-4799-bfeb-a8fd3eec8377', 'volume_size': 1}
Feb 27 01:24:20 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-16a0374b-cc95-4e83-a5c6-38bece9e1655 tempest-VolumesServicesTestJSON-1524881626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:24:20 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-16a0374b-cc95-4e83-a5c6-38bece9e1655 tempest-VolumesServicesTestJSON-1524881626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:24:20 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-16a0374b-cc95-4e83-a5c6-38bece9e1655 tempest-VolumesServicesTestJSON-1524881626 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:24:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-25055940',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb6986e8-1184-4799-bfeb-a8fd3eec8377,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34c7176f73bb4a56ada5eca1e66938ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:24:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:24:21Z,use_quota=True,user_id='117c5f5646b4492a80da6e3ca6d0a11c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:24:20 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-16a0374b-cc95-4e83-a5c6-38bece9e1655 tempest-VolumesServicesTestJSON-1524881626 None] Creating volume fb6986e8-1184-4799-bfeb-a8fd3eec8377 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:24:20 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-16a0374b-cc95-4e83-a5c6-38bece9e1655 tempest-VolumesServicesTestJSON-1524881626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:24:20 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-16a0374b-cc95-4e83-a5c6-38bece9e1655 tempest-VolumesServicesTestJSON-1524881626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:24:20 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-16a0374b-cc95-4e83-a5c6-38bece9e1655 tempest-VolumesServicesTestJSON-1524881626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:24:20 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-16a0374b-cc95-4e83-a5c6-38bece9e1655 tempest-VolumesServicesTestJSON-1524881626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:24:20 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-16a0374b-cc95-4e83-a5c6-38bece9e1655 tempest-VolumesServicesTestJSON-1524881626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:24:20 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-16a0374b-cc95-4e83-a5c6-38bece9e1655 tempest-VolumesServicesTestJSON-1524881626 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:24:20 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-16a0374b-cc95-4e83-a5c6-38bece9e1655 tempest-VolumesServicesTestJSON-1524881626 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:24:20 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-16a0374b-cc95-4e83-a5c6-38bece9e1655 tempest-VolumesServicesTestJSON-1524881626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-fb6986e8-1184-4799-bfeb-a8fd3eec8377 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:20 devstack sudo[86255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-fb6986e8-1184-4799-bfeb-a8fd3eec8377 1073741824
Feb 27 01:24:20 devstack sudo[86255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:20 devstack sudo[86249]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:20 devstack sudo[86251]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:20 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b574e598-99a9-4a8b-9ef8-3b1f09f37f2b tempest-GroupSnapshotsTest-208290777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-18ea0d56-f7d8-486f-afe8-e04809c872a5" returned: 0 in 0.670s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:20 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-1fc92ca1-aa4f-4d88-99d8-cf0d82d16715 tempest-ServersNegativeTestJSON-1393661834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c59d67f0-eb7f-404d-9006-2dab96b99b8e" returned: 0 in 0.792s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:20 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-1fc92ca1-aa4f-4d88-99d8-cf0d82d16715 tempest-ServersNegativeTestJSON-1393661834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c59d67f0-eb7f-404d-9006-2dab96b99b8e {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:20 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-b574e598-99a9-4a8b-9ef8-3b1f09f37f2b tempest-GroupSnapshotsTest-208290777 None] Lock "cinder-quobyte-18ea0d56-f7d8-486f-afe8-e04809c872a5" released by "delete_volume" :: held 1.359s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:24:20 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-b574e598-99a9-4a8b-9ef8-3b1f09f37f2b tempest-GroupSnapshotsTest-208290777 None] Acquiring lock "cinder-quobyte-793305e7-37f9-4924-b41a-6dbe6af81352" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:24:20 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-b574e598-99a9-4a8b-9ef8-3b1f09f37f2b tempest-GroupSnapshotsTest-208290777 None] Lock "cinder-quobyte-793305e7-37f9-4924-b41a-6dbe6af81352" acquired by "delete_volume" :: waited 0.016s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:24:21 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[51bdef95-fa08-423f-a61a-7ee0772df295]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:24:21 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b574e598-99a9-4a8b-9ef8-3b1f09f37f2b tempest-GroupSnapshotsTest-208290777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-793305e7-37f9-4924-b41a-6dbe6af81352 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:21 devstack sudo[86267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c59d67f0-eb7f-404d-9006-2dab96b99b8e
Feb 27 01:24:21 devstack sudo[86267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:21 devstack sudo[86269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-793305e7-37f9-4924-b41a-6dbe6af81352
Feb 27 01:24:21 devstack sudo[86269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:21 devstack sudo[86255]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:21 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-16a0374b-cc95-4e83-a5c6-38bece9e1655 tempest-VolumesServicesTestJSON-1524881626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-fb6986e8-1184-4799-bfeb-a8fd3eec8377 1073741824" returned: 0 in 0.798s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:21 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-16a0374b-cc95-4e83-a5c6-38bece9e1655 tempest-VolumesServicesTestJSON-1524881626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-fb6986e8-1184-4799-bfeb-a8fd3eec8377 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:21 devstack sudo[86291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-fb6986e8-1184-4799-bfeb-a8fd3eec8377
Feb 27 01:24:21 devstack sudo[86291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:21 devstack sudo[86267]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:21 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-1fc92ca1-aa4f-4d88-99d8-cf0d82d16715 tempest-ServersNegativeTestJSON-1393661834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c59d67f0-eb7f-404d-9006-2dab96b99b8e" returned: 0 in 0.797s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:21 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-1fc92ca1-aa4f-4d88-99d8-cf0d82d16715 tempest-ServersNegativeTestJSON-1393661834 None] Lock "cinder-quobyte-c59d67f0-eb7f-404d-9006-2dab96b99b8e" released by "delete_volume" :: held 1.638s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:24:21 devstack sudo[86269]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:21 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b574e598-99a9-4a8b-9ef8-3b1f09f37f2b tempest-GroupSnapshotsTest-208290777 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-793305e7-37f9-4924-b41a-6dbe6af81352" returned: 0 in 0.762s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:21 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b574e598-99a9-4a8b-9ef8-3b1f09f37f2b tempest-GroupSnapshotsTest-208290777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-793305e7-37f9-4924-b41a-6dbe6af81352 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:21 devstack sudo[86316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-793305e7-37f9-4924-b41a-6dbe6af81352
Feb 27 01:24:21 devstack sudo[86316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:21 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-1fc92ca1-aa4f-4d88-99d8-cf0d82d16715 tempest-ServersNegativeTestJSON-1393661834 None] Created reservations ['04a1d3fd-981c-4f11-900f-386930bcde87', 'd9bee19b-566d-4a5a-afc5-6de0103a7ea6', '85fc63af-6ff3-482c-a38e-145b61c396d3', '66a1fb6d-bf7d-4bfc-b632-6ddc7290b982'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:24:21 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-1fc92ca1-aa4f-4d88-99d8-cf0d82d16715 tempest-ServersNegativeTestJSON-1393661834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:24:21 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-1fc92ca1-aa4f-4d88-99d8-cf0d82d16715 tempest-ServersNegativeTestJSON-1393661834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:24:21 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-1fc92ca1-aa4f-4d88-99d8-cf0d82d16715 tempest-ServersNegativeTestJSON-1393661834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:24:21 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-1fc92ca1-aa4f-4d88-99d8-cf0d82d16715 tempest-ServersNegativeTestJSON-1393661834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:24:21 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-1fc92ca1-aa4f-4d88-99d8-cf0d82d16715 tempest-ServersNegativeTestJSON-1393661834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:24:21 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-1fc92ca1-aa4f-4d88-99d8-cf0d82d16715 tempest-ServersNegativeTestJSON-1393661834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:21 devstack sudo[86322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:24:21 devstack sudo[86322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:22 devstack sudo[86291]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:22 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-16a0374b-cc95-4e83-a5c6-38bece9e1655 tempest-VolumesServicesTestJSON-1524881626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-fb6986e8-1184-4799-bfeb-a8fd3eec8377" returned: 0 in 0.847s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:22 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-16a0374b-cc95-4e83-a5c6-38bece9e1655 tempest-VolumesServicesTestJSON-1524881626 None] <== create_volume: return (1677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:24:22 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-16a0374b-cc95-4e83-a5c6-38bece9e1655 tempest-VolumesServicesTestJSON-1524881626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.680s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:24:22 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-16a0374b-cc95-4e83-a5c6-38bece9e1655 tempest-VolumesServicesTestJSON-1524881626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (987497e6-60d0-4f9d-b9d8-39691e8156b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb6986e8-1184-4799-bfeb-a8fd3eec8377', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:22 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-16a0374b-cc95-4e83-a5c6-38bece9e1655 tempest-VolumesServicesTestJSON-1524881626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58921c0a-a5cf-4239-9e7c-5c9ab15714a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:22 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-16a0374b-cc95-4e83-a5c6-38bece9e1655 tempest-VolumesServicesTestJSON-1524881626 None] Volume volume-fb6986e8-1184-4799-bfeb-a8fd3eec8377 (fb6986e8-1184-4799-bfeb-a8fd3eec8377): created successfully
Feb 27 01:24:22 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-16a0374b-cc95-4e83-a5c6-38bece9e1655 tempest-VolumesServicesTestJSON-1524881626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58921c0a-a5cf-4239-9e7c-5c9ab15714a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:22 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-16a0374b-cc95-4e83-a5c6-38bece9e1655 tempest-VolumesServicesTestJSON-1524881626 None] Flow 'volume_create_manager' (ec3f1b30-20f5-42c9-b725-8180b03dc466) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:24:22 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-16a0374b-cc95-4e83-a5c6-38bece9e1655 tempest-VolumesServicesTestJSON-1524881626 None] Created volume successfully.
Feb 27 01:24:22 devstack sudo[86316]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:22 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b574e598-99a9-4a8b-9ef8-3b1f09f37f2b tempest-GroupSnapshotsTest-208290777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-793305e7-37f9-4924-b41a-6dbe6af81352" returned: 0 in 0.964s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:22 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-b574e598-99a9-4a8b-9ef8-3b1f09f37f2b tempest-GroupSnapshotsTest-208290777 None] Lock "cinder-quobyte-793305e7-37f9-4924-b41a-6dbe6af81352" released by "delete_volume" :: held 1.776s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:24:22 devstack sudo[86322]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:22 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-1fc92ca1-aa4f-4d88-99d8-cf0d82d16715 tempest-ServersNegativeTestJSON-1393661834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.963s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:22 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-1fc92ca1-aa4f-4d88-99d8-cf0d82d16715 tempest-ServersNegativeTestJSON-1393661834 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:24:22 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-1fc92ca1-aa4f-4d88-99d8-cf0d82d16715 tempest-ServersNegativeTestJSON-1393661834 None] Deleted volume successfully.
Feb 27 01:24:22 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-832ec3e8-5a28-45aa-89fe-079cafe949fb tempest-VolumesServicesTestJSON-1524881626 None] Acquiring lock "cinder-fb6986e8-1184-4799-bfeb-a8fd3eec8377-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:24:22 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-b574e598-99a9-4a8b-9ef8-3b1f09f37f2b tempest-GroupSnapshotsTest-208290777 None] Created reservations ['480d562d-7350-4204-b82e-1546eabc1a5f'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:24:22 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-832ec3e8-5a28-45aa-89fe-079cafe949fb tempest-VolumesServicesTestJSON-1524881626 None] Lock "cinder-fb6986e8-1184-4799-bfeb-a8fd3eec8377-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:24:22 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-1fc92ca1-aa4f-4d88-99d8-cf0d82d16715 tempest-ServersNegativeTestJSON-1393661834 None] Lock "cinder-c59d67f0-eb7f-404d-9006-2dab96b99b8e-delete_volume" released by "delete_volume" :: held 2.913s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:24:22 devstack cinder-volume[83106]: WARNING cinder.quota [None req-b574e598-99a9-4a8b-9ef8-3b1f09f37f2b tempest-GroupSnapshotsTest-208290777 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2057300925 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2057300925, it is now deprecated. Please use the default quota class for default quota.
Feb 27 01:24:23 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-832ec3e8-5a28-45aa-89fe-079cafe949fb tempest-VolumesServicesTestJSON-1524881626 None] Acquiring lock "cinder-quobyte-fb6986e8-1184-4799-bfeb-a8fd3eec8377" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:24:23 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-832ec3e8-5a28-45aa-89fe-079cafe949fb tempest-VolumesServicesTestJSON-1524881626 None] Lock "cinder-quobyte-fb6986e8-1184-4799-bfeb-a8fd3eec8377" acquired by "delete_volume" :: waited 0.013s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:24:23 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-b574e598-99a9-4a8b-9ef8-3b1f09f37f2b tempest-GroupSnapshotsTest-208290777 None] Created reservations ['9bd55b7c-932e-45ea-9c78-f429b06411ef', 'e009d75b-0368-40a3-bd97-136a97150d79', '56abefe7-114a-46c6-a536-ba70f30aba0b', '03f73093-cf5b-4bbb-bb71-eda54ee65971'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:24:23 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea034e7e-22ca-4e25-92d5-22a07c66b73c]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:24:23 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-832ec3e8-5a28-45aa-89fe-079cafe949fb tempest-VolumesServicesTestJSON-1524881626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-fb6986e8-1184-4799-bfeb-a8fd3eec8377 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:23 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-b574e598-99a9-4a8b-9ef8-3b1f09f37f2b tempest-GroupSnapshotsTest-208290777 None] Created reservations ['231e83ac-be61-4c30-8349-06b0ceddda9d', '32b28cca-6e96-403a-961d-b9484091b938', '8941ec65-4128-4e65-9f49-14facd76f7d3', 'a92900e9-bd5b-4a23-9233-4c308564d9d5'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:24:23 devstack sudo[86330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-fb6986e8-1184-4799-bfeb-a8fd3eec8377
Feb 27 01:24:23 devstack sudo[86330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:23 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-b574e598-99a9-4a8b-9ef8-3b1f09f37f2b tempest-GroupSnapshotsTest-208290777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:24:23 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-b574e598-99a9-4a8b-9ef8-3b1f09f37f2b tempest-GroupSnapshotsTest-208290777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:24:23 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-b574e598-99a9-4a8b-9ef8-3b1f09f37f2b tempest-GroupSnapshotsTest-208290777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:24:23 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-b574e598-99a9-4a8b-9ef8-3b1f09f37f2b tempest-GroupSnapshotsTest-208290777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:24:23 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-b574e598-99a9-4a8b-9ef8-3b1f09f37f2b tempest-GroupSnapshotsTest-208290777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:24:23 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b574e598-99a9-4a8b-9ef8-3b1f09f37f2b tempest-GroupSnapshotsTest-208290777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:23 devstack sudo[86332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:24:23 devstack sudo[86332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:23 devstack sudo[86330]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:23 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-832ec3e8-5a28-45aa-89fe-079cafe949fb tempest-VolumesServicesTestJSON-1524881626 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-fb6986e8-1184-4799-bfeb-a8fd3eec8377" returned: 0 in 0.617s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:23 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-832ec3e8-5a28-45aa-89fe-079cafe949fb tempest-VolumesServicesTestJSON-1524881626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-fb6986e8-1184-4799-bfeb-a8fd3eec8377 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:23 devstack sudo[86341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-fb6986e8-1184-4799-bfeb-a8fd3eec8377
Feb 27 01:24:23 devstack sudo[86341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:23 devstack sudo[86332]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:23 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b574e598-99a9-4a8b-9ef8-3b1f09f37f2b tempest-GroupSnapshotsTest-208290777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.493s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:23 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-b574e598-99a9-4a8b-9ef8-3b1f09f37f2b tempest-GroupSnapshotsTest-208290777 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:24:23 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-b574e598-99a9-4a8b-9ef8-3b1f09f37f2b tempest-GroupSnapshotsTest-208290777 None] Delete group completed successfully.
Feb 27 01:24:24 devstack sudo[86341]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:24 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-832ec3e8-5a28-45aa-89fe-079cafe949fb tempest-VolumesServicesTestJSON-1524881626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-fb6986e8-1184-4799-bfeb-a8fd3eec8377" returned: 0 in 0.747s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:24 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-832ec3e8-5a28-45aa-89fe-079cafe949fb tempest-VolumesServicesTestJSON-1524881626 None] Lock "cinder-quobyte-fb6986e8-1184-4799-bfeb-a8fd3eec8377" released by "delete_volume" :: held 1.399s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:24:24 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-832ec3e8-5a28-45aa-89fe-079cafe949fb tempest-VolumesServicesTestJSON-1524881626 None] Created reservations ['9fd6f583-1532-4a68-ae9a-c12fa42d6df7', 'e2e37327-09f0-48a1-8887-63ad9d967c3c', '0765a9c7-5872-47d0-b086-440acd1cf8e0', 'd16ee246-5bbf-4a39-a0c6-413c424b5403'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:24:24 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-832ec3e8-5a28-45aa-89fe-079cafe949fb tempest-VolumesServicesTestJSON-1524881626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:24:24 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-832ec3e8-5a28-45aa-89fe-079cafe949fb tempest-VolumesServicesTestJSON-1524881626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:24:24 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-832ec3e8-5a28-45aa-89fe-079cafe949fb tempest-VolumesServicesTestJSON-1524881626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:24:24 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-832ec3e8-5a28-45aa-89fe-079cafe949fb tempest-VolumesServicesTestJSON-1524881626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:24:24 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-832ec3e8-5a28-45aa-89fe-079cafe949fb tempest-VolumesServicesTestJSON-1524881626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:24:24 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-832ec3e8-5a28-45aa-89fe-079cafe949fb tempest-VolumesServicesTestJSON-1524881626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:24 devstack sudo[86363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:24:24 devstack sudo[86363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:24 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-b8592b9f-ed17-4e65-8724-f1874d4b50da tempest-GroupSnapshotsTest-208290777 None] Group tempest-GroupSnapshotsTest-Group-81364838: creating
Feb 27 01:24:24 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-b8592b9f-ed17-4e65-8724-f1874d4b50da tempest-GroupSnapshotsTest-208290777 None] Group tempest-GroupSnapshotsTest-Group-81364838: created successfully
Feb 27 01:24:24 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-b8592b9f-ed17-4e65-8724-f1874d4b50da tempest-GroupSnapshotsTest-208290777 None] Create group completed successfully.
Feb 27 01:24:25 devstack sudo[86363]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:25 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-832ec3e8-5a28-45aa-89fe-079cafe949fb tempest-VolumesServicesTestJSON-1524881626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.558s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:25 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-832ec3e8-5a28-45aa-89fe-079cafe949fb tempest-VolumesServicesTestJSON-1524881626 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:24:25 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-832ec3e8-5a28-45aa-89fe-079cafe949fb tempest-VolumesServicesTestJSON-1524881626 None] Deleted volume successfully.
Feb 27 01:24:25 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-832ec3e8-5a28-45aa-89fe-079cafe949fb tempest-VolumesServicesTestJSON-1524881626 None] Lock "cinder-fb6986e8-1184-4799-bfeb-a8fd3eec8377-delete_volume" released by "delete_volume" :: held 2.299s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:24:26 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f02978b-8ed5-44de-867c-b946ff4eb95a tempest-GroupSnapshotsTest-208290777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:24:26 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1f02978b-8ed5-44de-867c-b946ff4eb95a tempest-GroupSnapshotsTest-208290777 None] Flow 'volume_create_manager' (aca3ddf7-13fc-4fd1-a224-b5aa28b81cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:24:26 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1f02978b-8ed5-44de-867c-b946ff4eb95a tempest-GroupSnapshotsTest-208290777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74032a7f-b136-4e9a-a19d-593004b1630f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:26 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1f02978b-8ed5-44de-867c-b946ff4eb95a tempest-GroupSnapshotsTest-208290777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74032a7f-b136-4e9a-a19d-593004b1630f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:24:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-521224323',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9cbc3175-48c2-421b-b47f-916e705f4b0b,host='devstack@QuobyteHD#QuobyteHD',id=111252f2-b04c-490d-9331-fddd063df951,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac472ce010b34a03b2fb9217cfad031e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:24:26Z,use_quota=True,user_id='0219e94a4390484f905ea633322ed978',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(88163d8e-6928-4cf1-bcc2-1708eaaf78da),volume_type_id=88163d8e-6928-4cf1-bcc2-1708eaaf78da)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:26 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1f02978b-8ed5-44de-867c-b946ff4eb95a tempest-GroupSnapshotsTest-208290777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e475b545-a239-40b9-874c-d8c8b2b4b82f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:26 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1f02978b-8ed5-44de-867c-b946ff4eb95a tempest-GroupSnapshotsTest-208290777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e475b545-a239-40b9-874c-d8c8b2b4b82f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:26 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1f02978b-8ed5-44de-867c-b946ff4eb95a tempest-GroupSnapshotsTest-208290777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31ead0ea-6921-44d7-9160-3da2855989b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:26 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1f02978b-8ed5-44de-867c-b946ff4eb95a tempest-GroupSnapshotsTest-208290777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31ead0ea-6921-44d7-9160-3da2855989b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '111252f2-b04c-490d-9331-fddd063df951', 'volume_name': 'volume-111252f2-b04c-490d-9331-fddd063df951', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:26 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1f02978b-8ed5-44de-867c-b946ff4eb95a tempest-GroupSnapshotsTest-208290777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cbd7580-e0c1-4910-b1e7-144bcf193998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:26 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1f02978b-8ed5-44de-867c-b946ff4eb95a tempest-GroupSnapshotsTest-208290777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cbd7580-e0c1-4910-b1e7-144bcf193998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:26 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1f02978b-8ed5-44de-867c-b946ff4eb95a tempest-GroupSnapshotsTest-208290777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (878e9c08-f2ee-493b-9e1b-7c1bf78d09a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:26 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-1f02978b-8ed5-44de-867c-b946ff4eb95a tempest-GroupSnapshotsTest-208290777 None] Volume 111252f2-b04c-490d-9331-fddd063df951: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-111252f2-b04c-490d-9331-fddd063df951', 'volume_size': 1}
Feb 27 01:24:26 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-1f02978b-8ed5-44de-867c-b946ff4eb95a tempest-GroupSnapshotsTest-208290777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:24:26 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-1f02978b-8ed5-44de-867c-b946ff4eb95a tempest-GroupSnapshotsTest-208290777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:24:26 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-1f02978b-8ed5-44de-867c-b946ff4eb95a tempest-GroupSnapshotsTest-208290777 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=9cbc3175-48c2-421b-b47f-916e705f4b0b,created_at=2026-02-27T00:24:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-521224323',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9cbc3175-48c2-421b-b47f-916e705f4b0b,host='devstack@QuobyteHD#QuobyteHD',id=111252f2-b04c-490d-9331-fddd063df951,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac472ce010b34a03b2fb9217cfad031e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:24:26Z,use_quota=True,user_id='0219e94a4390484f905ea633322ed978',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(88163d8e-6928-4cf1-bcc2-1708eaaf78da),volume_type_id=88163d8e-6928-4cf1-bcc2-1708eaaf78da)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:24:26 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-1f02978b-8ed5-44de-867c-b946ff4eb95a tempest-GroupSnapshotsTest-208290777 None] Creating volume 111252f2-b04c-490d-9331-fddd063df951 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:24:26 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-1f02978b-8ed5-44de-867c-b946ff4eb95a tempest-GroupSnapshotsTest-208290777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:24:26 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-1f02978b-8ed5-44de-867c-b946ff4eb95a tempest-GroupSnapshotsTest-208290777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:24:26 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-1f02978b-8ed5-44de-867c-b946ff4eb95a tempest-GroupSnapshotsTest-208290777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:24:26 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-1f02978b-8ed5-44de-867c-b946ff4eb95a tempest-GroupSnapshotsTest-208290777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:24:26 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-1f02978b-8ed5-44de-867c-b946ff4eb95a tempest-GroupSnapshotsTest-208290777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:24:26 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-1f02978b-8ed5-44de-867c-b946ff4eb95a tempest-GroupSnapshotsTest-208290777 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:24:26 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-1f02978b-8ed5-44de-867c-b946ff4eb95a tempest-GroupSnapshotsTest-208290777 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:24:26 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-1f02978b-8ed5-44de-867c-b946ff4eb95a tempest-GroupSnapshotsTest-208290777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-111252f2-b04c-490d-9331-fddd063df951 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:26 devstack sudo[86388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-111252f2-b04c-490d-9331-fddd063df951 1073741824
Feb 27 01:24:26 devstack sudo[86388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:27 devstack sudo[86388]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-1f02978b-8ed5-44de-867c-b946ff4eb95a tempest-GroupSnapshotsTest-208290777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-111252f2-b04c-490d-9331-fddd063df951 1073741824" returned: 0 in 0.749s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-1f02978b-8ed5-44de-867c-b946ff4eb95a tempest-GroupSnapshotsTest-208290777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-111252f2-b04c-490d-9331-fddd063df951 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:27 devstack sudo[86394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-111252f2-b04c-490d-9331-fddd063df951
Feb 27 01:24:27 devstack sudo[86394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:27 devstack sudo[86394]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-1f02978b-8ed5-44de-867c-b946ff4eb95a tempest-GroupSnapshotsTest-208290777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-111252f2-b04c-490d-9331-fddd063df951" returned: 0 in 0.569s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:27 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-1f02978b-8ed5-44de-867c-b946ff4eb95a tempest-GroupSnapshotsTest-208290777 None] <== create_volume: return (1361ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:24:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-1f02978b-8ed5-44de-867c-b946ff4eb95a tempest-GroupSnapshotsTest-208290777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.365s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:24:27 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1f02978b-8ed5-44de-867c-b946ff4eb95a tempest-GroupSnapshotsTest-208290777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (878e9c08-f2ee-493b-9e1b-7c1bf78d09a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-111252f2-b04c-490d-9331-fddd063df951', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:27 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1f02978b-8ed5-44de-867c-b946ff4eb95a tempest-GroupSnapshotsTest-208290777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85e293f0-bb20-44cc-9740-6f74210ca0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:27 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-1f02978b-8ed5-44de-867c-b946ff4eb95a tempest-GroupSnapshotsTest-208290777 None] Volume volume-111252f2-b04c-490d-9331-fddd063df951 (111252f2-b04c-490d-9331-fddd063df951): created successfully
Feb 27 01:24:27 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1f02978b-8ed5-44de-867c-b946ff4eb95a tempest-GroupSnapshotsTest-208290777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85e293f0-bb20-44cc-9740-6f74210ca0d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:27 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1f02978b-8ed5-44de-867c-b946ff4eb95a tempest-GroupSnapshotsTest-208290777 None] Flow 'volume_create_manager' (aca3ddf7-13fc-4fd1-a224-b5aa28b81cda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:24:27 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-1f02978b-8ed5-44de-867c-b946ff4eb95a tempest-GroupSnapshotsTest-208290777 None] Created volume successfully.
Feb 27 01:24:28 devstack cinder-volume[83106]: INFO cinder.volume.manager [req-d8c33ebb-7768-446c-942f-54f80232558f req-210a085e-f810-4d56-834c-fa09940ce445 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Terminate volume connection completed successfully.
Feb 27 01:24:28 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [req-d8c33ebb-7768-446c-942f-54f80232558f req-210a085e-f810-4d56-834c-fa09940ce445 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Deleting attachment f9cc37e6-cc08-43b3-b32e-31b4a2b55602. {{(pid=83106) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Feb 27 01:24:28 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-d1cc6f84-ce6d-406f-9b04-63cf61ff944b tempest-GroupSnapshotsTest-208290777 None] GroupSnapshot cc0aada5-803c-4eb7-bc43-16db039e7df7: creating.
Feb 27 01:24:28 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d1cc6f84-ce6d-406f-9b04-63cf61ff944b tempest-GroupSnapshotsTest-208290777 None] Group snapshot cc0aada5-803c-4eb7-bc43-16db039e7df7: creating. {{(pid=83106) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Feb 27 01:24:28 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-d1cc6f84-ce6d-406f-9b04-63cf61ff944b tempest-GroupSnapshotsTest-208290777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:24:28 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-d1cc6f84-ce6d-406f-9b04-63cf61ff944b tempest-GroupSnapshotsTest-208290777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:24:28 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-d1cc6f84-ce6d-406f-9b04-63cf61ff944b tempest-GroupSnapshotsTest-208290777 None] Creating offline snapshot 789e46de-d164-4ff2-a694-b0a0d6e52c5a of volume 111252f2-b04c-490d-9331-fddd063df951 {{(pid=83106) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:24:28 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c278a3-b2c8-4a8f-afa5-8243b8bc3d16]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:24:28 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d1cc6f84-ce6d-406f-9b04-63cf61ff944b tempest-GroupSnapshotsTest-208290777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-111252f2-b04c-490d-9331-fddd063df951 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:28 devstack sudo[86398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-111252f2-b04c-490d-9331-fddd063df951
Feb 27 01:24:28 devstack sudo[86398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:28 devstack cinder-volume[83106]: DEBUG cinder.coordination [req-d8c33ebb-7768-446c-942f-54f80232558f req-8ad1bc9d-4b57-4ec1-88d6-b67b9ffca106 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Acquiring lock "cinder-363bbf57-d127-4cf7-b12f-197fa82f28d8-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:24:28 devstack cinder-volume[83106]: DEBUG cinder.coordination [req-d8c33ebb-7768-446c-942f-54f80232558f req-8ad1bc9d-4b57-4ec1-88d6-b67b9ffca106 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Lock "cinder-363bbf57-d127-4cf7-b12f-197fa82f28d8-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:24:28 devstack cinder-volume[83106]: DEBUG cinder.coordination [req-d8c33ebb-7768-446c-942f-54f80232558f req-8ad1bc9d-4b57-4ec1-88d6-b67b9ffca106 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Acquiring lock "cinder-quobyte-363bbf57-d127-4cf7-b12f-197fa82f28d8" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:24:28 devstack cinder-volume[83106]: DEBUG cinder.coordination [req-d8c33ebb-7768-446c-942f-54f80232558f req-8ad1bc9d-4b57-4ec1-88d6-b67b9ffca106 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Lock "cinder-quobyte-363bbf57-d127-4cf7-b12f-197fa82f28d8" acquired by "delete_volume" :: waited 0.008s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:24:29 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2431560-8a13-40db-ab88-4e15ddca0339]: (4, 'raw') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:24:29 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-d8c33ebb-7768-446c-942f-54f80232558f req-8ad1bc9d-4b57-4ec1-88d6-b67b9ffca106 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-363bbf57-d127-4cf7-b12f-197fa82f28d8 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:29 devstack sudo[86400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-363bbf57-d127-4cf7-b12f-197fa82f28d8
Feb 27 01:24:29 devstack sudo[86400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:29 devstack sudo[86398]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:29 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d1cc6f84-ce6d-406f-9b04-63cf61ff944b tempest-GroupSnapshotsTest-208290777 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-111252f2-b04c-490d-9331-fddd063df951" returned: 0 in 0.694s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:29 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d1cc6f84-ce6d-406f-9b04-63cf61ff944b tempest-GroupSnapshotsTest-208290777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-111252f2-b04c-490d-9331-fddd063df951,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-111252f2-b04c-490d-9331-fddd063df951.789e46de-d164-4ff2-a694-b0a0d6e52c5a 1G {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:29 devstack sudo[86405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-111252f2-b04c-490d-9331-fddd063df951,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-111252f2-b04c-490d-9331-fddd063df951.789e46de-d164-4ff2-a694-b0a0d6e52c5a 1G
Feb 27 01:24:29 devstack sudo[86405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:29 devstack sudo[86400]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:29 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-d8c33ebb-7768-446c-942f-54f80232558f req-8ad1bc9d-4b57-4ec1-88d6-b67b9ffca106 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-363bbf57-d127-4cf7-b12f-197fa82f28d8" returned: 0 in 0.611s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:29 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-d8c33ebb-7768-446c-942f-54f80232558f req-8ad1bc9d-4b57-4ec1-88d6-b67b9ffca106 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-363bbf57-d127-4cf7-b12f-197fa82f28d8 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:29 devstack sudo[86409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-363bbf57-d127-4cf7-b12f-197fa82f28d8
Feb 27 01:24:29 devstack sudo[86409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:29 devstack sudo[86405]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:29 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d1cc6f84-ce6d-406f-9b04-63cf61ff944b tempest-GroupSnapshotsTest-208290777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-111252f2-b04c-490d-9331-fddd063df951,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-111252f2-b04c-490d-9331-fddd063df951.789e46de-d164-4ff2-a694-b0a0d6e52c5a 1G" returned: 0 in 0.587s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:29 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d1cc6f84-ce6d-406f-9b04-63cf61ff944b tempest-GroupSnapshotsTest-208290777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-111252f2-b04c-490d-9331-fddd063df951 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-111252f2-b04c-490d-9331-fddd063df951.789e46de-d164-4ff2-a694-b0a0d6e52c5a {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:29 devstack sudo[86414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-111252f2-b04c-490d-9331-fddd063df951 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-111252f2-b04c-490d-9331-fddd063df951.789e46de-d164-4ff2-a694-b0a0d6e52c5a
Feb 27 01:24:29 devstack sudo[86414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:30 devstack sudo[86409]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:30 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-d8c33ebb-7768-446c-942f-54f80232558f req-8ad1bc9d-4b57-4ec1-88d6-b67b9ffca106 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-363bbf57-d127-4cf7-b12f-197fa82f28d8" returned: 1 in 0.712s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:30 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-d8c33ebb-7768-446c-942f-54f80232558f req-8ad1bc9d-4b57-4ec1-88d6-b67b9ffca106 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-363bbf57-d127-4cf7-b12f-197fa82f28d8' failed. Not Retrying. {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 27 01:24:30 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-d8c33ebb-7768-446c-942f-54f80232558f req-8ad1bc9d-4b57-4ec1-88d6-b67b9ffca106 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-363bbf57-d127-4cf7-b12f-197fa82f28d8 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:30 devstack sudo[86420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-363bbf57-d127-4cf7-b12f-197fa82f28d8
Feb 27 01:24:30 devstack sudo[86420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:30 devstack sudo[86414]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:30 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d1cc6f84-ce6d-406f-9b04-63cf61ff944b tempest-GroupSnapshotsTest-208290777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-111252f2-b04c-490d-9331-fddd063df951 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-111252f2-b04c-490d-9331-fddd063df951.789e46de-d164-4ff2-a694-b0a0d6e52c5a" returned: 0 in 0.620s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:30 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-d1cc6f84-ce6d-406f-9b04-63cf61ff944b tempest-GroupSnapshotsTest-208290777 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-111252f2-b04c-490d-9331-fddd063df951.789e46de-d164-4ff2-a694-b0a0d6e52c5a is being set with open permissions: ugo+rw: NotImplementedError
Feb 27 01:24:30 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d1cc6f84-ce6d-406f-9b04-63cf61ff944b tempest-GroupSnapshotsTest-208290777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-111252f2-b04c-490d-9331-fddd063df951.789e46de-d164-4ff2-a694-b0a0d6e52c5a {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:30 devstack sudo[86424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-111252f2-b04c-490d-9331-fddd063df951.789e46de-d164-4ff2-a694-b0a0d6e52c5a
Feb 27 01:24:30 devstack sudo[86424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:31 devstack sudo[86420]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:31 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-d8c33ebb-7768-446c-942f-54f80232558f req-8ad1bc9d-4b57-4ec1-88d6-b67b9ffca106 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-363bbf57-d127-4cf7-b12f-197fa82f28d8" returned: 0 in 0.708s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:31 devstack cinder-volume[83106]: DEBUG cinder.coordination [req-d8c33ebb-7768-446c-942f-54f80232558f req-8ad1bc9d-4b57-4ec1-88d6-b67b9ffca106 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Lock "cinder-quobyte-363bbf57-d127-4cf7-b12f-197fa82f28d8" released by "delete_volume" :: held 2.089s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:24:31 devstack sudo[86424]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:31 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d1cc6f84-ce6d-406f-9b04-63cf61ff944b tempest-GroupSnapshotsTest-208290777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-111252f2-b04c-490d-9331-fddd063df951.789e46de-d164-4ff2-a694-b0a0d6e52c5a" returned: 0 in 0.609s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:31 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d1cc6f84-ce6d-406f-9b04-63cf61ff944b tempest-GroupSnapshotsTest-208290777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-111252f2-b04c-490d-9331-fddd063df951.info {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:31 devstack sudo[86429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-111252f2-b04c-490d-9331-fddd063df951.info
Feb 27 01:24:31 devstack sudo[86429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:31 devstack cinder-volume[83106]: DEBUG cinder.quota [req-d8c33ebb-7768-446c-942f-54f80232558f req-8ad1bc9d-4b57-4ec1-88d6-b67b9ffca106 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Created reservations ['b14484d7-da90-4e81-a39f-4b1217d6a37b', 'f6bbe686-517c-4dae-95cc-69a738cd611d', 'eb8a930e-9be2-417f-bbe9-ecfecfa2e160', 'ac4fde44-4dbd-4440-9aa3-8005f11ee043'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:24:31 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [req-d8c33ebb-7768-446c-942f-54f80232558f req-8ad1bc9d-4b57-4ec1-88d6-b67b9ffca106 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:24:31 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [req-d8c33ebb-7768-446c-942f-54f80232558f req-8ad1bc9d-4b57-4ec1-88d6-b67b9ffca106 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:24:31 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [req-d8c33ebb-7768-446c-942f-54f80232558f req-8ad1bc9d-4b57-4ec1-88d6-b67b9ffca106 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:24:31 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [req-d8c33ebb-7768-446c-942f-54f80232558f req-8ad1bc9d-4b57-4ec1-88d6-b67b9ffca106 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:24:31 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [req-d8c33ebb-7768-446c-942f-54f80232558f req-8ad1bc9d-4b57-4ec1-88d6-b67b9ffca106 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:24:31 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-d8c33ebb-7768-446c-942f-54f80232558f req-8ad1bc9d-4b57-4ec1-88d6-b67b9ffca106 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:31 devstack sudo[86431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:24:31 devstack sudo[86431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:31 devstack sudo[86429]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:31 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d1cc6f84-ce6d-406f-9b04-63cf61ff944b tempest-GroupSnapshotsTest-208290777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-111252f2-b04c-490d-9331-fddd063df951.info" returned: 0 in 0.641s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:31 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-d1cc6f84-ce6d-406f-9b04-63cf61ff944b tempest-GroupSnapshotsTest-208290777 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-111252f2-b04c-490d-9331-fddd063df951.info is being set with open permissions: ugo+rw: NotImplementedError
Feb 27 01:24:31 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d1cc6f84-ce6d-406f-9b04-63cf61ff944b tempest-GroupSnapshotsTest-208290777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-111252f2-b04c-490d-9331-fddd063df951.info {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:31 devstack sudo[86434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-111252f2-b04c-490d-9331-fddd063df951.info
Feb 27 01:24:31 devstack sudo[86434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:32 devstack sudo[86431]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:32 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [req-d8c33ebb-7768-446c-942f-54f80232558f req-8ad1bc9d-4b57-4ec1-88d6-b67b9ffca106 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.814s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:32 devstack cinder-volume[83106]: DEBUG cinder.manager [req-d8c33ebb-7768-446c-942f-54f80232558f req-8ad1bc9d-4b57-4ec1-88d6-b67b9ffca106 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:24:32 devstack cinder-volume[83106]: INFO cinder.volume.manager [req-d8c33ebb-7768-446c-942f-54f80232558f req-8ad1bc9d-4b57-4ec1-88d6-b67b9ffca106 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Deleted volume successfully.
Feb 27 01:24:32 devstack cinder-volume[83106]: DEBUG cinder.coordination [req-d8c33ebb-7768-446c-942f-54f80232558f req-8ad1bc9d-4b57-4ec1-88d6-b67b9ffca106 tempest-ServerBootFromVolumeStableRescueTest-1587336755 None] Lock "cinder-363bbf57-d127-4cf7-b12f-197fa82f28d8-delete_volume" released by "delete_volume" :: held 3.265s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:24:32 devstack sudo[86434]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:32 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d1cc6f84-ce6d-406f-9b04-63cf61ff944b tempest-GroupSnapshotsTest-208290777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-111252f2-b04c-490d-9331-fddd063df951.info" returned: 0 in 0.841s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:32 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-d1cc6f84-ce6d-406f-9b04-63cf61ff944b tempest-GroupSnapshotsTest-208290777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.075s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:24:32 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-d1cc6f84-ce6d-406f-9b04-63cf61ff944b tempest-GroupSnapshotsTest-208290777 None] group_snapshot cc0aada5-803c-4eb7-bc43-16db039e7df7: created successfully
Feb 27 01:24:33 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-5160024e-9dc1-40be-b1bc-ba22c3e66aa7 tempest-GroupSnapshotsTest-208290777 None] group_snapshot cc0aada5-803c-4eb7-bc43-16db039e7df7: deleting
Feb 27 01:24:34 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-5160024e-9dc1-40be-b1bc-ba22c3e66aa7 tempest-GroupSnapshotsTest-208290777 None] group_snapshot cc0aada5-803c-4eb7-bc43-16db039e7df7: deleting {{(pid=83106) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Feb 27 01:24:34 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5160024e-9dc1-40be-b1bc-ba22c3e66aa7 tempest-GroupSnapshotsTest-208290777 None] Acquiring lock "cinder-quobyte-111252f2-b04c-490d-9331-fddd063df951" by "delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:24:34 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5160024e-9dc1-40be-b1bc-ba22c3e66aa7 tempest-GroupSnapshotsTest-208290777 None] Lock "cinder-quobyte-111252f2-b04c-490d-9331-fddd063df951" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:24:34 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5160024e-9dc1-40be-b1bc-ba22c3e66aa7 tempest-GroupSnapshotsTest-208290777 None] Acquiring lock "cinder-quobyte-789e46de-d164-4ff2-a694-b0a0d6e52c5a" by "_delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:24:34 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5160024e-9dc1-40be-b1bc-ba22c3e66aa7 tempest-GroupSnapshotsTest-208290777 None] Lock "cinder-quobyte-789e46de-d164-4ff2-a694-b0a0d6e52c5a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:24:34 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-5160024e-9dc1-40be-b1bc-ba22c3e66aa7 tempest-GroupSnapshotsTest-208290777 None] Deleting offline snapshot 789e46de-d164-4ff2-a694-b0a0d6e52c5a of volume 111252f2-b04c-490d-9331-fddd063df951 {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:24:34 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-5160024e-9dc1-40be-b1bc-ba22c3e66aa7 tempest-GroupSnapshotsTest-208290777 None] snapshot_file for this snap is: volume-111252f2-b04c-490d-9331-fddd063df951.789e46de-d164-4ff2-a694-b0a0d6e52c5a {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:24:34 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0524a3b-8606-4051-9e37-e71fa55929be]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:24:34 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5160024e-9dc1-40be-b1bc-ba22c3e66aa7 tempest-GroupSnapshotsTest-208290777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-111252f2-b04c-490d-9331-fddd063df951.789e46de-d164-4ff2-a694-b0a0d6e52c5a {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:34 devstack sudo[86461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-111252f2-b04c-490d-9331-fddd063df951.789e46de-d164-4ff2-a694-b0a0d6e52c5a
Feb 27 01:24:34 devstack sudo[86461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:34 devstack sudo[86461]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:34 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5160024e-9dc1-40be-b1bc-ba22c3e66aa7 tempest-GroupSnapshotsTest-208290777 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-111252f2-b04c-490d-9331-fddd063df951.789e46de-d164-4ff2-a694-b0a0d6e52c5a" returned: 0 in 0.752s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:34 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-5160024e-9dc1-40be-b1bc-ba22c3e66aa7 tempest-GroupSnapshotsTest-208290777 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-111252f2-b04c-490d-9331-fddd063df951(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83106) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:24:34 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85f6408-4304-46aa-8738-35b0c94d32ae]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:24:34 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5160024e-9dc1-40be-b1bc-ba22c3e66aa7 tempest-GroupSnapshotsTest-208290777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-111252f2-b04c-490d-9331-fddd063df951 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:35 devstack sudo[86470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-111252f2-b04c-490d-9331-fddd063df951
Feb 27 01:24:35 devstack sudo[86470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:35 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-07a1118d-bb53-4751-bd34-2eb81d0b27f1 tempest-VolumeTypesAccessTest-1870820626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:24:35 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-07a1118d-bb53-4751-bd34-2eb81d0b27f1 tempest-VolumeTypesAccessTest-1870820626 None] Flow 'volume_create_manager' (1a590afa-e236-4564-a9a3-c98e5af44a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:24:35 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-07a1118d-bb53-4751-bd34-2eb81d0b27f1 tempest-VolumeTypesAccessTest-1870820626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30dcbcb6-17f3-422f-bcca-96d251e2606f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:35 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-07a1118d-bb53-4751-bd34-2eb81d0b27f1 tempest-VolumeTypesAccessTest-1870820626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30dcbcb6-17f3-422f-bcca-96d251e2606f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:24:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1906314106',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41e792a4-a050-4369-988c-116eec6e42d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e5cd983aa0042b4863de7c5180b8caa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:24:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:24:36Z,use_quota=True,user_id='1e8a18cb8745456b86bb97cf85b49a7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e03dfcd-ebf4-4d2d-82bb-191f4de901e3),volume_type_id=5e03dfcd-ebf4-4d2d-82bb-191f4de901e3)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:35 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-07a1118d-bb53-4751-bd34-2eb81d0b27f1 tempest-VolumeTypesAccessTest-1870820626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32c54fba-734f-4b04-a55d-4adb704b3fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:35 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-07a1118d-bb53-4751-bd34-2eb81d0b27f1 tempest-VolumeTypesAccessTest-1870820626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32c54fba-734f-4b04-a55d-4adb704b3fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:35 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-07a1118d-bb53-4751-bd34-2eb81d0b27f1 tempest-VolumeTypesAccessTest-1870820626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7de49d57-1677-4e3a-98e9-4922d15787b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:35 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-07a1118d-bb53-4751-bd34-2eb81d0b27f1 tempest-VolumeTypesAccessTest-1870820626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7de49d57-1677-4e3a-98e9-4922d15787b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41e792a4-a050-4369-988c-116eec6e42d5', 'volume_name': 'volume-41e792a4-a050-4369-988c-116eec6e42d5', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:35 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-07a1118d-bb53-4751-bd34-2eb81d0b27f1 tempest-VolumeTypesAccessTest-1870820626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (444cdc9a-3035-4353-a40e-6453da6b5ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:35 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-07a1118d-bb53-4751-bd34-2eb81d0b27f1 tempest-VolumeTypesAccessTest-1870820626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (444cdc9a-3035-4353-a40e-6453da6b5ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:35 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-07a1118d-bb53-4751-bd34-2eb81d0b27f1 tempest-VolumeTypesAccessTest-1870820626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e209051-ae2d-434b-ba3d-f95867c21a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:35 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-07a1118d-bb53-4751-bd34-2eb81d0b27f1 tempest-VolumeTypesAccessTest-1870820626 None] Volume 41e792a4-a050-4369-988c-116eec6e42d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41e792a4-a050-4369-988c-116eec6e42d5', 'volume_size': 1}
Feb 27 01:24:35 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-07a1118d-bb53-4751-bd34-2eb81d0b27f1 tempest-VolumeTypesAccessTest-1870820626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:24:35 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-07a1118d-bb53-4751-bd34-2eb81d0b27f1 tempest-VolumeTypesAccessTest-1870820626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:24:35 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-07a1118d-bb53-4751-bd34-2eb81d0b27f1 tempest-VolumeTypesAccessTest-1870820626 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:24:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1906314106',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41e792a4-a050-4369-988c-116eec6e42d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e5cd983aa0042b4863de7c5180b8caa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:24:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:24:36Z,use_quota=True,user_id='1e8a18cb8745456b86bb97cf85b49a7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e03dfcd-ebf4-4d2d-82bb-191f4de901e3),volume_type_id=5e03dfcd-ebf4-4d2d-82bb-191f4de901e3)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:24:35 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-07a1118d-bb53-4751-bd34-2eb81d0b27f1 tempest-VolumeTypesAccessTest-1870820626 None] Creating volume 41e792a4-a050-4369-988c-116eec6e42d5 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:24:35 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-07a1118d-bb53-4751-bd34-2eb81d0b27f1 tempest-VolumeTypesAccessTest-1870820626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:24:35 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-07a1118d-bb53-4751-bd34-2eb81d0b27f1 tempest-VolumeTypesAccessTest-1870820626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:24:35 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-07a1118d-bb53-4751-bd34-2eb81d0b27f1 tempest-VolumeTypesAccessTest-1870820626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:24:35 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-07a1118d-bb53-4751-bd34-2eb81d0b27f1 tempest-VolumeTypesAccessTest-1870820626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:24:35 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-07a1118d-bb53-4751-bd34-2eb81d0b27f1 tempest-VolumeTypesAccessTest-1870820626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:24:35 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-07a1118d-bb53-4751-bd34-2eb81d0b27f1 tempest-VolumeTypesAccessTest-1870820626 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:24:35 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-07a1118d-bb53-4751-bd34-2eb81d0b27f1 tempest-VolumeTypesAccessTest-1870820626 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:24:35 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-07a1118d-bb53-4751-bd34-2eb81d0b27f1 tempest-VolumeTypesAccessTest-1870820626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-41e792a4-a050-4369-988c-116eec6e42d5 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:35 devstack sudo[86478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-41e792a4-a050-4369-988c-116eec6e42d5 1073741824
Feb 27 01:24:35 devstack sudo[86478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:35 devstack sudo[86470]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:35 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5160024e-9dc1-40be-b1bc-ba22c3e66aa7 tempest-GroupSnapshotsTest-208290777 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-111252f2-b04c-490d-9331-fddd063df951" returned: 0 in 0.841s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:35 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5160024e-9dc1-40be-b1bc-ba22c3e66aa7 tempest-GroupSnapshotsTest-208290777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-111252f2-b04c-490d-9331-fddd063df951.789e46de-d164-4ff2-a694-b0a0d6e52c5a {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:35 devstack sudo[86480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-111252f2-b04c-490d-9331-fddd063df951.789e46de-d164-4ff2-a694-b0a0d6e52c5a
Feb 27 01:24:35 devstack sudo[86480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:36 devstack sudo[86480]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:36 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5160024e-9dc1-40be-b1bc-ba22c3e66aa7 tempest-GroupSnapshotsTest-208290777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-111252f2-b04c-490d-9331-fddd063df951.789e46de-d164-4ff2-a694-b0a0d6e52c5a" returned: 0 in 0.619s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:36 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5160024e-9dc1-40be-b1bc-ba22c3e66aa7 tempest-GroupSnapshotsTest-208290777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-111252f2-b04c-490d-9331-fddd063df951.789e46de-d164-4ff2-a694-b0a0d6e52c5a {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:36 devstack sudo[86478]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:36 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-07a1118d-bb53-4751-bd34-2eb81d0b27f1 tempest-VolumeTypesAccessTest-1870820626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-41e792a4-a050-4369-988c-116eec6e42d5 1073741824" returned: 0 in 0.686s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:36 devstack sudo[86488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-111252f2-b04c-490d-9331-fddd063df951.789e46de-d164-4ff2-a694-b0a0d6e52c5a
Feb 27 01:24:36 devstack sudo[86488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:36 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-07a1118d-bb53-4751-bd34-2eb81d0b27f1 tempest-VolumeTypesAccessTest-1870820626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-41e792a4-a050-4369-988c-116eec6e42d5 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:36 devstack sudo[86490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-41e792a4-a050-4369-988c-116eec6e42d5
Feb 27 01:24:36 devstack sudo[86490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:36 devstack sudo[86490]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:36 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-07a1118d-bb53-4751-bd34-2eb81d0b27f1 tempest-VolumeTypesAccessTest-1870820626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-41e792a4-a050-4369-988c-116eec6e42d5" returned: 0 in 0.483s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:36 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-07a1118d-bb53-4751-bd34-2eb81d0b27f1 tempest-VolumeTypesAccessTest-1870820626 None] <== create_volume: return (1206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:24:36 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-07a1118d-bb53-4751-bd34-2eb81d0b27f1 tempest-VolumeTypesAccessTest-1870820626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.210s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:24:36 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-07a1118d-bb53-4751-bd34-2eb81d0b27f1 tempest-VolumeTypesAccessTest-1870820626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e209051-ae2d-434b-ba3d-f95867c21a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41e792a4-a050-4369-988c-116eec6e42d5', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:36 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-07a1118d-bb53-4751-bd34-2eb81d0b27f1 tempest-VolumeTypesAccessTest-1870820626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e69addd-578e-4e7f-a69d-fd42acf3c55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:36 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-07a1118d-bb53-4751-bd34-2eb81d0b27f1 tempest-VolumeTypesAccessTest-1870820626 None] Volume volume-41e792a4-a050-4369-988c-116eec6e42d5 (41e792a4-a050-4369-988c-116eec6e42d5): created successfully
Feb 27 01:24:36 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-07a1118d-bb53-4751-bd34-2eb81d0b27f1 tempest-VolumeTypesAccessTest-1870820626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e69addd-578e-4e7f-a69d-fd42acf3c55d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:36 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-07a1118d-bb53-4751-bd34-2eb81d0b27f1 tempest-VolumeTypesAccessTest-1870820626 None] Flow 'volume_create_manager' (1a590afa-e236-4564-a9a3-c98e5af44a91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:24:36 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-07a1118d-bb53-4751-bd34-2eb81d0b27f1 tempest-VolumeTypesAccessTest-1870820626 None] Created volume successfully.
Feb 27 01:24:36 devstack sudo[86488]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:36 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5160024e-9dc1-40be-b1bc-ba22c3e66aa7 tempest-GroupSnapshotsTest-208290777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-111252f2-b04c-490d-9331-fddd063df951.789e46de-d164-4ff2-a694-b0a0d6e52c5a" returned: 0 in 0.619s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:37 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5160024e-9dc1-40be-b1bc-ba22c3e66aa7 tempest-GroupSnapshotsTest-208290777 None] Lock "cinder-quobyte-789e46de-d164-4ff2-a694-b0a0d6e52c5a" released by "_delete_snapshot" :: held 2.935s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:24:37 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5160024e-9dc1-40be-b1bc-ba22c3e66aa7 tempest-GroupSnapshotsTest-208290777 None] Lock "cinder-quobyte-111252f2-b04c-490d-9331-fddd063df951" released by "delete_snapshot" :: held 2.955s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:24:37 devstack cinder-volume[83106]: WARNING cinder.quota [None req-5160024e-9dc1-40be-b1bc-ba22c3e66aa7 tempest-GroupSnapshotsTest-208290777 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1235523824 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1235523824, it is now deprecated. Please use the default quota class for default quota.
Feb 27 01:24:37 devstack cinder-volume[83106]: WARNING cinder.quota [None req-5160024e-9dc1-40be-b1bc-ba22c3e66aa7 tempest-GroupSnapshotsTest-208290777 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1235523824 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1235523824, it is now deprecated. Please use the default quota class for default quota.
Feb 27 01:24:37 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-5160024e-9dc1-40be-b1bc-ba22c3e66aa7 tempest-GroupSnapshotsTest-208290777 None] Created reservations ['71168233-de57-45dd-9507-1f48aee7b241', '9c58019a-7d25-4c80-b24f-0023b5c13867', 'a1f81044-91ee-4445-b78c-57091347f0c8', '77463581-e8cd-42c5-ab48-b2f754caebac'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:24:37 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-5160024e-9dc1-40be-b1bc-ba22c3e66aa7 tempest-GroupSnapshotsTest-208290777 None] group_snapshot cc0aada5-803c-4eb7-bc43-16db039e7df7: deleted successfully
Feb 27 01:24:37 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a4436e9-3581-481c-833e-af988b82fe7c tempest-VolumesTestJSON-817047389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:24:37 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-0a4436e9-3581-481c-833e-af988b82fe7c tempest-VolumesTestJSON-817047389 None] Flow 'volume_create_manager' (9e6dee91-3d69-47d1-af50-6229906e4ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:24:37 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-0a4436e9-3581-481c-833e-af988b82fe7c tempest-VolumesTestJSON-817047389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1919b01-d983-4d6d-a570-3b5dd967053e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:37 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-0a4436e9-3581-481c-833e-af988b82fe7c tempest-VolumesTestJSON-817047389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1919b01-d983-4d6d-a570-3b5dd967053e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-336526660',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14449f5b-b09d-4338-b7d7-6416fefa94a4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fee350ba9bb74876951dd1e6e8eb6978',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:24:37Z,use_quota=True,user_id='ece8271b32394f2aae758697237c09c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:37 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-0a4436e9-3581-481c-833e-af988b82fe7c tempest-VolumesTestJSON-817047389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f39495b9-e594-4c0b-8f95-89123dc0e71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:37 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-0a4436e9-3581-481c-833e-af988b82fe7c tempest-VolumesTestJSON-817047389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f39495b9-e594-4c0b-8f95-89123dc0e71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:37 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-0a4436e9-3581-481c-833e-af988b82fe7c tempest-VolumesTestJSON-817047389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (426c80ab-2f3a-4fac-b6ca-7ea1ed0fa355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:37 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-0a4436e9-3581-481c-833e-af988b82fe7c tempest-VolumesTestJSON-817047389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (426c80ab-2f3a-4fac-b6ca-7ea1ed0fa355) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14449f5b-b09d-4338-b7d7-6416fefa94a4', 'volume_name': 'volume-14449f5b-b09d-4338-b7d7-6416fefa94a4', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:37 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-0a4436e9-3581-481c-833e-af988b82fe7c tempest-VolumesTestJSON-817047389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b9e2986-ce5f-4979-bc15-148144745cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:37 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-0a4436e9-3581-481c-833e-af988b82fe7c tempest-VolumesTestJSON-817047389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b9e2986-ce5f-4979-bc15-148144745cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:37 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-0a4436e9-3581-481c-833e-af988b82fe7c tempest-VolumesTestJSON-817047389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6de0af45-788e-403e-afba-01070dc2f1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:37 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-0a4436e9-3581-481c-833e-af988b82fe7c tempest-VolumesTestJSON-817047389 None] Volume 14449f5b-b09d-4338-b7d7-6416fefa94a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14449f5b-b09d-4338-b7d7-6416fefa94a4', 'volume_size': 1}
Feb 27 01:24:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-0a4436e9-3581-481c-833e-af988b82fe7c tempest-VolumesTestJSON-817047389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:24:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-0a4436e9-3581-481c-833e-af988b82fe7c tempest-VolumesTestJSON-817047389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:24:37 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-0a4436e9-3581-481c-833e-af988b82fe7c tempest-VolumesTestJSON-817047389 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-336526660',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14449f5b-b09d-4338-b7d7-6416fefa94a4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fee350ba9bb74876951dd1e6e8eb6978',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:24:37Z,use_quota=True,user_id='ece8271b32394f2aae758697237c09c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:24:37 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-0a4436e9-3581-481c-833e-af988b82fe7c tempest-VolumesTestJSON-817047389 None] Creating volume 14449f5b-b09d-4338-b7d7-6416fefa94a4 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:24:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-0a4436e9-3581-481c-833e-af988b82fe7c tempest-VolumesTestJSON-817047389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:24:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-0a4436e9-3581-481c-833e-af988b82fe7c tempest-VolumesTestJSON-817047389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:24:37 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-0a4436e9-3581-481c-833e-af988b82fe7c tempest-VolumesTestJSON-817047389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:24:37 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-0a4436e9-3581-481c-833e-af988b82fe7c tempest-VolumesTestJSON-817047389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:24:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-0a4436e9-3581-481c-833e-af988b82fe7c tempest-VolumesTestJSON-817047389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:24:37 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-0a4436e9-3581-481c-833e-af988b82fe7c tempest-VolumesTestJSON-817047389 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:24:37 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-0a4436e9-3581-481c-833e-af988b82fe7c tempest-VolumesTestJSON-817047389 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:24:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0a4436e9-3581-481c-833e-af988b82fe7c tempest-VolumesTestJSON-817047389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-14449f5b-b09d-4338-b7d7-6416fefa94a4 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:37 devstack sudo[86494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-14449f5b-b09d-4338-b7d7-6416fefa94a4 1073741824
Feb 27 01:24:37 devstack sudo[86494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:37 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-e605b1d9-fce3-4c2b-b42b-2d500c3d95b9 tempest-GroupSnapshotsTest-208290777 None] Acquiring lock "cinder-quobyte-111252f2-b04c-490d-9331-fddd063df951" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:24:37 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-e605b1d9-fce3-4c2b-b42b-2d500c3d95b9 tempest-GroupSnapshotsTest-208290777 None] Lock "cinder-quobyte-111252f2-b04c-490d-9331-fddd063df951" acquired by "delete_volume" :: waited 0.009s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:24:37 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d30d15-489d-468c-8f9c-4a5bde1501e3]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:24:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-e605b1d9-fce3-4c2b-b42b-2d500c3d95b9 tempest-GroupSnapshotsTest-208290777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-111252f2-b04c-490d-9331-fddd063df951 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:37 devstack sudo[86496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-111252f2-b04c-490d-9331-fddd063df951
Feb 27 01:24:37 devstack sudo[86496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:37 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-17dd2f41-c6cc-4897-b13c-f23857bb6ea8 tempest-VolumeTypesAccessTest-1870820626 None] Acquiring lock "cinder-41e792a4-a050-4369-988c-116eec6e42d5-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:24:37 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-17dd2f41-c6cc-4897-b13c-f23857bb6ea8 tempest-VolumeTypesAccessTest-1870820626 None] Lock "cinder-41e792a4-a050-4369-988c-116eec6e42d5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:24:37 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-17dd2f41-c6cc-4897-b13c-f23857bb6ea8 tempest-VolumeTypesAccessTest-1870820626 None] Acquiring lock "cinder-quobyte-41e792a4-a050-4369-988c-116eec6e42d5" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:24:37 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-17dd2f41-c6cc-4897-b13c-f23857bb6ea8 tempest-VolumeTypesAccessTest-1870820626 None] Lock "cinder-quobyte-41e792a4-a050-4369-988c-116eec6e42d5" acquired by "delete_volume" :: waited 0.012s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:24:37 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[8260c861-60f5-4105-9374-3322b7921f29]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:24:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-17dd2f41-c6cc-4897-b13c-f23857bb6ea8 tempest-VolumeTypesAccessTest-1870820626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-41e792a4-a050-4369-988c-116eec6e42d5 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:37 devstack sudo[86494]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0a4436e9-3581-481c-833e-af988b82fe7c tempest-VolumesTestJSON-817047389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-14449f5b-b09d-4338-b7d7-6416fefa94a4 1073741824" returned: 0 in 0.627s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0a4436e9-3581-481c-833e-af988b82fe7c tempest-VolumesTestJSON-817047389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-14449f5b-b09d-4338-b7d7-6416fefa94a4 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:37 devstack sudo[86502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-14449f5b-b09d-4338-b7d7-6416fefa94a4
Feb 27 01:24:37 devstack sudo[86502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:38 devstack sudo[86501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-41e792a4-a050-4369-988c-116eec6e42d5
Feb 27 01:24:38 devstack sudo[86501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:38 devstack sudo[86496]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:38 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-e605b1d9-fce3-4c2b-b42b-2d500c3d95b9 tempest-GroupSnapshotsTest-208290777 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-111252f2-b04c-490d-9331-fddd063df951" returned: 0 in 0.575s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:38 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-e605b1d9-fce3-4c2b-b42b-2d500c3d95b9 tempest-GroupSnapshotsTest-208290777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-111252f2-b04c-490d-9331-fddd063df951 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:38 devstack sudo[86508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-111252f2-b04c-490d-9331-fddd063df951
Feb 27 01:24:38 devstack sudo[86508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:38 devstack sudo[86502]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:38 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0a4436e9-3581-481c-833e-af988b82fe7c tempest-VolumesTestJSON-817047389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-14449f5b-b09d-4338-b7d7-6416fefa94a4" returned: 0 in 0.479s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:38 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-0a4436e9-3581-481c-833e-af988b82fe7c tempest-VolumesTestJSON-817047389 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:24:38 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-0a4436e9-3581-481c-833e-af988b82fe7c tempest-VolumesTestJSON-817047389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:24:38 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-0a4436e9-3581-481c-833e-af988b82fe7c tempest-VolumesTestJSON-817047389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6de0af45-788e-403e-afba-01070dc2f1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14449f5b-b09d-4338-b7d7-6416fefa94a4', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:38 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-0a4436e9-3581-481c-833e-af988b82fe7c tempest-VolumesTestJSON-817047389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51b54d46-2569-4db1-aee7-709a3b3ed7a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:38 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-0a4436e9-3581-481c-833e-af988b82fe7c tempest-VolumesTestJSON-817047389 None] Volume volume-14449f5b-b09d-4338-b7d7-6416fefa94a4 (14449f5b-b09d-4338-b7d7-6416fefa94a4): created successfully
Feb 27 01:24:38 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-0a4436e9-3581-481c-833e-af988b82fe7c tempest-VolumesTestJSON-817047389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51b54d46-2569-4db1-aee7-709a3b3ed7a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:38 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-0a4436e9-3581-481c-833e-af988b82fe7c tempest-VolumesTestJSON-817047389 None] Flow 'volume_create_manager' (9e6dee91-3d69-47d1-af50-6229906e4ebf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:24:38 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-0a4436e9-3581-481c-833e-af988b82fe7c tempest-VolumesTestJSON-817047389 None] Created volume successfully.
Feb 27 01:24:38 devstack sudo[86501]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:38 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-17dd2f41-c6cc-4897-b13c-f23857bb6ea8 tempest-VolumeTypesAccessTest-1870820626 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-41e792a4-a050-4369-988c-116eec6e42d5" returned: 0 in 0.665s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:38 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-17dd2f41-c6cc-4897-b13c-f23857bb6ea8 tempest-VolumeTypesAccessTest-1870820626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-41e792a4-a050-4369-988c-116eec6e42d5 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:38 devstack sudo[86515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-41e792a4-a050-4369-988c-116eec6e42d5
Feb 27 01:24:38 devstack sudo[86515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:38 devstack sudo[86508]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:38 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-e605b1d9-fce3-4c2b-b42b-2d500c3d95b9 tempest-GroupSnapshotsTest-208290777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-111252f2-b04c-490d-9331-fddd063df951" returned: 0 in 0.558s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:38 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-e605b1d9-fce3-4c2b-b42b-2d500c3d95b9 tempest-GroupSnapshotsTest-208290777 None] Lock "cinder-quobyte-111252f2-b04c-490d-9331-fddd063df951" released by "delete_volume" :: held 1.169s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:24:38 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-e605b1d9-fce3-4c2b-b42b-2d500c3d95b9 tempest-GroupSnapshotsTest-208290777 None] Created reservations ['db483572-f1e6-4ed8-a741-cfd86920d4ae'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:24:38 devstack cinder-volume[83106]: WARNING cinder.quota [None req-e605b1d9-fce3-4c2b-b42b-2d500c3d95b9 tempest-GroupSnapshotsTest-208290777 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1235523824 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1235523824, it is now deprecated. Please use the default quota class for default quota.
Feb 27 01:24:38 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-e605b1d9-fce3-4c2b-b42b-2d500c3d95b9 tempest-GroupSnapshotsTest-208290777 None] Created reservations ['da7d58fb-1cef-41e6-932d-748d10b08d14', 'cf20090c-ba66-44b1-aac1-c936a340ffed', 'b60de9b8-6982-48a0-becf-d1327e0e6e62', '37b40139-0646-409a-8a2a-dfb5818bf9a2'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:24:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-e605b1d9-fce3-4c2b-b42b-2d500c3d95b9 tempest-GroupSnapshotsTest-208290777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:24:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-e605b1d9-fce3-4c2b-b42b-2d500c3d95b9 tempest-GroupSnapshotsTest-208290777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:24:39 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-e605b1d9-fce3-4c2b-b42b-2d500c3d95b9 tempest-GroupSnapshotsTest-208290777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:24:39 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-e605b1d9-fce3-4c2b-b42b-2d500c3d95b9 tempest-GroupSnapshotsTest-208290777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:24:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-e605b1d9-fce3-4c2b-b42b-2d500c3d95b9 tempest-GroupSnapshotsTest-208290777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:24:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-e605b1d9-fce3-4c2b-b42b-2d500c3d95b9 tempest-GroupSnapshotsTest-208290777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:39 devstack sudo[86517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:24:39 devstack sudo[86517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:39 devstack sudo[86515]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-17dd2f41-c6cc-4897-b13c-f23857bb6ea8 tempest-VolumeTypesAccessTest-1870820626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-41e792a4-a050-4369-988c-116eec6e42d5" returned: 0 in 0.632s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:39 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-17dd2f41-c6cc-4897-b13c-f23857bb6ea8 tempest-VolumeTypesAccessTest-1870820626 None] Lock "cinder-quobyte-41e792a4-a050-4369-988c-116eec6e42d5" released by "delete_volume" :: held 1.330s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:24:39 devstack cinder-volume[83106]: WARNING cinder.quota [None req-17dd2f41-c6cc-4897-b13c-f23857bb6ea8 tempest-VolumeTypesAccessTest-1870820626 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-238373263 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-238373263, it is now deprecated. Please use the default quota class for default quota.
Feb 27 01:24:39 devstack cinder-volume[83106]: WARNING cinder.quota [None req-17dd2f41-c6cc-4897-b13c-f23857bb6ea8 tempest-VolumeTypesAccessTest-1870820626 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-238373263 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-238373263, it is now deprecated. Please use the default quota class for default quota.
Feb 27 01:24:39 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-17dd2f41-c6cc-4897-b13c-f23857bb6ea8 tempest-VolumeTypesAccessTest-1870820626 None] Created reservations ['ef32809f-65d6-431f-85f3-cb09bebd4694', '394eeb6b-fac9-437b-a29b-abc9b2872ef0', '77244d25-668c-4613-b02b-4e19b0187fd4', 'dee649fa-9e59-4862-bf5d-00ce001b48bc'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:24:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-17dd2f41-c6cc-4897-b13c-f23857bb6ea8 tempest-VolumeTypesAccessTest-1870820626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:24:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-17dd2f41-c6cc-4897-b13c-f23857bb6ea8 tempest-VolumeTypesAccessTest-1870820626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:24:39 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-17dd2f41-c6cc-4897-b13c-f23857bb6ea8 tempest-VolumeTypesAccessTest-1870820626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:24:39 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-17dd2f41-c6cc-4897-b13c-f23857bb6ea8 tempest-VolumeTypesAccessTest-1870820626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:24:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-17dd2f41-c6cc-4897-b13c-f23857bb6ea8 tempest-VolumeTypesAccessTest-1870820626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:24:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-17dd2f41-c6cc-4897-b13c-f23857bb6ea8 tempest-VolumeTypesAccessTest-1870820626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:39 devstack sudo[86520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:24:39 devstack sudo[86520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:39 devstack sudo[86517]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-e605b1d9-fce3-4c2b-b42b-2d500c3d95b9 tempest-GroupSnapshotsTest-208290777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.497s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:39 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-e605b1d9-fce3-4c2b-b42b-2d500c3d95b9 tempest-GroupSnapshotsTest-208290777 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:24:39 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-e605b1d9-fce3-4c2b-b42b-2d500c3d95b9 tempest-GroupSnapshotsTest-208290777 None] Delete group completed successfully.
Feb 27 01:24:39 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b158bc4-735c-4581-a83e-d839874a612b tempest-VolumesTestJSON-817047389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:24:39 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1b158bc4-735c-4581-a83e-d839874a612b tempest-VolumesTestJSON-817047389 None] Flow 'volume_create_manager' (456e973e-3b0a-4d3c-a7b7-bdebcec7b741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:24:39 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1b158bc4-735c-4581-a83e-d839874a612b tempest-VolumesTestJSON-817047389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3298ba60-128d-4dc2-8a2c-5fdd779dcb62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:39 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1b158bc4-735c-4581-a83e-d839874a612b tempest-VolumesTestJSON-817047389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3298ba60-128d-4dc2-8a2c-5fdd779dcb62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:24:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-145922712',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bccabbf-cf58-4877-b3e3-0c2bb609727a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fee350ba9bb74876951dd1e6e8eb6978',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:24:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:24:40Z,use_quota=True,user_id='ece8271b32394f2aae758697237c09c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:39 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1b158bc4-735c-4581-a83e-d839874a612b tempest-VolumesTestJSON-817047389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bca7712-4d25-464f-b571-706368da2fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:39 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1b158bc4-735c-4581-a83e-d839874a612b tempest-VolumesTestJSON-817047389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bca7712-4d25-464f-b571-706368da2fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:39 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1b158bc4-735c-4581-a83e-d839874a612b tempest-VolumesTestJSON-817047389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e814e166-7745-437c-95bf-91a1006250e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:39 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1b158bc4-735c-4581-a83e-d839874a612b tempest-VolumesTestJSON-817047389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e814e166-7745-437c-95bf-91a1006250e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bccabbf-cf58-4877-b3e3-0c2bb609727a', 'volume_name': 'volume-8bccabbf-cf58-4877-b3e3-0c2bb609727a', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:39 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1b158bc4-735c-4581-a83e-d839874a612b tempest-VolumesTestJSON-817047389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4bfb56d-71b9-4fe3-bc8e-666a8ff1ad60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:39 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1b158bc4-735c-4581-a83e-d839874a612b tempest-VolumesTestJSON-817047389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4bfb56d-71b9-4fe3-bc8e-666a8ff1ad60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:39 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1b158bc4-735c-4581-a83e-d839874a612b tempest-VolumesTestJSON-817047389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (897e9a08-3b44-49db-966f-0c84171bc104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:39 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-1b158bc4-735c-4581-a83e-d839874a612b tempest-VolumesTestJSON-817047389 None] Volume 8bccabbf-cf58-4877-b3e3-0c2bb609727a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bccabbf-cf58-4877-b3e3-0c2bb609727a', 'volume_size': 1}
Feb 27 01:24:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-1b158bc4-735c-4581-a83e-d839874a612b tempest-VolumesTestJSON-817047389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:24:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-1b158bc4-735c-4581-a83e-d839874a612b tempest-VolumesTestJSON-817047389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:24:39 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-1b158bc4-735c-4581-a83e-d839874a612b tempest-VolumesTestJSON-817047389 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:24:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-145922712',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bccabbf-cf58-4877-b3e3-0c2bb609727a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fee350ba9bb74876951dd1e6e8eb6978',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:24:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:24:40Z,use_quota=True,user_id='ece8271b32394f2aae758697237c09c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:24:39 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-1b158bc4-735c-4581-a83e-d839874a612b tempest-VolumesTestJSON-817047389 None] Creating volume 8bccabbf-cf58-4877-b3e3-0c2bb609727a {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:24:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-1b158bc4-735c-4581-a83e-d839874a612b tempest-VolumesTestJSON-817047389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:24:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-1b158bc4-735c-4581-a83e-d839874a612b tempest-VolumesTestJSON-817047389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:24:39 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-1b158bc4-735c-4581-a83e-d839874a612b tempest-VolumesTestJSON-817047389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:24:39 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-1b158bc4-735c-4581-a83e-d839874a612b tempest-VolumesTestJSON-817047389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:24:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-1b158bc4-735c-4581-a83e-d839874a612b tempest-VolumesTestJSON-817047389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:24:39 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-1b158bc4-735c-4581-a83e-d839874a612b tempest-VolumesTestJSON-817047389 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:24:39 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-1b158bc4-735c-4581-a83e-d839874a612b tempest-VolumesTestJSON-817047389 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:24:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-1b158bc4-735c-4581-a83e-d839874a612b tempest-VolumesTestJSON-817047389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8bccabbf-cf58-4877-b3e3-0c2bb609727a 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:39 devstack sudo[86520]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:39 devstack sudo[86524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8bccabbf-cf58-4877-b3e3-0c2bb609727a 1073741824
Feb 27 01:24:39 devstack sudo[86524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-17dd2f41-c6cc-4897-b13c-f23857bb6ea8 tempest-VolumeTypesAccessTest-1870820626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.526s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:39 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-17dd2f41-c6cc-4897-b13c-f23857bb6ea8 tempest-VolumeTypesAccessTest-1870820626 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:24:39 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-17dd2f41-c6cc-4897-b13c-f23857bb6ea8 tempest-VolumeTypesAccessTest-1870820626 None] Deleted volume successfully.
Feb 27 01:24:39 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-17dd2f41-c6cc-4897-b13c-f23857bb6ea8 tempest-VolumeTypesAccessTest-1870820626 None] Lock "cinder-41e792a4-a050-4369-988c-116eec6e42d5-delete_volume" released by "delete_volume" :: held 2.025s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:24:40 devstack sudo[86524]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:40 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-1b158bc4-735c-4581-a83e-d839874a612b tempest-VolumesTestJSON-817047389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8bccabbf-cf58-4877-b3e3-0c2bb609727a 1073741824" returned: 0 in 0.751s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:40 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-1b158bc4-735c-4581-a83e-d839874a612b tempest-VolumesTestJSON-817047389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8bccabbf-cf58-4877-b3e3-0c2bb609727a {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:40 devstack sudo[86553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8bccabbf-cf58-4877-b3e3-0c2bb609727a
Feb 27 01:24:40 devstack sudo[86553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:41 devstack sudo[86553]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:41 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-1b158bc4-735c-4581-a83e-d839874a612b tempest-VolumesTestJSON-817047389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8bccabbf-cf58-4877-b3e3-0c2bb609727a" returned: 0 in 0.689s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:41 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-1b158bc4-735c-4581-a83e-d839874a612b tempest-VolumesTestJSON-817047389 None] <== create_volume: return (1485ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:24:41 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-1b158bc4-735c-4581-a83e-d839874a612b tempest-VolumesTestJSON-817047389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.488s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:24:41 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1b158bc4-735c-4581-a83e-d839874a612b tempest-VolumesTestJSON-817047389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (897e9a08-3b44-49db-966f-0c84171bc104) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bccabbf-cf58-4877-b3e3-0c2bb609727a', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:41 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1b158bc4-735c-4581-a83e-d839874a612b tempest-VolumesTestJSON-817047389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e89a446f-325a-4dad-af69-7b6be28bb7a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:41 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-1b158bc4-735c-4581-a83e-d839874a612b tempest-VolumesTestJSON-817047389 None] Volume volume-8bccabbf-cf58-4877-b3e3-0c2bb609727a (8bccabbf-cf58-4877-b3e3-0c2bb609727a): created successfully
Feb 27 01:24:41 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1b158bc4-735c-4581-a83e-d839874a612b tempest-VolumesTestJSON-817047389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e89a446f-325a-4dad-af69-7b6be28bb7a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:41 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1b158bc4-735c-4581-a83e-d839874a612b tempest-VolumesTestJSON-817047389 None] Flow 'volume_create_manager' (456e973e-3b0a-4d3c-a7b7-bdebcec7b741) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:24:41 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-1b158bc4-735c-4581-a83e-d839874a612b tempest-VolumesTestJSON-817047389 None] Created volume successfully.
Feb 27 01:24:42 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bee56da-3e65-4edc-a47b-ec8964f283e9 tempest-VolumesTestJSON-817047389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:24:42 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-4bee56da-3e65-4edc-a47b-ec8964f283e9 tempest-VolumesTestJSON-817047389 None] Flow 'volume_create_manager' (53435e22-411f-4e64-95c9-e5383253454a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:24:42 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-4bee56da-3e65-4edc-a47b-ec8964f283e9 tempest-VolumesTestJSON-817047389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06ca4991-0e12-4168-85e0-38e18648d93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:42 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-4bee56da-3e65-4edc-a47b-ec8964f283e9 tempest-VolumesTestJSON-817047389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06ca4991-0e12-4168-85e0-38e18648d93e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:24:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-784609554',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=382caf35-c088-4a5b-9c87-99590833b6d9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fee350ba9bb74876951dd1e6e8eb6978',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:24:42Z,use_quota=True,user_id='ece8271b32394f2aae758697237c09c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:42 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-4bee56da-3e65-4edc-a47b-ec8964f283e9 tempest-VolumesTestJSON-817047389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (724b5a79-6555-4bb9-ba00-463b2f8059fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:42 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-4bee56da-3e65-4edc-a47b-ec8964f283e9 tempest-VolumesTestJSON-817047389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (724b5a79-6555-4bb9-ba00-463b2f8059fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:42 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-4bee56da-3e65-4edc-a47b-ec8964f283e9 tempest-VolumesTestJSON-817047389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e083517e-d93e-48bd-b70f-32a742215e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:42 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-4bee56da-3e65-4edc-a47b-ec8964f283e9 tempest-VolumesTestJSON-817047389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e083517e-d93e-48bd-b70f-32a742215e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '382caf35-c088-4a5b-9c87-99590833b6d9', 'volume_name': 'volume-382caf35-c088-4a5b-9c87-99590833b6d9', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:42 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-4bee56da-3e65-4edc-a47b-ec8964f283e9 tempest-VolumesTestJSON-817047389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (136fdc9c-449c-4bb7-9eb7-844208bb4c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:42 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-4bee56da-3e65-4edc-a47b-ec8964f283e9 tempest-VolumesTestJSON-817047389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (136fdc9c-449c-4bb7-9eb7-844208bb4c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:42 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-4bee56da-3e65-4edc-a47b-ec8964f283e9 tempest-VolumesTestJSON-817047389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27b69ca4-913b-4177-b141-6e44891b4dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:42 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-4bee56da-3e65-4edc-a47b-ec8964f283e9 tempest-VolumesTestJSON-817047389 None] Volume 382caf35-c088-4a5b-9c87-99590833b6d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-382caf35-c088-4a5b-9c87-99590833b6d9', 'volume_size': 1}
Feb 27 01:24:42 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-4bee56da-3e65-4edc-a47b-ec8964f283e9 tempest-VolumesTestJSON-817047389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:24:42 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-4bee56da-3e65-4edc-a47b-ec8964f283e9 tempest-VolumesTestJSON-817047389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:24:42 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-4bee56da-3e65-4edc-a47b-ec8964f283e9 tempest-VolumesTestJSON-817047389 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:24:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-784609554',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=382caf35-c088-4a5b-9c87-99590833b6d9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fee350ba9bb74876951dd1e6e8eb6978',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:24:42Z,use_quota=True,user_id='ece8271b32394f2aae758697237c09c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:24:42 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-4bee56da-3e65-4edc-a47b-ec8964f283e9 tempest-VolumesTestJSON-817047389 None] Creating volume 382caf35-c088-4a5b-9c87-99590833b6d9 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:24:42 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-4bee56da-3e65-4edc-a47b-ec8964f283e9 tempest-VolumesTestJSON-817047389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:24:42 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-4bee56da-3e65-4edc-a47b-ec8964f283e9 tempest-VolumesTestJSON-817047389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:24:42 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-4bee56da-3e65-4edc-a47b-ec8964f283e9 tempest-VolumesTestJSON-817047389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:24:42 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-4bee56da-3e65-4edc-a47b-ec8964f283e9 tempest-VolumesTestJSON-817047389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:24:42 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-4bee56da-3e65-4edc-a47b-ec8964f283e9 tempest-VolumesTestJSON-817047389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:24:42 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-4bee56da-3e65-4edc-a47b-ec8964f283e9 tempest-VolumesTestJSON-817047389 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:24:42 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-4bee56da-3e65-4edc-a47b-ec8964f283e9 tempest-VolumesTestJSON-817047389 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:24:42 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-4bee56da-3e65-4edc-a47b-ec8964f283e9 tempest-VolumesTestJSON-817047389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-382caf35-c088-4a5b-9c87-99590833b6d9 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:42 devstack sudo[86560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-382caf35-c088-4a5b-9c87-99590833b6d9 1073741824
Feb 27 01:24:42 devstack sudo[86560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:43 devstack sudo[86560]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:43 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-4bee56da-3e65-4edc-a47b-ec8964f283e9 tempest-VolumesTestJSON-817047389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-382caf35-c088-4a5b-9c87-99590833b6d9 1073741824" returned: 0 in 0.677s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:43 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-4bee56da-3e65-4edc-a47b-ec8964f283e9 tempest-VolumesTestJSON-817047389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-382caf35-c088-4a5b-9c87-99590833b6d9 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:43 devstack sudo[86569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-382caf35-c088-4a5b-9c87-99590833b6d9
Feb 27 01:24:43 devstack sudo[86569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:43 devstack sudo[86569]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:43 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-4bee56da-3e65-4edc-a47b-ec8964f283e9 tempest-VolumesTestJSON-817047389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-382caf35-c088-4a5b-9c87-99590833b6d9" returned: 0 in 0.549s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:43 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-4bee56da-3e65-4edc-a47b-ec8964f283e9 tempest-VolumesTestJSON-817047389 None] <== create_volume: return (1266ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:24:43 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-4bee56da-3e65-4edc-a47b-ec8964f283e9 tempest-VolumesTestJSON-817047389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.268s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:24:43 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-4bee56da-3e65-4edc-a47b-ec8964f283e9 tempest-VolumesTestJSON-817047389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27b69ca4-913b-4177-b141-6e44891b4dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-382caf35-c088-4a5b-9c87-99590833b6d9', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:43 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-4bee56da-3e65-4edc-a47b-ec8964f283e9 tempest-VolumesTestJSON-817047389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b4c0b70-cee2-4d44-a607-8120a94d611c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:43 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-4bee56da-3e65-4edc-a47b-ec8964f283e9 tempest-VolumesTestJSON-817047389 None] Volume volume-382caf35-c088-4a5b-9c87-99590833b6d9 (382caf35-c088-4a5b-9c87-99590833b6d9): created successfully
Feb 27 01:24:43 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-4bee56da-3e65-4edc-a47b-ec8964f283e9 tempest-VolumesTestJSON-817047389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b4c0b70-cee2-4d44-a607-8120a94d611c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:43 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-4bee56da-3e65-4edc-a47b-ec8964f283e9 tempest-VolumesTestJSON-817047389 None] Flow 'volume_create_manager' (53435e22-411f-4e64-95c9-e5383253454a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:24:43 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-4bee56da-3e65-4edc-a47b-ec8964f283e9 tempest-VolumesTestJSON-817047389 None] Created volume successfully.
Feb 27 01:24:45 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5d295e40-475f-4431-bc25-7345ab1b2654 tempest-VolumesTestJSON-817047389 None] Acquiring lock "cinder-382caf35-c088-4a5b-9c87-99590833b6d9-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:24:45 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5d295e40-475f-4431-bc25-7345ab1b2654 tempest-VolumesTestJSON-817047389 None] Lock "cinder-382caf35-c088-4a5b-9c87-99590833b6d9-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:24:45 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5d295e40-475f-4431-bc25-7345ab1b2654 tempest-VolumesTestJSON-817047389 None] Acquiring lock "cinder-quobyte-382caf35-c088-4a5b-9c87-99590833b6d9" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:24:45 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5d295e40-475f-4431-bc25-7345ab1b2654 tempest-VolumesTestJSON-817047389 None] Lock "cinder-quobyte-382caf35-c088-4a5b-9c87-99590833b6d9" acquired by "delete_volume" :: waited 0.008s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:24:45 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[579d79b2-f24b-4419-8410-c650f7eaed38]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:24:45 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5d295e40-475f-4431-bc25-7345ab1b2654 tempest-VolumesTestJSON-817047389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-382caf35-c088-4a5b-9c87-99590833b6d9 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:45 devstack sudo[86572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-382caf35-c088-4a5b-9c87-99590833b6d9
Feb 27 01:24:45 devstack sudo[86572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:45 devstack sudo[86572]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:45 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5d295e40-475f-4431-bc25-7345ab1b2654 tempest-VolumesTestJSON-817047389 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-382caf35-c088-4a5b-9c87-99590833b6d9" returned: 0 in 0.674s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:45 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5d295e40-475f-4431-bc25-7345ab1b2654 tempest-VolumesTestJSON-817047389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-382caf35-c088-4a5b-9c87-99590833b6d9 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:45 devstack sudo[86577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-382caf35-c088-4a5b-9c87-99590833b6d9
Feb 27 01:24:45 devstack sudo[86577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:46 devstack sudo[86577]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:46 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5d295e40-475f-4431-bc25-7345ab1b2654 tempest-VolumesTestJSON-817047389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-382caf35-c088-4a5b-9c87-99590833b6d9" returned: 0 in 0.535s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:46 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5d295e40-475f-4431-bc25-7345ab1b2654 tempest-VolumesTestJSON-817047389 None] Lock "cinder-quobyte-382caf35-c088-4a5b-9c87-99590833b6d9" released by "delete_volume" :: held 1.244s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:24:46 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-5d295e40-475f-4431-bc25-7345ab1b2654 tempest-VolumesTestJSON-817047389 None] Created reservations ['fdcb0169-4178-4c21-a57d-e4120f97cc5c', '4843cbd7-c8d1-4bed-9dd5-d72373a4674a', '797c8ee2-d830-44e2-b834-eb4af4e7dbb7', '7f729328-833c-45e6-ae7d-3b4b364b80da'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:24:46 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-5d295e40-475f-4431-bc25-7345ab1b2654 tempest-VolumesTestJSON-817047389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:24:46 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-5d295e40-475f-4431-bc25-7345ab1b2654 tempest-VolumesTestJSON-817047389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:24:46 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-5d295e40-475f-4431-bc25-7345ab1b2654 tempest-VolumesTestJSON-817047389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:24:46 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-5d295e40-475f-4431-bc25-7345ab1b2654 tempest-VolumesTestJSON-817047389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:24:46 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-5d295e40-475f-4431-bc25-7345ab1b2654 tempest-VolumesTestJSON-817047389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:24:46 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5d295e40-475f-4431-bc25-7345ab1b2654 tempest-VolumesTestJSON-817047389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:46 devstack sudo[86580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:24:46 devstack sudo[86580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:47 devstack sudo[86580]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:47 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5d295e40-475f-4431-bc25-7345ab1b2654 tempest-VolumesTestJSON-817047389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.600s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:47 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-5d295e40-475f-4431-bc25-7345ab1b2654 tempest-VolumesTestJSON-817047389 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:24:47 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-5d295e40-475f-4431-bc25-7345ab1b2654 tempest-VolumesTestJSON-817047389 None] Deleted volume successfully.
Feb 27 01:24:47 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5d295e40-475f-4431-bc25-7345ab1b2654 tempest-VolumesTestJSON-817047389 None] Lock "cinder-382caf35-c088-4a5b-9c87-99590833b6d9-delete_volume" released by "delete_volume" :: held 1.999s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:24:47 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-d44a7770-152e-4f7d-9fd9-b71fd4507ef7 tempest-VolumesTestJSON-817047389 None] Acquiring lock "cinder-8bccabbf-cf58-4877-b3e3-0c2bb609727a-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:24:47 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-d44a7770-152e-4f7d-9fd9-b71fd4507ef7 tempest-VolumesTestJSON-817047389 None] Lock "cinder-8bccabbf-cf58-4877-b3e3-0c2bb609727a-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:24:47 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-d44a7770-152e-4f7d-9fd9-b71fd4507ef7 tempest-VolumesTestJSON-817047389 None] Acquiring lock "cinder-quobyte-8bccabbf-cf58-4877-b3e3-0c2bb609727a" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:24:47 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-d44a7770-152e-4f7d-9fd9-b71fd4507ef7 tempest-VolumesTestJSON-817047389 None] Lock "cinder-quobyte-8bccabbf-cf58-4877-b3e3-0c2bb609727a" acquired by "delete_volume" :: waited 0.020s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:24:47 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab98f3a-8d51-41f8-ae1d-02678fd9e908]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:24:47 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d44a7770-152e-4f7d-9fd9-b71fd4507ef7 tempest-VolumesTestJSON-817047389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8bccabbf-cf58-4877-b3e3-0c2bb609727a {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:47 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c55970d-b8a8-4aa7-8942-5c493c883387 tempest-SnapshotMetadataTestJSON-912324066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:24:47 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-2c55970d-b8a8-4aa7-8942-5c493c883387 tempest-SnapshotMetadataTestJSON-912324066 None] Flow 'volume_create_manager' (4f8201b7-05fb-46ce-a3c6-4c1fe6bf786c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:24:47 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-2c55970d-b8a8-4aa7-8942-5c493c883387 tempest-SnapshotMetadataTestJSON-912324066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc835aba-851e-43d0-ad43-fc2c081a0606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:47 devstack sudo[86583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8bccabbf-cf58-4877-b3e3-0c2bb609727a
Feb 27 01:24:47 devstack sudo[86583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:47 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-2c55970d-b8a8-4aa7-8942-5c493c883387 tempest-SnapshotMetadataTestJSON-912324066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc835aba-851e-43d0-ad43-fc2c081a0606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:24:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-144670113',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63d77f76-80a0-49c7-a8fe-0b572565ce70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e629dbd7bfc4f07bbdc8e10b32f1f59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:24:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:24:47Z,use_quota=True,user_id='b21353c5d5cd4029a4b47ef6b02a8ad8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:47 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-2c55970d-b8a8-4aa7-8942-5c493c883387 tempest-SnapshotMetadataTestJSON-912324066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31bb8677-3ae0-4fca-8561-16bc2c8fd0e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:47 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-2c55970d-b8a8-4aa7-8942-5c493c883387 tempest-SnapshotMetadataTestJSON-912324066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31bb8677-3ae0-4fca-8561-16bc2c8fd0e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:47 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-2c55970d-b8a8-4aa7-8942-5c493c883387 tempest-SnapshotMetadataTestJSON-912324066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a3c1bde-278b-4b4e-87f7-e44aeba393ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:47 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-2c55970d-b8a8-4aa7-8942-5c493c883387 tempest-SnapshotMetadataTestJSON-912324066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a3c1bde-278b-4b4e-87f7-e44aeba393ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63d77f76-80a0-49c7-a8fe-0b572565ce70', 'volume_name': 'volume-63d77f76-80a0-49c7-a8fe-0b572565ce70', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:47 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-2c55970d-b8a8-4aa7-8942-5c493c883387 tempest-SnapshotMetadataTestJSON-912324066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7ea248d-9659-429c-bf10-7265b89814dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:47 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-2c55970d-b8a8-4aa7-8942-5c493c883387 tempest-SnapshotMetadataTestJSON-912324066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7ea248d-9659-429c-bf10-7265b89814dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:47 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-2c55970d-b8a8-4aa7-8942-5c493c883387 tempest-SnapshotMetadataTestJSON-912324066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13d4c7c0-f301-4c34-ae33-2097b67b24bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:47 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-2c55970d-b8a8-4aa7-8942-5c493c883387 tempest-SnapshotMetadataTestJSON-912324066 None] Volume 63d77f76-80a0-49c7-a8fe-0b572565ce70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63d77f76-80a0-49c7-a8fe-0b572565ce70', 'volume_size': 1}
Feb 27 01:24:47 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-2c55970d-b8a8-4aa7-8942-5c493c883387 tempest-SnapshotMetadataTestJSON-912324066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:24:47 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-2c55970d-b8a8-4aa7-8942-5c493c883387 tempest-SnapshotMetadataTestJSON-912324066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:24:47 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-2c55970d-b8a8-4aa7-8942-5c493c883387 tempest-SnapshotMetadataTestJSON-912324066 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:24:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-144670113',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63d77f76-80a0-49c7-a8fe-0b572565ce70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e629dbd7bfc4f07bbdc8e10b32f1f59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:24:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:24:47Z,use_quota=True,user_id='b21353c5d5cd4029a4b47ef6b02a8ad8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:24:47 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-2c55970d-b8a8-4aa7-8942-5c493c883387 tempest-SnapshotMetadataTestJSON-912324066 None] Creating volume 63d77f76-80a0-49c7-a8fe-0b572565ce70 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:24:47 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-2c55970d-b8a8-4aa7-8942-5c493c883387 tempest-SnapshotMetadataTestJSON-912324066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:24:47 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-2c55970d-b8a8-4aa7-8942-5c493c883387 tempest-SnapshotMetadataTestJSON-912324066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:24:47 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-2c55970d-b8a8-4aa7-8942-5c493c883387 tempest-SnapshotMetadataTestJSON-912324066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:24:47 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-2c55970d-b8a8-4aa7-8942-5c493c883387 tempest-SnapshotMetadataTestJSON-912324066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:24:47 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-2c55970d-b8a8-4aa7-8942-5c493c883387 tempest-SnapshotMetadataTestJSON-912324066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:24:47 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-2c55970d-b8a8-4aa7-8942-5c493c883387 tempest-SnapshotMetadataTestJSON-912324066 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:24:47 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-2c55970d-b8a8-4aa7-8942-5c493c883387 tempest-SnapshotMetadataTestJSON-912324066 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:24:47 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-2c55970d-b8a8-4aa7-8942-5c493c883387 tempest-SnapshotMetadataTestJSON-912324066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-63d77f76-80a0-49c7-a8fe-0b572565ce70 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:47 devstack sudo[86585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-63d77f76-80a0-49c7-a8fe-0b572565ce70 1073741824
Feb 27 01:24:47 devstack sudo[86585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:48 devstack sudo[86583]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:48 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d44a7770-152e-4f7d-9fd9-b71fd4507ef7 tempest-VolumesTestJSON-817047389 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8bccabbf-cf58-4877-b3e3-0c2bb609727a" returned: 0 in 0.641s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:48 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d44a7770-152e-4f7d-9fd9-b71fd4507ef7 tempest-VolumesTestJSON-817047389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8bccabbf-cf58-4877-b3e3-0c2bb609727a {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:48 devstack sudo[86591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8bccabbf-cf58-4877-b3e3-0c2bb609727a
Feb 27 01:24:48 devstack sudo[86591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:48 devstack sudo[86585]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:48 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-2c55970d-b8a8-4aa7-8942-5c493c883387 tempest-SnapshotMetadataTestJSON-912324066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-63d77f76-80a0-49c7-a8fe-0b572565ce70 1073741824" returned: 0 in 0.729s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:48 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-2c55970d-b8a8-4aa7-8942-5c493c883387 tempest-SnapshotMetadataTestJSON-912324066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-63d77f76-80a0-49c7-a8fe-0b572565ce70 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:48 devstack sudo[86596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-63d77f76-80a0-49c7-a8fe-0b572565ce70
Feb 27 01:24:48 devstack sudo[86596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:48 devstack sudo[86591]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:48 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d44a7770-152e-4f7d-9fd9-b71fd4507ef7 tempest-VolumesTestJSON-817047389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8bccabbf-cf58-4877-b3e3-0c2bb609727a" returned: 0 in 0.613s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:48 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-d44a7770-152e-4f7d-9fd9-b71fd4507ef7 tempest-VolumesTestJSON-817047389 None] Lock "cinder-quobyte-8bccabbf-cf58-4877-b3e3-0c2bb609727a" released by "delete_volume" :: held 1.282s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:24:48 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-d44a7770-152e-4f7d-9fd9-b71fd4507ef7 tempest-VolumesTestJSON-817047389 None] Created reservations ['ae717973-ebf5-40c1-ac3c-e0a435e4a4ce', '94e0085c-7444-4eb8-aa70-22fc9ca97e28', '8c1abb14-520a-4c74-a74b-5bbd464cd3cb', '9ef33a1e-2e30-4873-b092-2c345f7f1a67'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:24:48 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-d44a7770-152e-4f7d-9fd9-b71fd4507ef7 tempest-VolumesTestJSON-817047389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:24:48 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-d44a7770-152e-4f7d-9fd9-b71fd4507ef7 tempest-VolumesTestJSON-817047389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:24:48 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-d44a7770-152e-4f7d-9fd9-b71fd4507ef7 tempest-VolumesTestJSON-817047389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:24:48 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-d44a7770-152e-4f7d-9fd9-b71fd4507ef7 tempest-VolumesTestJSON-817047389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:24:48 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-d44a7770-152e-4f7d-9fd9-b71fd4507ef7 tempest-VolumesTestJSON-817047389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:24:48 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d44a7770-152e-4f7d-9fd9-b71fd4507ef7 tempest-VolumesTestJSON-817047389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:48 devstack sudo[86599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:24:48 devstack sudo[86599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:49 devstack sudo[86596]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-2c55970d-b8a8-4aa7-8942-5c493c883387 tempest-SnapshotMetadataTestJSON-912324066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-63d77f76-80a0-49c7-a8fe-0b572565ce70" returned: 0 in 0.712s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:49 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-2c55970d-b8a8-4aa7-8942-5c493c883387 tempest-SnapshotMetadataTestJSON-912324066 None] <== create_volume: return (1470ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:24:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-2c55970d-b8a8-4aa7-8942-5c493c883387 tempest-SnapshotMetadataTestJSON-912324066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.473s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:24:49 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-2c55970d-b8a8-4aa7-8942-5c493c883387 tempest-SnapshotMetadataTestJSON-912324066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13d4c7c0-f301-4c34-ae33-2097b67b24bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63d77f76-80a0-49c7-a8fe-0b572565ce70', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:49 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-2c55970d-b8a8-4aa7-8942-5c493c883387 tempest-SnapshotMetadataTestJSON-912324066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce1fb45d-eca8-4913-a8c3-3e215cb8e586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:49 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-2c55970d-b8a8-4aa7-8942-5c493c883387 tempest-SnapshotMetadataTestJSON-912324066 None] Volume volume-63d77f76-80a0-49c7-a8fe-0b572565ce70 (63d77f76-80a0-49c7-a8fe-0b572565ce70): created successfully
Feb 27 01:24:49 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-2c55970d-b8a8-4aa7-8942-5c493c883387 tempest-SnapshotMetadataTestJSON-912324066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce1fb45d-eca8-4913-a8c3-3e215cb8e586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:49 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-2c55970d-b8a8-4aa7-8942-5c493c883387 tempest-SnapshotMetadataTestJSON-912324066 None] Flow 'volume_create_manager' (4f8201b7-05fb-46ce-a3c6-4c1fe6bf786c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:24:49 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-2c55970d-b8a8-4aa7-8942-5c493c883387 tempest-SnapshotMetadataTestJSON-912324066 None] Created volume successfully.
Feb 27 01:24:49 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-9168183a-82fd-422e-9f16-e14c6b780b45 tempest-SnapshotsActionsTest-1161199312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:24:49 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-9168183a-82fd-422e-9f16-e14c6b780b45 tempest-SnapshotsActionsTest-1161199312 None] Flow 'volume_create_manager' (5f67f79f-1f7c-4372-bbef-8d7991091ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:24:49 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-9168183a-82fd-422e-9f16-e14c6b780b45 tempest-SnapshotsActionsTest-1161199312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17c170f5-faa4-47d7-9e5c-54c6e158e476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:49 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-9168183a-82fd-422e-9f16-e14c6b780b45 tempest-SnapshotsActionsTest-1161199312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17c170f5-faa4-47d7-9e5c-54c6e158e476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:24:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1587975675',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4cb7fea-935f-40f5-8093-ce89f2d2348a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a47bc833b9414585ac28ba46ffad4fbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:24:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:24:49Z,use_quota=True,user_id='d75aeadc991940228efa0bca5617b066',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:49 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-9168183a-82fd-422e-9f16-e14c6b780b45 tempest-SnapshotsActionsTest-1161199312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f59e9c93-ddc8-406e-a249-e7a662905740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:49 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-9168183a-82fd-422e-9f16-e14c6b780b45 tempest-SnapshotsActionsTest-1161199312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f59e9c93-ddc8-406e-a249-e7a662905740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:49 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-9168183a-82fd-422e-9f16-e14c6b780b45 tempest-SnapshotsActionsTest-1161199312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ee0dbe4-548a-4155-b421-b8bc1f9a9d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:49 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-9168183a-82fd-422e-9f16-e14c6b780b45 tempest-SnapshotsActionsTest-1161199312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ee0dbe4-548a-4155-b421-b8bc1f9a9d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4cb7fea-935f-40f5-8093-ce89f2d2348a', 'volume_name': 'volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:49 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-9168183a-82fd-422e-9f16-e14c6b780b45 tempest-SnapshotsActionsTest-1161199312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a4a3ae6-201b-4201-8999-f13977106bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:49 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-9168183a-82fd-422e-9f16-e14c6b780b45 tempest-SnapshotsActionsTest-1161199312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a4a3ae6-201b-4201-8999-f13977106bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:49 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-9168183a-82fd-422e-9f16-e14c6b780b45 tempest-SnapshotsActionsTest-1161199312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4202b2bf-9d91-45a4-af0d-252d345e8d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:49 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-9168183a-82fd-422e-9f16-e14c6b780b45 tempest-SnapshotsActionsTest-1161199312 None] Volume f4cb7fea-935f-40f5-8093-ce89f2d2348a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a', 'volume_size': 1}
Feb 27 01:24:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-9168183a-82fd-422e-9f16-e14c6b780b45 tempest-SnapshotsActionsTest-1161199312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:24:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-9168183a-82fd-422e-9f16-e14c6b780b45 tempest-SnapshotsActionsTest-1161199312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:24:49 devstack sudo[86599]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:49 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-9168183a-82fd-422e-9f16-e14c6b780b45 tempest-SnapshotsActionsTest-1161199312 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:24:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1587975675',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4cb7fea-935f-40f5-8093-ce89f2d2348a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a47bc833b9414585ac28ba46ffad4fbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:24:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:24:49Z,use_quota=True,user_id='d75aeadc991940228efa0bca5617b066',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:24:49 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-9168183a-82fd-422e-9f16-e14c6b780b45 tempest-SnapshotsActionsTest-1161199312 None] Creating volume f4cb7fea-935f-40f5-8093-ce89f2d2348a {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:24:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-9168183a-82fd-422e-9f16-e14c6b780b45 tempest-SnapshotsActionsTest-1161199312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:24:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-9168183a-82fd-422e-9f16-e14c6b780b45 tempest-SnapshotsActionsTest-1161199312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:24:49 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-9168183a-82fd-422e-9f16-e14c6b780b45 tempest-SnapshotsActionsTest-1161199312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:24:49 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-9168183a-82fd-422e-9f16-e14c6b780b45 tempest-SnapshotsActionsTest-1161199312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:24:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-9168183a-82fd-422e-9f16-e14c6b780b45 tempest-SnapshotsActionsTest-1161199312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:24:49 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-9168183a-82fd-422e-9f16-e14c6b780b45 tempest-SnapshotsActionsTest-1161199312 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:24:49 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-9168183a-82fd-422e-9f16-e14c6b780b45 tempest-SnapshotsActionsTest-1161199312 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:24:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9168183a-82fd-422e-9f16-e14c6b780b45 tempest-SnapshotsActionsTest-1161199312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d44a7770-152e-4f7d-9fd9-b71fd4507ef7 tempest-VolumesTestJSON-817047389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.593s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:49 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-d44a7770-152e-4f7d-9fd9-b71fd4507ef7 tempest-VolumesTestJSON-817047389 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:24:49 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-d44a7770-152e-4f7d-9fd9-b71fd4507ef7 tempest-VolumesTestJSON-817047389 None] Deleted volume successfully.
Feb 27 01:24:49 devstack sudo[86603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a 1073741824
Feb 27 01:24:49 devstack sudo[86603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:49 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-d44a7770-152e-4f7d-9fd9-b71fd4507ef7 tempest-VolumesTestJSON-817047389 None] Lock "cinder-8bccabbf-cf58-4877-b3e3-0c2bb609727a-delete_volume" released by "delete_volume" :: held 2.030s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:24:49 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-ed72c5b4-ccf2-4a55-93cc-c0b2d8d1e6de tempest-VolumesTestJSON-817047389 None] Acquiring lock "cinder-14449f5b-b09d-4338-b7d7-6416fefa94a4-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:24:49 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-ed72c5b4-ccf2-4a55-93cc-c0b2d8d1e6de tempest-VolumesTestJSON-817047389 None] Lock "cinder-14449f5b-b09d-4338-b7d7-6416fefa94a4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:24:49 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-ed72c5b4-ccf2-4a55-93cc-c0b2d8d1e6de tempest-VolumesTestJSON-817047389 None] Acquiring lock "cinder-quobyte-14449f5b-b09d-4338-b7d7-6416fefa94a4" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:24:49 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-ed72c5b4-ccf2-4a55-93cc-c0b2d8d1e6de tempest-VolumesTestJSON-817047389 None] Lock "cinder-quobyte-14449f5b-b09d-4338-b7d7-6416fefa94a4" acquired by "delete_volume" :: waited 0.013s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:24:49 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[8008c1a3-9836-4d94-8108-c81239c8a7a4]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:24:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ed72c5b4-ccf2-4a55-93cc-c0b2d8d1e6de tempest-VolumesTestJSON-817047389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-14449f5b-b09d-4338-b7d7-6416fefa94a4 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:49 devstack sudo[86606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-14449f5b-b09d-4338-b7d7-6416fefa94a4
Feb 27 01:24:49 devstack sudo[86606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-78ed3945-246e-49e4-af9c-7aeb2d5410b7 tempest-SnapshotMetadataTestJSON-912324066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:24:50 devstack sudo[86603]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:50 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9168183a-82fd-422e-9f16-e14c6b780b45 tempest-SnapshotsActionsTest-1161199312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a 1073741824" returned: 0 in 0.693s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:50 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9168183a-82fd-422e-9f16-e14c6b780b45 tempest-SnapshotsActionsTest-1161199312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:50 devstack sudo[86611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a
Feb 27 01:24:50 devstack sudo[86611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:50 devstack sudo[86606]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:50 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ed72c5b4-ccf2-4a55-93cc-c0b2d8d1e6de tempest-VolumesTestJSON-817047389 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-14449f5b-b09d-4338-b7d7-6416fefa94a4" returned: 0 in 0.622s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:50 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ed72c5b4-ccf2-4a55-93cc-c0b2d8d1e6de tempest-VolumesTestJSON-817047389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-14449f5b-b09d-4338-b7d7-6416fefa94a4 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:50 devstack sudo[86616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-14449f5b-b09d-4338-b7d7-6416fefa94a4
Feb 27 01:24:50 devstack sudo[86616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:50 devstack sudo[86611]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:50 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9168183a-82fd-422e-9f16-e14c6b780b45 tempest-SnapshotsActionsTest-1161199312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a" returned: 0 in 0.492s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:50 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-9168183a-82fd-422e-9f16-e14c6b780b45 tempest-SnapshotsActionsTest-1161199312 None] <== create_volume: return (1213ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:24:50 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-9168183a-82fd-422e-9f16-e14c6b780b45 tempest-SnapshotsActionsTest-1161199312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.216s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:24:50 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-78ed3945-246e-49e4-af9c-7aeb2d5410b7 tempest-SnapshotMetadataTestJSON-912324066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.739s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:24:50 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-78ed3945-246e-49e4-af9c-7aeb2d5410b7 tempest-SnapshotMetadataTestJSON-912324066 None] Creating offline snapshot b1b02c33-b54d-4cab-acc9-1a6604af6f7a of volume 63d77f76-80a0-49c7-a8fe-0b572565ce70 {{(pid=83106) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:24:50 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-9168183a-82fd-422e-9f16-e14c6b780b45 tempest-SnapshotsActionsTest-1161199312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4202b2bf-9d91-45a4-af0d-252d345e8d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:50 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-9168183a-82fd-422e-9f16-e14c6b780b45 tempest-SnapshotsActionsTest-1161199312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f14ed8a-2cfa-4928-bc2a-a1b051a1b892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:50 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec02678-b537-4707-bba8-48e1814b38c1]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:24:50 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-78ed3945-246e-49e4-af9c-7aeb2d5410b7 tempest-SnapshotMetadataTestJSON-912324066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-63d77f76-80a0-49c7-a8fe-0b572565ce70 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:50 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-9168183a-82fd-422e-9f16-e14c6b780b45 tempest-SnapshotsActionsTest-1161199312 None] Volume volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a (f4cb7fea-935f-40f5-8093-ce89f2d2348a): created successfully
Feb 27 01:24:50 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-9168183a-82fd-422e-9f16-e14c6b780b45 tempest-SnapshotsActionsTest-1161199312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f14ed8a-2cfa-4928-bc2a-a1b051a1b892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:50 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-9168183a-82fd-422e-9f16-e14c6b780b45 tempest-SnapshotsActionsTest-1161199312 None] Flow 'volume_create_manager' (5f67f79f-1f7c-4372-bbef-8d7991091ba0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:24:50 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-9168183a-82fd-422e-9f16-e14c6b780b45 tempest-SnapshotsActionsTest-1161199312 None] Created volume successfully.
Feb 27 01:24:50 devstack sudo[86619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-63d77f76-80a0-49c7-a8fe-0b572565ce70
Feb 27 01:24:50 devstack sudo[86619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:50 devstack sudo[86616]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:50 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ed72c5b4-ccf2-4a55-93cc-c0b2d8d1e6de tempest-VolumesTestJSON-817047389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-14449f5b-b09d-4338-b7d7-6416fefa94a4" returned: 0 in 0.520s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:50 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-ed72c5b4-ccf2-4a55-93cc-c0b2d8d1e6de tempest-VolumesTestJSON-817047389 None] Lock "cinder-quobyte-14449f5b-b09d-4338-b7d7-6416fefa94a4" released by "delete_volume" :: held 1.176s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:24:50 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-ed72c5b4-ccf2-4a55-93cc-c0b2d8d1e6de tempest-VolumesTestJSON-817047389 None] Created reservations ['eb27131d-da97-4349-b824-332e61cd3e14', 'b8d2dc71-e41f-45eb-abf4-cc2e3e43e5bf', '13cbb555-4f3a-4c93-af2d-7b5ece2d9f4a', '88288f75-b380-43b2-8aaa-2ddf8e54b635'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:24:50 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-ed72c5b4-ccf2-4a55-93cc-c0b2d8d1e6de tempest-VolumesTestJSON-817047389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:24:50 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-ed72c5b4-ccf2-4a55-93cc-c0b2d8d1e6de tempest-VolumesTestJSON-817047389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:24:50 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-ed72c5b4-ccf2-4a55-93cc-c0b2d8d1e6de tempest-VolumesTestJSON-817047389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:24:50 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-ed72c5b4-ccf2-4a55-93cc-c0b2d8d1e6de tempest-VolumesTestJSON-817047389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:24:50 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-ed72c5b4-ccf2-4a55-93cc-c0b2d8d1e6de tempest-VolumesTestJSON-817047389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:24:50 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ed72c5b4-ccf2-4a55-93cc-c0b2d8d1e6de tempest-VolumesTestJSON-817047389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:50 devstack sudo[86622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:24:50 devstack sudo[86622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:51 devstack sudo[86619]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:51 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-78ed3945-246e-49e4-af9c-7aeb2d5410b7 tempest-SnapshotMetadataTestJSON-912324066 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-63d77f76-80a0-49c7-a8fe-0b572565ce70" returned: 0 in 0.553s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:51 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-78ed3945-246e-49e4-af9c-7aeb2d5410b7 tempest-SnapshotMetadataTestJSON-912324066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-63d77f76-80a0-49c7-a8fe-0b572565ce70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-63d77f76-80a0-49c7-a8fe-0b572565ce70.b1b02c33-b54d-4cab-acc9-1a6604af6f7a 1G {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:51 devstack sudo[86627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-63d77f76-80a0-49c7-a8fe-0b572565ce70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-63d77f76-80a0-49c7-a8fe-0b572565ce70.b1b02c33-b54d-4cab-acc9-1a6604af6f7a 1G
Feb 27 01:24:51 devstack sudo[86627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:51 devstack sudo[86622]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:51 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ed72c5b4-ccf2-4a55-93cc-c0b2d8d1e6de tempest-VolumesTestJSON-817047389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.483s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:51 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-ed72c5b4-ccf2-4a55-93cc-c0b2d8d1e6de tempest-VolumesTestJSON-817047389 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:24:51 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-ed72c5b4-ccf2-4a55-93cc-c0b2d8d1e6de tempest-VolumesTestJSON-817047389 None] Deleted volume successfully.
Feb 27 01:24:51 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-ed72c5b4-ccf2-4a55-93cc-c0b2d8d1e6de tempest-VolumesTestJSON-817047389 None] Lock "cinder-14449f5b-b09d-4338-b7d7-6416fefa94a4-delete_volume" released by "delete_volume" :: held 1.824s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:24:51 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-1cb7683a-d6d0-4e50-8ceb-ed601939956f tempest-SnapshotsActionsTest-1161199312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:24:51 devstack sudo[86627]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:51 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-78ed3945-246e-49e4-af9c-7aeb2d5410b7 tempest-SnapshotMetadataTestJSON-912324066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-63d77f76-80a0-49c7-a8fe-0b572565ce70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-63d77f76-80a0-49c7-a8fe-0b572565ce70.b1b02c33-b54d-4cab-acc9-1a6604af6f7a 1G" returned: 0 in 0.625s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:51 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-78ed3945-246e-49e4-af9c-7aeb2d5410b7 tempest-SnapshotMetadataTestJSON-912324066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63d77f76-80a0-49c7-a8fe-0b572565ce70 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-63d77f76-80a0-49c7-a8fe-0b572565ce70.b1b02c33-b54d-4cab-acc9-1a6604af6f7a {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:51 devstack sudo[86633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63d77f76-80a0-49c7-a8fe-0b572565ce70 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-63d77f76-80a0-49c7-a8fe-0b572565ce70.b1b02c33-b54d-4cab-acc9-1a6604af6f7a
Feb 27 01:24:51 devstack sudo[86633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:52 devstack sudo[86633]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:52 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-78ed3945-246e-49e4-af9c-7aeb2d5410b7 tempest-SnapshotMetadataTestJSON-912324066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63d77f76-80a0-49c7-a8fe-0b572565ce70 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-63d77f76-80a0-49c7-a8fe-0b572565ce70.b1b02c33-b54d-4cab-acc9-1a6604af6f7a" returned: 0 in 0.477s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:52 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-78ed3945-246e-49e4-af9c-7aeb2d5410b7 tempest-SnapshotMetadataTestJSON-912324066 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-63d77f76-80a0-49c7-a8fe-0b572565ce70.b1b02c33-b54d-4cab-acc9-1a6604af6f7a is being set with open permissions: ugo+rw
Feb 27 01:24:52 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-78ed3945-246e-49e4-af9c-7aeb2d5410b7 tempest-SnapshotMetadataTestJSON-912324066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-63d77f76-80a0-49c7-a8fe-0b572565ce70.b1b02c33-b54d-4cab-acc9-1a6604af6f7a {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:52 devstack sudo[86638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-63d77f76-80a0-49c7-a8fe-0b572565ce70.b1b02c33-b54d-4cab-acc9-1a6604af6f7a
Feb 27 01:24:52 devstack sudo[86638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:52 devstack sudo[86638]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:52 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-78ed3945-246e-49e4-af9c-7aeb2d5410b7 tempest-SnapshotMetadataTestJSON-912324066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-63d77f76-80a0-49c7-a8fe-0b572565ce70.b1b02c33-b54d-4cab-acc9-1a6604af6f7a" returned: 0 in 0.476s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:52 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-78ed3945-246e-49e4-af9c-7aeb2d5410b7 tempest-SnapshotMetadataTestJSON-912324066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-63d77f76-80a0-49c7-a8fe-0b572565ce70.info {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:52 devstack sudo[86642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-63d77f76-80a0-49c7-a8fe-0b572565ce70.info
Feb 27 01:24:52 devstack sudo[86642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:52 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-e528e22b-5772-4bc8-b183-925eaa8b68b7 tempest-BackendsCapabilitiesAdminTestsJSON-1327413487 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580490112305, 'free_capacity_gb': 1775.7580490112305, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83106) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Feb 27 01:24:53 devstack sudo[86642]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:53 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-78ed3945-246e-49e4-af9c-7aeb2d5410b7 tempest-SnapshotMetadataTestJSON-912324066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-63d77f76-80a0-49c7-a8fe-0b572565ce70.info" returned: 0 in 0.486s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:53 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-78ed3945-246e-49e4-af9c-7aeb2d5410b7 tempest-SnapshotMetadataTestJSON-912324066 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-63d77f76-80a0-49c7-a8fe-0b572565ce70.info is being set with open permissions: ugo+rw
Feb 27 01:24:53 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-78ed3945-246e-49e4-af9c-7aeb2d5410b7 tempest-SnapshotMetadataTestJSON-912324066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-63d77f76-80a0-49c7-a8fe-0b572565ce70.info {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:53 devstack sudo[86645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-63d77f76-80a0-49c7-a8fe-0b572565ce70.info
Feb 27 01:24:53 devstack sudo[86645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:53 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-147407d8-7ca4-434c-bdeb-0733c9c58c03 tempest-BackendsCapabilitiesAdminTestsJSON-1327413487 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580490112305, 'free_capacity_gb': 1775.7580490112305, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83106) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Feb 27 01:24:53 devstack sudo[86645]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:53 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-78ed3945-246e-49e4-af9c-7aeb2d5410b7 tempest-SnapshotMetadataTestJSON-912324066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-63d77f76-80a0-49c7-a8fe-0b572565ce70.info" returned: 0 in 0.501s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:53 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-78ed3945-246e-49e4-af9c-7aeb2d5410b7 tempest-SnapshotMetadataTestJSON-912324066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.188s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:24:53 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-1cb7683a-d6d0-4e50-8ceb-ed601939956f tempest-SnapshotsActionsTest-1161199312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.158s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:24:53 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-1cb7683a-d6d0-4e50-8ceb-ed601939956f tempest-SnapshotsActionsTest-1161199312 None] Creating offline snapshot 864f055e-6cc0-410f-83c0-64b218ae6d25 of volume f4cb7fea-935f-40f5-8093-ce89f2d2348a {{(pid=83106) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:24:53 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-78ed3945-246e-49e4-af9c-7aeb2d5410b7 tempest-SnapshotMetadataTestJSON-912324066 None] Create snapshot completed successfully
Feb 27 01:24:53 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29a518e-8837-481b-b04a-8e0496e01c85]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:24:53 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-1cb7683a-d6d0-4e50-8ceb-ed601939956f tempest-SnapshotsActionsTest-1161199312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:53 devstack sudo[86648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a
Feb 27 01:24:53 devstack sudo[86648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:54 devstack sudo[86648]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:54 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-1cb7683a-d6d0-4e50-8ceb-ed601939956f tempest-SnapshotsActionsTest-1161199312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a" returned: 0 in 0.717s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:54 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-1cb7683a-d6d0-4e50-8ceb-ed601939956f tempest-SnapshotsActionsTest-1161199312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.864f055e-6cc0-410f-83c0-64b218ae6d25 1G {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:54 devstack sudo[86653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.864f055e-6cc0-410f-83c0-64b218ae6d25 1G
Feb 27 01:24:54 devstack sudo[86653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:54 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-d1c1c604-5c78-4bde-8919-2956afcfdd5d tempest-SnapshotMetadataTestJSON-912324066 None] Acquiring lock "cinder-b1b02c33-b54d-4cab-acc9-1a6604af6f7a-delete_snapshot" by "delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:24:54 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-d1c1c604-5c78-4bde-8919-2956afcfdd5d tempest-SnapshotMetadataTestJSON-912324066 None] Lock "cinder-b1b02c33-b54d-4cab-acc9-1a6604af6f7a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:24:54 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-d1c1c604-5c78-4bde-8919-2956afcfdd5d tempest-SnapshotMetadataTestJSON-912324066 None] Acquiring lock "cinder-quobyte-63d77f76-80a0-49c7-a8fe-0b572565ce70" by "delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:24:54 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-d1c1c604-5c78-4bde-8919-2956afcfdd5d tempest-SnapshotMetadataTestJSON-912324066 None] Lock "cinder-quobyte-63d77f76-80a0-49c7-a8fe-0b572565ce70" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:24:54 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-d1c1c604-5c78-4bde-8919-2956afcfdd5d tempest-SnapshotMetadataTestJSON-912324066 None] Acquiring lock "cinder-quobyte-b1b02c33-b54d-4cab-acc9-1a6604af6f7a" by "_delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:24:54 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-d1c1c604-5c78-4bde-8919-2956afcfdd5d tempest-SnapshotMetadataTestJSON-912324066 None] Lock "cinder-quobyte-b1b02c33-b54d-4cab-acc9-1a6604af6f7a" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:24:54 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-d1c1c604-5c78-4bde-8919-2956afcfdd5d tempest-SnapshotMetadataTestJSON-912324066 None] Deleting offline snapshot b1b02c33-b54d-4cab-acc9-1a6604af6f7a of volume 63d77f76-80a0-49c7-a8fe-0b572565ce70 {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:24:54 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-d1c1c604-5c78-4bde-8919-2956afcfdd5d tempest-SnapshotMetadataTestJSON-912324066 None] snapshot_file for this snap is: volume-63d77f76-80a0-49c7-a8fe-0b572565ce70.b1b02c33-b54d-4cab-acc9-1a6604af6f7a {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:24:54 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5eb021a-f304-4869-94ac-0c39df39343f]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:24:54 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d1c1c604-5c78-4bde-8919-2956afcfdd5d tempest-SnapshotMetadataTestJSON-912324066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-63d77f76-80a0-49c7-a8fe-0b572565ce70.b1b02c33-b54d-4cab-acc9-1a6604af6f7a {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:54 devstack sudo[86655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-63d77f76-80a0-49c7-a8fe-0b572565ce70.b1b02c33-b54d-4cab-acc9-1a6604af6f7a
Feb 27 01:24:54 devstack sudo[86655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:55 devstack sudo[86653]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-1cb7683a-d6d0-4e50-8ceb-ed601939956f tempest-SnapshotsActionsTest-1161199312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.864f055e-6cc0-410f-83c0-64b218ae6d25 1G" returned: 0 in 0.623s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-1cb7683a-d6d0-4e50-8ceb-ed601939956f tempest-SnapshotsActionsTest-1161199312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.864f055e-6cc0-410f-83c0-64b218ae6d25 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:55 devstack sudo[86660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.864f055e-6cc0-410f-83c0-64b218ae6d25
Feb 27 01:24:55 devstack sudo[86660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:55 devstack sudo[86655]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d1c1c604-5c78-4bde-8919-2956afcfdd5d tempest-SnapshotMetadataTestJSON-912324066 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-63d77f76-80a0-49c7-a8fe-0b572565ce70.b1b02c33-b54d-4cab-acc9-1a6604af6f7a" returned: 0 in 0.622s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:55 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-d1c1c604-5c78-4bde-8919-2956afcfdd5d tempest-SnapshotMetadataTestJSON-912324066 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63d77f76-80a0-49c7-a8fe-0b572565ce70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83106) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:24:55 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[29bdc6c5-3907-40ab-b4e2-5fbfb8a6ba99]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:24:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d1c1c604-5c78-4bde-8919-2956afcfdd5d tempest-SnapshotMetadataTestJSON-912324066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-63d77f76-80a0-49c7-a8fe-0b572565ce70 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:55 devstack sudo[86665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-63d77f76-80a0-49c7-a8fe-0b572565ce70
Feb 27 01:24:55 devstack sudo[86665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:55 devstack sudo[86660]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-1cb7683a-d6d0-4e50-8ceb-ed601939956f tempest-SnapshotsActionsTest-1161199312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.864f055e-6cc0-410f-83c0-64b218ae6d25" returned: 0 in 0.546s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:55 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-1cb7683a-d6d0-4e50-8ceb-ed601939956f tempest-SnapshotsActionsTest-1161199312 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.864f055e-6cc0-410f-83c0-64b218ae6d25 is being set with open permissions: ugo+rw
Feb 27 01:24:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-1cb7683a-d6d0-4e50-8ceb-ed601939956f tempest-SnapshotsActionsTest-1161199312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.864f055e-6cc0-410f-83c0-64b218ae6d25 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:55 devstack sudo[86670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.864f055e-6cc0-410f-83c0-64b218ae6d25
Feb 27 01:24:55 devstack sudo[86670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:55 devstack sudo[86665]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d1c1c604-5c78-4bde-8919-2956afcfdd5d tempest-SnapshotMetadataTestJSON-912324066 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-63d77f76-80a0-49c7-a8fe-0b572565ce70" returned: 0 in 0.628s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d1c1c604-5c78-4bde-8919-2956afcfdd5d tempest-SnapshotMetadataTestJSON-912324066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-63d77f76-80a0-49c7-a8fe-0b572565ce70.b1b02c33-b54d-4cab-acc9-1a6604af6f7a {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:56 devstack sudo[86675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-63d77f76-80a0-49c7-a8fe-0b572565ce70.b1b02c33-b54d-4cab-acc9-1a6604af6f7a
Feb 27 01:24:56 devstack sudo[86675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:56 devstack sudo[86670]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-1cb7683a-d6d0-4e50-8ceb-ed601939956f tempest-SnapshotsActionsTest-1161199312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.864f055e-6cc0-410f-83c0-64b218ae6d25" returned: 0 in 0.511s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:56 devstack cinder-volume[83106]: DEBUG dbcounter [-] [83106] Writing DB stats cinder:UPDATE=158,cinder:DELETE=14,cinder:SELECT=135,cinder:INSERT=37 {{(pid=83106) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 01:24:56 devstack cinder-volume[83106]: DEBUG dbcounter [-] [83106] Writing DB stats cinder:SELECT=142,cinder:UPDATE=159,cinder:INSERT=36,cinder:DELETE=6 {{(pid=83106) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 01:24:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-1cb7683a-d6d0-4e50-8ceb-ed601939956f tempest-SnapshotsActionsTest-1161199312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.info {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:56 devstack sudo[86678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.info
Feb 27 01:24:56 devstack sudo[86678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:56 devstack sudo[86675]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d1c1c604-5c78-4bde-8919-2956afcfdd5d tempest-SnapshotMetadataTestJSON-912324066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-63d77f76-80a0-49c7-a8fe-0b572565ce70.b1b02c33-b54d-4cab-acc9-1a6604af6f7a" returned: 0 in 0.518s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d1c1c604-5c78-4bde-8919-2956afcfdd5d tempest-SnapshotMetadataTestJSON-912324066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-63d77f76-80a0-49c7-a8fe-0b572565ce70.b1b02c33-b54d-4cab-acc9-1a6604af6f7a {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:56 devstack sudo[86683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-63d77f76-80a0-49c7-a8fe-0b572565ce70.b1b02c33-b54d-4cab-acc9-1a6604af6f7a
Feb 27 01:24:56 devstack sudo[86683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:56 devstack sudo[86678]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-1cb7683a-d6d0-4e50-8ceb-ed601939956f tempest-SnapshotsActionsTest-1161199312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.info" returned: 0 in 0.513s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:56 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-1cb7683a-d6d0-4e50-8ceb-ed601939956f tempest-SnapshotsActionsTest-1161199312 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.info is being set with open permissions: ugo+rw
Feb 27 01:24:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-1cb7683a-d6d0-4e50-8ceb-ed601939956f tempest-SnapshotsActionsTest-1161199312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.info {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:56 devstack sudo[86686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.info
Feb 27 01:24:56 devstack sudo[86686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:56 devstack cinder-volume[83106]: DEBUG oslo_service.periodic_task [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83106) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Feb 27 01:24:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:24:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:24:56 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:24:56 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:24:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:24:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:56 devstack sudo[86688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:24:56 devstack sudo[86688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:57 devstack sudo[86683]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d1c1c604-5c78-4bde-8919-2956afcfdd5d tempest-SnapshotMetadataTestJSON-912324066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-63d77f76-80a0-49c7-a8fe-0b572565ce70.b1b02c33-b54d-4cab-acc9-1a6604af6f7a" returned: 0 in 0.537s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:57 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-d1c1c604-5c78-4bde-8919-2956afcfdd5d tempest-SnapshotMetadataTestJSON-912324066 None] Lock "cinder-quobyte-b1b02c33-b54d-4cab-acc9-1a6604af6f7a" released by "_delete_snapshot" :: held 2.403s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:24:57 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-d1c1c604-5c78-4bde-8919-2956afcfdd5d tempest-SnapshotMetadataTestJSON-912324066 None] Lock "cinder-quobyte-63d77f76-80a0-49c7-a8fe-0b572565ce70" released by "delete_snapshot" :: held 2.416s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:24:57 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-d1c1c604-5c78-4bde-8919-2956afcfdd5d tempest-SnapshotMetadataTestJSON-912324066 None] Created reservations ['defb5403-a5f1-4820-9a04-48d514abf1e9', 'b9befe1c-faf9-4954-8956-bc8c984e8a11', 'baca2815-6dbc-4830-9c70-225afcc79446', 'df9019fe-39e6-49da-9436-ccc145336ab5'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:24:57 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-d1c1c604-5c78-4bde-8919-2956afcfdd5d tempest-SnapshotMetadataTestJSON-912324066 None] Delete snapshot completed successfully.
Feb 27 01:24:57 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-d1c1c604-5c78-4bde-8919-2956afcfdd5d tempest-SnapshotMetadataTestJSON-912324066 None] Lock "cinder-b1b02c33-b54d-4cab-acc9-1a6604af6f7a-delete_snapshot" released by "delete_snapshot" :: held 2.589s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:24:57 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-19d3cab6-3240-4cf5-85e2-49ad10e134e4 tempest-GroupSnapshotsV319Test-652929209 None] Group tempest-GroupSnapshotsV319Test-Group-1796153283: creating
Feb 27 01:24:57 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-19d3cab6-3240-4cf5-85e2-49ad10e134e4 tempest-GroupSnapshotsV319Test-652929209 None] Group tempest-GroupSnapshotsV319Test-Group-1796153283: created successfully
Feb 27 01:24:57 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-19d3cab6-3240-4cf5-85e2-49ad10e134e4 tempest-GroupSnapshotsV319Test-652929209 None] Create group completed successfully.
Feb 27 01:24:57 devstack sudo[86686]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-1cb7683a-d6d0-4e50-8ceb-ed601939956f tempest-SnapshotsActionsTest-1161199312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.info" returned: 0 in 0.671s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-1cb7683a-d6d0-4e50-8ceb-ed601939956f tempest-SnapshotsActionsTest-1161199312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.665s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:24:57 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-1cb7683a-d6d0-4e50-8ceb-ed601939956f tempest-SnapshotsActionsTest-1161199312 None] Create snapshot completed successfully
Feb 27 01:24:57 devstack sudo[86688]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.593s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:57 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:24:57 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-7d4f83ce-b602-48be-8fee-1a9c0feb5690 tempest-SnapshotMetadataTestJSON-912324066 None] Acquiring lock "cinder-63d77f76-80a0-49c7-a8fe-0b572565ce70-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:24:57 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-7d4f83ce-b602-48be-8fee-1a9c0feb5690 tempest-SnapshotMetadataTestJSON-912324066 None] Lock "cinder-63d77f76-80a0-49c7-a8fe-0b572565ce70-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:24:57 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-7d4f83ce-b602-48be-8fee-1a9c0feb5690 tempest-SnapshotMetadataTestJSON-912324066 None] Acquiring lock "cinder-quobyte-63d77f76-80a0-49c7-a8fe-0b572565ce70" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:24:57 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-7d4f83ce-b602-48be-8fee-1a9c0feb5690 tempest-SnapshotMetadataTestJSON-912324066 None] Lock "cinder-quobyte-63d77f76-80a0-49c7-a8fe-0b572565ce70" acquired by "delete_volume" :: waited 0.007s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:24:57 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec398b7-560b-46b2-81cf-2884d234dd31]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:24:58 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7d4f83ce-b602-48be-8fee-1a9c0feb5690 tempest-SnapshotMetadataTestJSON-912324066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-63d77f76-80a0-49c7-a8fe-0b572565ce70 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:58 devstack sudo[86693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-63d77f76-80a0-49c7-a8fe-0b572565ce70
Feb 27 01:24:58 devstack sudo[86693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:58 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-5d1699c6-b1b8-47d6-bea3-116c4e3b5718 tempest-SnapshotsActionsTest-1161199312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:24:58 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-5d1699c6-b1b8-47d6-bea3-116c4e3b5718 tempest-SnapshotsActionsTest-1161199312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:24:58 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-5d1699c6-b1b8-47d6-bea3-116c4e3b5718 tempest-SnapshotsActionsTest-1161199312 None] Creating offline snapshot e16aa689-ebe6-4921-9c12-40bb75368671 of volume f4cb7fea-935f-40f5-8093-ce89f2d2348a {{(pid=83106) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:24:58 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[803759f8-8d29-45e5-86cb-c352d17d8769]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:24:58 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5d1699c6-b1b8-47d6-bea3-116c4e3b5718 tempest-SnapshotsActionsTest-1161199312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.864f055e-6cc0-410f-83c0-64b218ae6d25 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:58 devstack sudo[86695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.864f055e-6cc0-410f-83c0-64b218ae6d25
Feb 27 01:24:58 devstack sudo[86695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:58 devstack sudo[86693]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:58 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7d4f83ce-b602-48be-8fee-1a9c0feb5690 tempest-SnapshotMetadataTestJSON-912324066 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-63d77f76-80a0-49c7-a8fe-0b572565ce70" returned: 0 in 0.578s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:58 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7d4f83ce-b602-48be-8fee-1a9c0feb5690 tempest-SnapshotMetadataTestJSON-912324066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-63d77f76-80a0-49c7-a8fe-0b572565ce70 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:58 devstack sudo[86700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-63d77f76-80a0-49c7-a8fe-0b572565ce70
Feb 27 01:24:58 devstack sudo[86700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:58 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-964127ab-76e0-41c3-900c-99bc998e507b tempest-GroupSnapshotsV319Test-652929209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:24:58 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-964127ab-76e0-41c3-900c-99bc998e507b tempest-GroupSnapshotsV319Test-652929209 None] Flow 'volume_create_manager' (35df8f4a-1e3b-4fb6-b91c-18c7e773c437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:24:58 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-964127ab-76e0-41c3-900c-99bc998e507b tempest-GroupSnapshotsV319Test-652929209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ab25a2e-369e-4d9c-a525-ddc95f455c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:58 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-964127ab-76e0-41c3-900c-99bc998e507b tempest-GroupSnapshotsV319Test-652929209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ab25a2e-369e-4d9c-a525-ddc95f455c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:24:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1256294840',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=49170893-5a70-48ea-a49d-2329482380df,host='devstack@QuobyteHD#QuobyteHD',id=26d9be49-d08f-460a-a70f-cd3d4fb9d56d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3973312921949fbac7338ec9ab1c0ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:24:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:24:59Z,use_quota=True,user_id='24db08aced974bc2a19edef8d0822b78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd748d34-deb3-49b2-a97a-c82d5da1c69a),volume_type_id=bd748d34-deb3-49b2-a97a-c82d5da1c69a)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:58 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-964127ab-76e0-41c3-900c-99bc998e507b tempest-GroupSnapshotsV319Test-652929209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4101f01-6e5f-4e8d-a47c-71daeea385e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:58 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-964127ab-76e0-41c3-900c-99bc998e507b tempest-GroupSnapshotsV319Test-652929209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4101f01-6e5f-4e8d-a47c-71daeea385e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:58 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-964127ab-76e0-41c3-900c-99bc998e507b tempest-GroupSnapshotsV319Test-652929209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (641a8437-980c-4860-bb90-bd31940a1485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:58 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-964127ab-76e0-41c3-900c-99bc998e507b tempest-GroupSnapshotsV319Test-652929209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (641a8437-980c-4860-bb90-bd31940a1485) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26d9be49-d08f-460a-a70f-cd3d4fb9d56d', 'volume_name': 'volume-26d9be49-d08f-460a-a70f-cd3d4fb9d56d', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:58 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-964127ab-76e0-41c3-900c-99bc998e507b tempest-GroupSnapshotsV319Test-652929209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a368e64-86a9-4715-a667-e4ffcaa2f594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:58 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-964127ab-76e0-41c3-900c-99bc998e507b tempest-GroupSnapshotsV319Test-652929209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a368e64-86a9-4715-a667-e4ffcaa2f594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:24:58 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-964127ab-76e0-41c3-900c-99bc998e507b tempest-GroupSnapshotsV319Test-652929209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f988adb-96cc-4e71-a9d1-d76058283e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:24:58 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-964127ab-76e0-41c3-900c-99bc998e507b tempest-GroupSnapshotsV319Test-652929209 None] Volume 26d9be49-d08f-460a-a70f-cd3d4fb9d56d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26d9be49-d08f-460a-a70f-cd3d4fb9d56d', 'volume_size': 1}
Feb 27 01:24:58 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-964127ab-76e0-41c3-900c-99bc998e507b tempest-GroupSnapshotsV319Test-652929209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:24:58 devstack sudo[86695]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:58 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5d1699c6-b1b8-47d6-bea3-116c4e3b5718 tempest-SnapshotsActionsTest-1161199312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.864f055e-6cc0-410f-83c0-64b218ae6d25" returned: 0 in 0.631s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:58 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-5d1699c6-b1b8-47d6-bea3-116c4e3b5718 tempest-SnapshotsActionsTest-1161199312 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83106) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:24:58 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5d1699c6-b1b8-47d6-bea3-116c4e3b5718 tempest-SnapshotsActionsTest-1161199312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.864f055e-6cc0-410f-83c0-64b218ae6d25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.e16aa689-ebe6-4921-9c12-40bb75368671 1G {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:58 devstack sudo[86705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.864f055e-6cc0-410f-83c0-64b218ae6d25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.e16aa689-ebe6-4921-9c12-40bb75368671 1G
Feb 27 01:24:58 devstack sudo[86705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:59 devstack sudo[86700]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:59 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7d4f83ce-b602-48be-8fee-1a9c0feb5690 tempest-SnapshotMetadataTestJSON-912324066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-63d77f76-80a0-49c7-a8fe-0b572565ce70" returned: 0 in 0.578s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:59 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-7d4f83ce-b602-48be-8fee-1a9c0feb5690 tempest-SnapshotMetadataTestJSON-912324066 None] Lock "cinder-quobyte-63d77f76-80a0-49c7-a8fe-0b572565ce70" released by "delete_volume" :: held 1.202s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:24:59 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-7d4f83ce-b602-48be-8fee-1a9c0feb5690 tempest-SnapshotMetadataTestJSON-912324066 None] Created reservations ['fc2c07b9-c84f-487f-aa2c-ae2ed165be37', '5de537ff-e665-48ad-ad68-1d2ad14f800b', '650f0fab-2326-421c-94aa-315c0a2a45ee', 'bd75e9f7-7445-4a0e-82a5-af7c43259595'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:24:59 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-7d4f83ce-b602-48be-8fee-1a9c0feb5690 tempest-SnapshotMetadataTestJSON-912324066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:24:59 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-7d4f83ce-b602-48be-8fee-1a9c0feb5690 tempest-SnapshotMetadataTestJSON-912324066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:24:59 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-7d4f83ce-b602-48be-8fee-1a9c0feb5690 tempest-SnapshotMetadataTestJSON-912324066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:24:59 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-7d4f83ce-b602-48be-8fee-1a9c0feb5690 tempest-SnapshotMetadataTestJSON-912324066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:24:59 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-7d4f83ce-b602-48be-8fee-1a9c0feb5690 tempest-SnapshotMetadataTestJSON-912324066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:24:59 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7d4f83ce-b602-48be-8fee-1a9c0feb5690 tempest-SnapshotMetadataTestJSON-912324066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:59 devstack sudo[86708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:24:59 devstack sudo[86708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:59 devstack sudo[86705]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:59 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5d1699c6-b1b8-47d6-bea3-116c4e3b5718 tempest-SnapshotsActionsTest-1161199312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.864f055e-6cc0-410f-83c0-64b218ae6d25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.e16aa689-ebe6-4921-9c12-40bb75368671 1G" returned: 0 in 0.742s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:59 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5d1699c6-b1b8-47d6-bea3-116c4e3b5718 tempest-SnapshotsActionsTest-1161199312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.864f055e-6cc0-410f-83c0-64b218ae6d25 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.e16aa689-ebe6-4921-9c12-40bb75368671 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:24:59 devstack sudo[86745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.864f055e-6cc0-410f-83c0-64b218ae6d25 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.e16aa689-ebe6-4921-9c12-40bb75368671
Feb 27 01:24:59 devstack sudo[86745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:24:59 devstack sudo[86708]: pam_unix(sudo:session): session closed for user root
Feb 27 01:24:59 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7d4f83ce-b602-48be-8fee-1a9c0feb5690 tempest-SnapshotMetadataTestJSON-912324066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.503s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:24:59 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-7d4f83ce-b602-48be-8fee-1a9c0feb5690 tempest-SnapshotMetadataTestJSON-912324066 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:24:59 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-7d4f83ce-b602-48be-8fee-1a9c0feb5690 tempest-SnapshotMetadataTestJSON-912324066 None] Deleted volume successfully.
Feb 27 01:24:59 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-7d4f83ce-b602-48be-8fee-1a9c0feb5690 tempest-SnapshotMetadataTestJSON-912324066 None] Lock "cinder-63d77f76-80a0-49c7-a8fe-0b572565ce70-delete_volume" released by "delete_volume" :: held 1.914s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:00 devstack sudo[86745]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:00 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5d1699c6-b1b8-47d6-bea3-116c4e3b5718 tempest-SnapshotsActionsTest-1161199312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.864f055e-6cc0-410f-83c0-64b218ae6d25 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.e16aa689-ebe6-4921-9c12-40bb75368671" returned: 0 in 0.471s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:00 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-5d1699c6-b1b8-47d6-bea3-116c4e3b5718 tempest-SnapshotsActionsTest-1161199312 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.e16aa689-ebe6-4921-9c12-40bb75368671 is being set with open permissions: ugo+rw
Feb 27 01:25:00 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5d1699c6-b1b8-47d6-bea3-116c4e3b5718 tempest-SnapshotsActionsTest-1161199312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.e16aa689-ebe6-4921-9c12-40bb75368671 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:00 devstack sudo[86753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.e16aa689-ebe6-4921-9c12-40bb75368671
Feb 27 01:25:00 devstack sudo[86753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:00 devstack sudo[86753]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:00 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5d1699c6-b1b8-47d6-bea3-116c4e3b5718 tempest-SnapshotsActionsTest-1161199312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.e16aa689-ebe6-4921-9c12-40bb75368671" returned: 0 in 0.498s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:00 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-5d1699c6-b1b8-47d6-bea3-116c4e3b5718 tempest-SnapshotsActionsTest-1161199312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.410s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:00 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-964127ab-76e0-41c3-900c-99bc998e507b tempest-GroupSnapshotsV319Test-652929209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.805s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:00 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-964127ab-76e0-41c3-900c-99bc998e507b tempest-GroupSnapshotsV319Test-652929209 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=49170893-5a70-48ea-a49d-2329482380df,created_at=2026-02-27T00:24:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1256294840',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=49170893-5a70-48ea-a49d-2329482380df,host='devstack@QuobyteHD#QuobyteHD',id=26d9be49-d08f-460a-a70f-cd3d4fb9d56d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3973312921949fbac7338ec9ab1c0ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:24:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:24:59Z,use_quota=True,user_id='24db08aced974bc2a19edef8d0822b78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd748d34-deb3-49b2-a97a-c82d5da1c69a),volume_type_id=bd748d34-deb3-49b2-a97a-c82d5da1c69a)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:25:00 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-964127ab-76e0-41c3-900c-99bc998e507b tempest-GroupSnapshotsV319Test-652929209 None] Creating volume 26d9be49-d08f-460a-a70f-cd3d4fb9d56d {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:25:00 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-964127ab-76e0-41c3-900c-99bc998e507b tempest-GroupSnapshotsV319Test-652929209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:00 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-964127ab-76e0-41c3-900c-99bc998e507b tempest-GroupSnapshotsV319Test-652929209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:00 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-964127ab-76e0-41c3-900c-99bc998e507b tempest-GroupSnapshotsV319Test-652929209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:25:00 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-964127ab-76e0-41c3-900c-99bc998e507b tempest-GroupSnapshotsV319Test-652929209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:25:00 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-964127ab-76e0-41c3-900c-99bc998e507b tempest-GroupSnapshotsV319Test-652929209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:00 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-964127ab-76e0-41c3-900c-99bc998e507b tempest-GroupSnapshotsV319Test-652929209 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:25:00 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-964127ab-76e0-41c3-900c-99bc998e507b tempest-GroupSnapshotsV319Test-652929209 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:25:00 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-964127ab-76e0-41c3-900c-99bc998e507b tempest-GroupSnapshotsV319Test-652929209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-26d9be49-d08f-460a-a70f-cd3d4fb9d56d 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:00 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-5d1699c6-b1b8-47d6-bea3-116c4e3b5718 tempest-SnapshotsActionsTest-1161199312 None] Create snapshot completed successfully
Feb 27 01:25:00 devstack sudo[86762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-26d9be49-d08f-460a-a70f-cd3d4fb9d56d 1073741824
Feb 27 01:25:00 devstack sudo[86762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:01 devstack sudo[86762]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:01 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-964127ab-76e0-41c3-900c-99bc998e507b tempest-GroupSnapshotsV319Test-652929209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-26d9be49-d08f-460a-a70f-cd3d4fb9d56d 1073741824" returned: 0 in 0.843s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:01 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-b6b455b5-11e9-486e-be7c-7e5357709d9e tempest-SnapshotsActionsTest-200108673 None] Acquiring lock "cinder-e16aa689-ebe6-4921-9c12-40bb75368671-delete_snapshot" by "delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:01 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-b6b455b5-11e9-486e-be7c-7e5357709d9e tempest-SnapshotsActionsTest-200108673 None] Lock "cinder-e16aa689-ebe6-4921-9c12-40bb75368671-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:01 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-b6b455b5-11e9-486e-be7c-7e5357709d9e tempest-SnapshotsActionsTest-200108673 None] Acquiring lock "cinder-quobyte-f4cb7fea-935f-40f5-8093-ce89f2d2348a" by "delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:01 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-b6b455b5-11e9-486e-be7c-7e5357709d9e tempest-SnapshotsActionsTest-200108673 None] Lock "cinder-quobyte-f4cb7fea-935f-40f5-8093-ce89f2d2348a" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:01 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-b6b455b5-11e9-486e-be7c-7e5357709d9e tempest-SnapshotsActionsTest-200108673 None] Acquiring lock "cinder-quobyte-e16aa689-ebe6-4921-9c12-40bb75368671" by "_delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:01 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-964127ab-76e0-41c3-900c-99bc998e507b tempest-GroupSnapshotsV319Test-652929209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-26d9be49-d08f-460a-a70f-cd3d4fb9d56d {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:01 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-b6b455b5-11e9-486e-be7c-7e5357709d9e tempest-SnapshotsActionsTest-200108673 None] Lock "cinder-quobyte-e16aa689-ebe6-4921-9c12-40bb75368671" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:01 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-b6b455b5-11e9-486e-be7c-7e5357709d9e tempest-SnapshotsActionsTest-200108673 None] Deleting offline snapshot e16aa689-ebe6-4921-9c12-40bb75368671 of volume f4cb7fea-935f-40f5-8093-ce89f2d2348a {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:25:01 devstack sudo[86767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-26d9be49-d08f-460a-a70f-cd3d4fb9d56d
Feb 27 01:25:01 devstack sudo[86767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:01 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-b6b455b5-11e9-486e-be7c-7e5357709d9e tempest-SnapshotsActionsTest-200108673 None] snapshot_file for this snap is: volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.e16aa689-ebe6-4921-9c12-40bb75368671 {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:25:01 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[a650e78d-f232-469e-ba1a-5ae57c21ab53]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:01 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b6b455b5-11e9-486e-be7c-7e5357709d9e tempest-SnapshotsActionsTest-200108673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.e16aa689-ebe6-4921-9c12-40bb75368671 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:01 devstack sudo[86769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.e16aa689-ebe6-4921-9c12-40bb75368671
Feb 27 01:25:01 devstack sudo[86769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:02 devstack sudo[86769]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:02 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b6b455b5-11e9-486e-be7c-7e5357709d9e tempest-SnapshotsActionsTest-200108673 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.e16aa689-ebe6-4921-9c12-40bb75368671" returned: 0 in 0.604s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:02 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-b6b455b5-11e9-486e-be7c-7e5357709d9e tempest-SnapshotsActionsTest-200108673 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83106) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:25:02 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6d576c-8aa0-44a6-a154-d0c4f32bae98]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:02 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b6b455b5-11e9-486e-be7c-7e5357709d9e tempest-SnapshotsActionsTest-200108673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.864f055e-6cc0-410f-83c0-64b218ae6d25 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:02 devstack sudo[86767]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:02 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-964127ab-76e0-41c3-900c-99bc998e507b tempest-GroupSnapshotsV319Test-652929209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-26d9be49-d08f-460a-a70f-cd3d4fb9d56d" returned: 0 in 0.935s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:02 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-964127ab-76e0-41c3-900c-99bc998e507b tempest-GroupSnapshotsV319Test-652929209 None] <== create_volume: return (1862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:25:02 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-964127ab-76e0-41c3-900c-99bc998e507b tempest-GroupSnapshotsV319Test-652929209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.870s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:02 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-964127ab-76e0-41c3-900c-99bc998e507b tempest-GroupSnapshotsV319Test-652929209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f988adb-96cc-4e71-a9d1-d76058283e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26d9be49-d08f-460a-a70f-cd3d4fb9d56d', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:02 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-964127ab-76e0-41c3-900c-99bc998e507b tempest-GroupSnapshotsV319Test-652929209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93ba437a-38bd-46cd-b808-2f61d3aa83c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:02 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-964127ab-76e0-41c3-900c-99bc998e507b tempest-GroupSnapshotsV319Test-652929209 None] Volume volume-26d9be49-d08f-460a-a70f-cd3d4fb9d56d (26d9be49-d08f-460a-a70f-cd3d4fb9d56d): created successfully
Feb 27 01:25:02 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-964127ab-76e0-41c3-900c-99bc998e507b tempest-GroupSnapshotsV319Test-652929209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93ba437a-38bd-46cd-b808-2f61d3aa83c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:02 devstack sudo[86775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.864f055e-6cc0-410f-83c0-64b218ae6d25
Feb 27 01:25:02 devstack sudo[86775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:02 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-964127ab-76e0-41c3-900c-99bc998e507b tempest-GroupSnapshotsV319Test-652929209 None] Flow 'volume_create_manager' (35df8f4a-1e3b-4fb6-b91c-18c7e773c437) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:25:02 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-964127ab-76e0-41c3-900c-99bc998e507b tempest-GroupSnapshotsV319Test-652929209 None] Created volume successfully.
Feb 27 01:25:03 devstack sudo[86775]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:03 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b6b455b5-11e9-486e-be7c-7e5357709d9e tempest-SnapshotsActionsTest-200108673 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.864f055e-6cc0-410f-83c0-64b218ae6d25" returned: 0 in 0.894s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:03 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-b6b455b5-11e9-486e-be7c-7e5357709d9e tempest-SnapshotsActionsTest-200108673 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83106) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:25:03 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b6b455b5-11e9-486e-be7c-7e5357709d9e tempest-SnapshotsActionsTest-200108673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.e16aa689-ebe6-4921-9c12-40bb75368671 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:03 devstack sudo[86782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.e16aa689-ebe6-4921-9c12-40bb75368671
Feb 27 01:25:03 devstack sudo[86782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:03 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-d882ac13-bb1f-45f2-8d99-692a6e5e2a3c tempest-GroupSnapshotsV319Test-652929209 None] GroupSnapshot 2579caa3-290a-459e-b936-1b2e42c545ea: creating.
Feb 27 01:25:03 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d882ac13-bb1f-45f2-8d99-692a6e5e2a3c tempest-GroupSnapshotsV319Test-652929209 None] Group snapshot 2579caa3-290a-459e-b936-1b2e42c545ea: creating. {{(pid=83106) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Feb 27 01:25:03 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-d882ac13-bb1f-45f2-8d99-692a6e5e2a3c tempest-GroupSnapshotsV319Test-652929209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:03 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-d882ac13-bb1f-45f2-8d99-692a6e5e2a3c tempest-GroupSnapshotsV319Test-652929209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:03 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-d882ac13-bb1f-45f2-8d99-692a6e5e2a3c tempest-GroupSnapshotsV319Test-652929209 None] Creating offline snapshot a3d1c981-5fae-46fa-bfff-eac0424a520f of volume 26d9be49-d08f-460a-a70f-cd3d4fb9d56d {{(pid=83106) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:25:03 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c355e5-01d4-4ed4-aa3e-075b4853f599]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:03 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d882ac13-bb1f-45f2-8d99-692a6e5e2a3c tempest-GroupSnapshotsV319Test-652929209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-26d9be49-d08f-460a-a70f-cd3d4fb9d56d {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:03 devstack sudo[86784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-26d9be49-d08f-460a-a70f-cd3d4fb9d56d
Feb 27 01:25:03 devstack sudo[86784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:03 devstack sudo[86782]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:03 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b6b455b5-11e9-486e-be7c-7e5357709d9e tempest-SnapshotsActionsTest-200108673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.e16aa689-ebe6-4921-9c12-40bb75368671" returned: 0 in 0.818s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:03 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b6b455b5-11e9-486e-be7c-7e5357709d9e tempest-SnapshotsActionsTest-200108673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.e16aa689-ebe6-4921-9c12-40bb75368671 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:04 devstack sudo[86789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.e16aa689-ebe6-4921-9c12-40bb75368671
Feb 27 01:25:04 devstack sudo[86789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:04 devstack sudo[86784]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:04 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d882ac13-bb1f-45f2-8d99-692a6e5e2a3c tempest-GroupSnapshotsV319Test-652929209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-26d9be49-d08f-460a-a70f-cd3d4fb9d56d" returned: 0 in 0.702s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:04 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d882ac13-bb1f-45f2-8d99-692a6e5e2a3c tempest-GroupSnapshotsV319Test-652929209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-26d9be49-d08f-460a-a70f-cd3d4fb9d56d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-26d9be49-d08f-460a-a70f-cd3d4fb9d56d.a3d1c981-5fae-46fa-bfff-eac0424a520f 1G {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:04 devstack sudo[86794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-26d9be49-d08f-460a-a70f-cd3d4fb9d56d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-26d9be49-d08f-460a-a70f-cd3d4fb9d56d.a3d1c981-5fae-46fa-bfff-eac0424a520f 1G
Feb 27 01:25:04 devstack sudo[86794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:04 devstack sudo[86789]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:04 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b6b455b5-11e9-486e-be7c-7e5357709d9e tempest-SnapshotsActionsTest-200108673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.e16aa689-ebe6-4921-9c12-40bb75368671" returned: 0 in 0.656s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:04 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-b6b455b5-11e9-486e-be7c-7e5357709d9e tempest-SnapshotsActionsTest-200108673 None] Lock "cinder-quobyte-e16aa689-ebe6-4921-9c12-40bb75368671" released by "_delete_snapshot" :: held 3.071s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:04 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-b6b455b5-11e9-486e-be7c-7e5357709d9e tempest-SnapshotsActionsTest-200108673 None] Lock "cinder-quobyte-f4cb7fea-935f-40f5-8093-ce89f2d2348a" released by "delete_snapshot" :: held 3.116s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:04 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-b6b455b5-11e9-486e-be7c-7e5357709d9e tempest-SnapshotsActionsTest-200108673 None] Created reservations ['8c3d0200-c5c6-4d74-95d6-b15e573c0c8e', '63ef26be-a4ba-4396-b05d-09545633bc19', '7d66201c-9491-4f13-afb7-bec3a8743167', 'ac2ea582-ef37-434b-ad43-9488e5c1bd45'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:25:04 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-b6b455b5-11e9-486e-be7c-7e5357709d9e tempest-SnapshotsActionsTest-200108673 None] Delete snapshot completed successfully.
Feb 27 01:25:04 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-b6b455b5-11e9-486e-be7c-7e5357709d9e tempest-SnapshotsActionsTest-200108673 None] Lock "cinder-e16aa689-ebe6-4921-9c12-40bb75368671-delete_snapshot" released by "delete_snapshot" :: held 3.264s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:04 devstack sudo[86794]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:04 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d882ac13-bb1f-45f2-8d99-692a6e5e2a3c tempest-GroupSnapshotsV319Test-652929209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-26d9be49-d08f-460a-a70f-cd3d4fb9d56d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-26d9be49-d08f-460a-a70f-cd3d4fb9d56d.a3d1c981-5fae-46fa-bfff-eac0424a520f 1G" returned: 0 in 0.715s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:04 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d882ac13-bb1f-45f2-8d99-692a6e5e2a3c tempest-GroupSnapshotsV319Test-652929209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26d9be49-d08f-460a-a70f-cd3d4fb9d56d -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-26d9be49-d08f-460a-a70f-cd3d4fb9d56d.a3d1c981-5fae-46fa-bfff-eac0424a520f {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:04 devstack sudo[86800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26d9be49-d08f-460a-a70f-cd3d4fb9d56d -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-26d9be49-d08f-460a-a70f-cd3d4fb9d56d.a3d1c981-5fae-46fa-bfff-eac0424a520f
Feb 27 01:25:04 devstack sudo[86800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:05 devstack sudo[86800]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:05 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d882ac13-bb1f-45f2-8d99-692a6e5e2a3c tempest-GroupSnapshotsV319Test-652929209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26d9be49-d08f-460a-a70f-cd3d4fb9d56d -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-26d9be49-d08f-460a-a70f-cd3d4fb9d56d.a3d1c981-5fae-46fa-bfff-eac0424a520f" returned: 0 in 0.595s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:05 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-d882ac13-bb1f-45f2-8d99-692a6e5e2a3c tempest-GroupSnapshotsV319Test-652929209 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-26d9be49-d08f-460a-a70f-cd3d4fb9d56d.a3d1c981-5fae-46fa-bfff-eac0424a520f is being set with open permissions: ugo+rw: NotImplementedError
Feb 27 01:25:05 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d882ac13-bb1f-45f2-8d99-692a6e5e2a3c tempest-GroupSnapshotsV319Test-652929209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-26d9be49-d08f-460a-a70f-cd3d4fb9d56d.a3d1c981-5fae-46fa-bfff-eac0424a520f {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:05 devstack sudo[86805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-26d9be49-d08f-460a-a70f-cd3d4fb9d56d.a3d1c981-5fae-46fa-bfff-eac0424a520f
Feb 27 01:25:05 devstack sudo[86805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:05 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-b49a780d-a0f4-4bff-972c-1f57490071c6 tempest-VolumesDeleteCascade-678564053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:25:05 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-b49a780d-a0f4-4bff-972c-1f57490071c6 tempest-VolumesDeleteCascade-678564053 None] Flow 'volume_create_manager' (e86db8d8-0aa2-4d54-8a39-a306370b5fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:25:05 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-b49a780d-a0f4-4bff-972c-1f57490071c6 tempest-VolumesDeleteCascade-678564053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b56a1070-a3c4-41f5-bf9b-43ed1fbd54d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:05 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-b49a780d-a0f4-4bff-972c-1f57490071c6 tempest-VolumesDeleteCascade-678564053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b56a1070-a3c4-41f5-bf9b-43ed1fbd54d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:25:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2058075409',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ea3a222-5c0d-4a87-a3d0-bccd61775b99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e23314fa89a64fb69ef0eeb80359765d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:25:06Z,use_quota=True,user_id='b516876a5a1f4760b83f013927ad30ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:05 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-b49a780d-a0f4-4bff-972c-1f57490071c6 tempest-VolumesDeleteCascade-678564053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bacc74c-6ad7-4e27-b7e2-09b91d29bf90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:05 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-b49a780d-a0f4-4bff-972c-1f57490071c6 tempest-VolumesDeleteCascade-678564053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bacc74c-6ad7-4e27-b7e2-09b91d29bf90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:05 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-b49a780d-a0f4-4bff-972c-1f57490071c6 tempest-VolumesDeleteCascade-678564053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ecf6df8-9f48-4dfd-987a-f232eff02e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:05 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-b49a780d-a0f4-4bff-972c-1f57490071c6 tempest-VolumesDeleteCascade-678564053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ecf6df8-9f48-4dfd-987a-f232eff02e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ea3a222-5c0d-4a87-a3d0-bccd61775b99', 'volume_name': 'volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:05 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-b49a780d-a0f4-4bff-972c-1f57490071c6 tempest-VolumesDeleteCascade-678564053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (818499f9-a56b-4bd7-a991-6f033432f24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:05 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-b49a780d-a0f4-4bff-972c-1f57490071c6 tempest-VolumesDeleteCascade-678564053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (818499f9-a56b-4bd7-a991-6f033432f24c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:05 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-b49a780d-a0f4-4bff-972c-1f57490071c6 tempest-VolumesDeleteCascade-678564053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4b67eff-1fec-4fe0-9f6f-c6fb882bdf4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:05 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-b49a780d-a0f4-4bff-972c-1f57490071c6 tempest-VolumesDeleteCascade-678564053 None] Volume 3ea3a222-5c0d-4a87-a3d0-bccd61775b99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99', 'volume_size': 1}
Feb 27 01:25:05 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-b49a780d-a0f4-4bff-972c-1f57490071c6 tempest-VolumesDeleteCascade-678564053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:05 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-ceaae2ad-6552-4323-a12a-db11ddb42d11 tempest-SnapshotsActionsTest-1161199312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:06 devstack sudo[86805]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:06 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d882ac13-bb1f-45f2-8d99-692a6e5e2a3c tempest-GroupSnapshotsV319Test-652929209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-26d9be49-d08f-460a-a70f-cd3d4fb9d56d.a3d1c981-5fae-46fa-bfff-eac0424a520f" returned: 0 in 0.569s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:06 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d882ac13-bb1f-45f2-8d99-692a6e5e2a3c tempest-GroupSnapshotsV319Test-652929209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-26d9be49-d08f-460a-a70f-cd3d4fb9d56d.info {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:06 devstack sudo[86809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-26d9be49-d08f-460a-a70f-cd3d4fb9d56d.info
Feb 27 01:25:06 devstack sudo[86809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:06 devstack sudo[86809]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:06 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d882ac13-bb1f-45f2-8d99-692a6e5e2a3c tempest-GroupSnapshotsV319Test-652929209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-26d9be49-d08f-460a-a70f-cd3d4fb9d56d.info" returned: 0 in 0.513s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:06 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-d882ac13-bb1f-45f2-8d99-692a6e5e2a3c tempest-GroupSnapshotsV319Test-652929209 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-26d9be49-d08f-460a-a70f-cd3d4fb9d56d.info is being set with open permissions: ugo+rw: NotImplementedError
Feb 27 01:25:06 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d882ac13-bb1f-45f2-8d99-692a6e5e2a3c tempest-GroupSnapshotsV319Test-652929209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-26d9be49-d08f-460a-a70f-cd3d4fb9d56d.info {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:06 devstack sudo[86812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-26d9be49-d08f-460a-a70f-cd3d4fb9d56d.info
Feb 27 01:25:06 devstack sudo[86812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:07 devstack sudo[86812]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:07 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d882ac13-bb1f-45f2-8d99-692a6e5e2a3c tempest-GroupSnapshotsV319Test-652929209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-26d9be49-d08f-460a-a70f-cd3d4fb9d56d.info" returned: 0 in 0.508s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:07 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-d882ac13-bb1f-45f2-8d99-692a6e5e2a3c tempest-GroupSnapshotsV319Test-652929209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.675s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:07 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-b49a780d-a0f4-4bff-972c-1f57490071c6 tempest-VolumesDeleteCascade-678564053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.418s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:07 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-b49a780d-a0f4-4bff-972c-1f57490071c6 tempest-VolumesDeleteCascade-678564053 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:25:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2058075409',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ea3a222-5c0d-4a87-a3d0-bccd61775b99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e23314fa89a64fb69ef0eeb80359765d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:25:06Z,use_quota=True,user_id='b516876a5a1f4760b83f013927ad30ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:25:07 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-b49a780d-a0f4-4bff-972c-1f57490071c6 tempest-VolumesDeleteCascade-678564053 None] Creating volume 3ea3a222-5c0d-4a87-a3d0-bccd61775b99 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:25:07 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-b49a780d-a0f4-4bff-972c-1f57490071c6 tempest-VolumesDeleteCascade-678564053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:07 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-b49a780d-a0f4-4bff-972c-1f57490071c6 tempest-VolumesDeleteCascade-678564053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:07 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-b49a780d-a0f4-4bff-972c-1f57490071c6 tempest-VolumesDeleteCascade-678564053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:25:07 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-b49a780d-a0f4-4bff-972c-1f57490071c6 tempest-VolumesDeleteCascade-678564053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:25:07 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-b49a780d-a0f4-4bff-972c-1f57490071c6 tempest-VolumesDeleteCascade-678564053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:07 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-b49a780d-a0f4-4bff-972c-1f57490071c6 tempest-VolumesDeleteCascade-678564053 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:25:07 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-b49a780d-a0f4-4bff-972c-1f57490071c6 tempest-VolumesDeleteCascade-678564053 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:25:07 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b49a780d-a0f4-4bff-972c-1f57490071c6 tempest-VolumesDeleteCascade-678564053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:07 devstack sudo[86815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99 1073741824
Feb 27 01:25:07 devstack sudo[86815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:07 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-d882ac13-bb1f-45f2-8d99-692a6e5e2a3c tempest-GroupSnapshotsV319Test-652929209 None] group_snapshot 2579caa3-290a-459e-b936-1b2e42c545ea: created successfully
Feb 27 01:25:07 devstack sudo[86815]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:07 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b49a780d-a0f4-4bff-972c-1f57490071c6 tempest-VolumesDeleteCascade-678564053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99 1073741824" returned: 0 in 0.763s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:07 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b49a780d-a0f4-4bff-972c-1f57490071c6 tempest-VolumesDeleteCascade-678564053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:07 devstack sudo[86820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99
Feb 27 01:25:07 devstack sudo[86820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:08 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-21f0e8e4-c342-4b23-a4fe-335d97e16c24 tempest-GroupSnapshotsV319Test-652929209 None] group_snapshot 2579caa3-290a-459e-b936-1b2e42c545ea: deleting
Feb 27 01:25:08 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-21f0e8e4-c342-4b23-a4fe-335d97e16c24 tempest-GroupSnapshotsV319Test-652929209 None] group_snapshot 2579caa3-290a-459e-b936-1b2e42c545ea: deleting {{(pid=83106) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Feb 27 01:25:08 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-21f0e8e4-c342-4b23-a4fe-335d97e16c24 tempest-GroupSnapshotsV319Test-652929209 None] Acquiring lock "cinder-quobyte-26d9be49-d08f-460a-a70f-cd3d4fb9d56d" by "delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:08 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-21f0e8e4-c342-4b23-a4fe-335d97e16c24 tempest-GroupSnapshotsV319Test-652929209 None] Lock "cinder-quobyte-26d9be49-d08f-460a-a70f-cd3d4fb9d56d" acquired by "delete_snapshot" :: waited 0.021s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:08 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-21f0e8e4-c342-4b23-a4fe-335d97e16c24 tempest-GroupSnapshotsV319Test-652929209 None] Acquiring lock "cinder-quobyte-a3d1c981-5fae-46fa-bfff-eac0424a520f" by "_delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:08 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-21f0e8e4-c342-4b23-a4fe-335d97e16c24 tempest-GroupSnapshotsV319Test-652929209 None] Lock "cinder-quobyte-a3d1c981-5fae-46fa-bfff-eac0424a520f" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:08 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-21f0e8e4-c342-4b23-a4fe-335d97e16c24 tempest-GroupSnapshotsV319Test-652929209 None] Deleting offline snapshot a3d1c981-5fae-46fa-bfff-eac0424a520f of volume 26d9be49-d08f-460a-a70f-cd3d4fb9d56d {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:25:08 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-21f0e8e4-c342-4b23-a4fe-335d97e16c24 tempest-GroupSnapshotsV319Test-652929209 None] snapshot_file for this snap is: volume-26d9be49-d08f-460a-a70f-cd3d4fb9d56d.a3d1c981-5fae-46fa-bfff-eac0424a520f {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:25:08 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f657faa-3b6c-46e0-ae1e-8bf463f3c86c]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:08 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-21f0e8e4-c342-4b23-a4fe-335d97e16c24 tempest-GroupSnapshotsV319Test-652929209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-26d9be49-d08f-460a-a70f-cd3d4fb9d56d.a3d1c981-5fae-46fa-bfff-eac0424a520f {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:08 devstack sudo[86822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-26d9be49-d08f-460a-a70f-cd3d4fb9d56d.a3d1c981-5fae-46fa-bfff-eac0424a520f
Feb 27 01:25:08 devstack sudo[86822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:08 devstack sudo[86820]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:08 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b49a780d-a0f4-4bff-972c-1f57490071c6 tempest-VolumesDeleteCascade-678564053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99" returned: 0 in 0.710s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:08 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-b49a780d-a0f4-4bff-972c-1f57490071c6 tempest-VolumesDeleteCascade-678564053 None] <== create_volume: return (1511ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:25:08 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-b49a780d-a0f4-4bff-972c-1f57490071c6 tempest-VolumesDeleteCascade-678564053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.515s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:08 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-ceaae2ad-6552-4323-a12a-db11ddb42d11 tempest-SnapshotsActionsTest-1161199312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.603s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:08 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-b49a780d-a0f4-4bff-972c-1f57490071c6 tempest-VolumesDeleteCascade-678564053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4b67eff-1fec-4fe0-9f6f-c6fb882bdf4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:08 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-b49a780d-a0f4-4bff-972c-1f57490071c6 tempest-VolumesDeleteCascade-678564053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89a2870e-1d83-43c5-9ecb-0fe8ea99d18a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:08 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-ceaae2ad-6552-4323-a12a-db11ddb42d11 tempest-SnapshotsActionsTest-1161199312 None] Creating offline snapshot 897d280c-7bc0-4cf3-857d-4a487905b27c of volume f4cb7fea-935f-40f5-8093-ce89f2d2348a {{(pid=83106) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:25:08 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-b49a780d-a0f4-4bff-972c-1f57490071c6 tempest-VolumesDeleteCascade-678564053 None] Volume volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99 (3ea3a222-5c0d-4a87-a3d0-bccd61775b99): created successfully
Feb 27 01:25:08 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-b49a780d-a0f4-4bff-972c-1f57490071c6 tempest-VolumesDeleteCascade-678564053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89a2870e-1d83-43c5-9ecb-0fe8ea99d18a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:08 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-b49a780d-a0f4-4bff-972c-1f57490071c6 tempest-VolumesDeleteCascade-678564053 None] Flow 'volume_create_manager' (e86db8d8-0aa2-4d54-8a39-a306370b5fd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:25:08 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[e787e1e9-cee2-47f8-979b-23e257d619f8]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:08 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ceaae2ad-6552-4323-a12a-db11ddb42d11 tempest-SnapshotsActionsTest-1161199312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.864f055e-6cc0-410f-83c0-64b218ae6d25 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:08 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-b49a780d-a0f4-4bff-972c-1f57490071c6 tempest-VolumesDeleteCascade-678564053 None] Created volume successfully.
Feb 27 01:25:08 devstack sudo[86828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.864f055e-6cc0-410f-83c0-64b218ae6d25
Feb 27 01:25:08 devstack sudo[86828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:08 devstack sudo[86822]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:08 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-21f0e8e4-c342-4b23-a4fe-335d97e16c24 tempest-GroupSnapshotsV319Test-652929209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-26d9be49-d08f-460a-a70f-cd3d4fb9d56d.a3d1c981-5fae-46fa-bfff-eac0424a520f" returned: 0 in 0.653s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:08 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-21f0e8e4-c342-4b23-a4fe-335d97e16c24 tempest-GroupSnapshotsV319Test-652929209 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26d9be49-d08f-460a-a70f-cd3d4fb9d56d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83106) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:25:08 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[96044d81-d072-4021-af3f-b75bd256c5e4]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:08 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-21f0e8e4-c342-4b23-a4fe-335d97e16c24 tempest-GroupSnapshotsV319Test-652929209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-26d9be49-d08f-460a-a70f-cd3d4fb9d56d {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:08 devstack sudo[86830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-26d9be49-d08f-460a-a70f-cd3d4fb9d56d
Feb 27 01:25:08 devstack sudo[86830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:09 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-1e00fcd5-5f84-49dd-8200-6eff041a42d0 tempest-VolumesDeleteCascade-678564053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:09 devstack sudo[86828]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:09 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ceaae2ad-6552-4323-a12a-db11ddb42d11 tempest-SnapshotsActionsTest-1161199312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.864f055e-6cc0-410f-83c0-64b218ae6d25" returned: 0 in 0.800s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:09 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-ceaae2ad-6552-4323-a12a-db11ddb42d11 tempest-SnapshotsActionsTest-1161199312 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83106) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:25:09 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ceaae2ad-6552-4323-a12a-db11ddb42d11 tempest-SnapshotsActionsTest-1161199312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.864f055e-6cc0-410f-83c0-64b218ae6d25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.897d280c-7bc0-4cf3-857d-4a487905b27c 1G {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:09 devstack sudo[86838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.864f055e-6cc0-410f-83c0-64b218ae6d25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.897d280c-7bc0-4cf3-857d-4a487905b27c 1G
Feb 27 01:25:09 devstack sudo[86838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:09 devstack sudo[86830]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:09 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-21f0e8e4-c342-4b23-a4fe-335d97e16c24 tempest-GroupSnapshotsV319Test-652929209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-26d9be49-d08f-460a-a70f-cd3d4fb9d56d" returned: 0 in 0.762s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:09 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-21f0e8e4-c342-4b23-a4fe-335d97e16c24 tempest-GroupSnapshotsV319Test-652929209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-26d9be49-d08f-460a-a70f-cd3d4fb9d56d.a3d1c981-5fae-46fa-bfff-eac0424a520f {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:09 devstack sudo[86840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-26d9be49-d08f-460a-a70f-cd3d4fb9d56d.a3d1c981-5fae-46fa-bfff-eac0424a520f
Feb 27 01:25:09 devstack sudo[86840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:10 devstack sudo[86840]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:10 devstack sudo[86838]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:10 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-21f0e8e4-c342-4b23-a4fe-335d97e16c24 tempest-GroupSnapshotsV319Test-652929209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-26d9be49-d08f-460a-a70f-cd3d4fb9d56d.a3d1c981-5fae-46fa-bfff-eac0424a520f" returned: 0 in 0.742s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:10 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-21f0e8e4-c342-4b23-a4fe-335d97e16c24 tempest-GroupSnapshotsV319Test-652929209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-26d9be49-d08f-460a-a70f-cd3d4fb9d56d.a3d1c981-5fae-46fa-bfff-eac0424a520f {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:10 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ceaae2ad-6552-4323-a12a-db11ddb42d11 tempest-SnapshotsActionsTest-1161199312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.864f055e-6cc0-410f-83c0-64b218ae6d25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.897d280c-7bc0-4cf3-857d-4a487905b27c 1G" returned: 0 in 0.867s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:10 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ceaae2ad-6552-4323-a12a-db11ddb42d11 tempest-SnapshotsActionsTest-1161199312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.864f055e-6cc0-410f-83c0-64b218ae6d25 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.897d280c-7bc0-4cf3-857d-4a487905b27c {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:10 devstack sudo[86848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-26d9be49-d08f-460a-a70f-cd3d4fb9d56d.a3d1c981-5fae-46fa-bfff-eac0424a520f
Feb 27 01:25:10 devstack sudo[86848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:10 devstack sudo[86849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.864f055e-6cc0-410f-83c0-64b218ae6d25 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.897d280c-7bc0-4cf3-857d-4a487905b27c
Feb 27 01:25:10 devstack sudo[86849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:10 devstack sudo[86848]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:10 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-21f0e8e4-c342-4b23-a4fe-335d97e16c24 tempest-GroupSnapshotsV319Test-652929209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-26d9be49-d08f-460a-a70f-cd3d4fb9d56d.a3d1c981-5fae-46fa-bfff-eac0424a520f" returned: 0 in 0.563s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:10 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-21f0e8e4-c342-4b23-a4fe-335d97e16c24 tempest-GroupSnapshotsV319Test-652929209 None] Lock "cinder-quobyte-a3d1c981-5fae-46fa-bfff-eac0424a520f" released by "_delete_snapshot" :: held 2.798s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:10 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-21f0e8e4-c342-4b23-a4fe-335d97e16c24 tempest-GroupSnapshotsV319Test-652929209 None] Lock "cinder-quobyte-26d9be49-d08f-460a-a70f-cd3d4fb9d56d" released by "delete_snapshot" :: held 2.818s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:11 devstack cinder-volume[83106]: WARNING cinder.quota [None req-21f0e8e4-c342-4b23-a4fe-335d97e16c24 tempest-GroupSnapshotsV319Test-652929209 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1184452837 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1184452837, it is now deprecated. Please use the default quota class for default quota.
Feb 27 01:25:11 devstack cinder-volume[83106]: WARNING cinder.quota [None req-21f0e8e4-c342-4b23-a4fe-335d97e16c24 tempest-GroupSnapshotsV319Test-652929209 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1184452837 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1184452837, it is now deprecated. Please use the default quota class for default quota.
Feb 27 01:25:11 devstack sudo[86849]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:11 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ceaae2ad-6552-4323-a12a-db11ddb42d11 tempest-SnapshotsActionsTest-1161199312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.864f055e-6cc0-410f-83c0-64b218ae6d25 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.897d280c-7bc0-4cf3-857d-4a487905b27c" returned: 0 in 0.672s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:11 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-ceaae2ad-6552-4323-a12a-db11ddb42d11 tempest-SnapshotsActionsTest-1161199312 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.897d280c-7bc0-4cf3-857d-4a487905b27c is being set with open permissions: ugo+rw
Feb 27 01:25:11 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ceaae2ad-6552-4323-a12a-db11ddb42d11 tempest-SnapshotsActionsTest-1161199312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.897d280c-7bc0-4cf3-857d-4a487905b27c {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:11 devstack sudo[86856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.897d280c-7bc0-4cf3-857d-4a487905b27c
Feb 27 01:25:11 devstack sudo[86856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:11 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-21f0e8e4-c342-4b23-a4fe-335d97e16c24 tempest-GroupSnapshotsV319Test-652929209 None] Created reservations ['5d713dfe-e4fe-4274-8eb4-3e1762e5a04b', '6ded46f4-9e64-4ec4-b769-35a2c20b23b8', '9b8c0946-e800-43e9-80b5-e99dbc6ff749', 'de6303d0-4a3d-480e-8552-b31e00327aaa'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:25:11 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-21f0e8e4-c342-4b23-a4fe-335d97e16c24 tempest-GroupSnapshotsV319Test-652929209 None] group_snapshot 2579caa3-290a-459e-b936-1b2e42c545ea: deleted successfully
Feb 27 01:25:11 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-a54ffe6e-150a-47fe-a1bf-ed949ad09b0c tempest-GroupSnapshotsV319Test-652929209 None] Acquiring lock "cinder-quobyte-26d9be49-d08f-460a-a70f-cd3d4fb9d56d" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:11 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-a54ffe6e-150a-47fe-a1bf-ed949ad09b0c tempest-GroupSnapshotsV319Test-652929209 None] Lock "cinder-quobyte-26d9be49-d08f-460a-a70f-cd3d4fb9d56d" acquired by "delete_volume" :: waited 0.011s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:11 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7f2044-7a80-4db9-ad4a-de2e7face31c]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:11 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a54ffe6e-150a-47fe-a1bf-ed949ad09b0c tempest-GroupSnapshotsV319Test-652929209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-26d9be49-d08f-460a-a70f-cd3d4fb9d56d {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:11 devstack sudo[86859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-26d9be49-d08f-460a-a70f-cd3d4fb9d56d
Feb 27 01:25:11 devstack sudo[86859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:11 devstack sudo[86856]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:11 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ceaae2ad-6552-4323-a12a-db11ddb42d11 tempest-SnapshotsActionsTest-1161199312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.897d280c-7bc0-4cf3-857d-4a487905b27c" returned: 0 in 0.657s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:11 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-ceaae2ad-6552-4323-a12a-db11ddb42d11 tempest-SnapshotsActionsTest-1161199312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.125s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:11 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-1e00fcd5-5f84-49dd-8200-6eff041a42d0 tempest-VolumesDeleteCascade-678564053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.638s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:11 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-1e00fcd5-5f84-49dd-8200-6eff041a42d0 tempest-VolumesDeleteCascade-678564053 None] Creating offline snapshot f9c7fe3c-af84-40b4-b6ab-85c7209d64e4 of volume 3ea3a222-5c0d-4a87-a3d0-bccd61775b99 {{(pid=83106) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:25:11 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[73514279-4f41-43a5-b87b-8bf44309d2db]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:11 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-1e00fcd5-5f84-49dd-8200-6eff041a42d0 tempest-VolumesDeleteCascade-678564053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:11 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-ceaae2ad-6552-4323-a12a-db11ddb42d11 tempest-SnapshotsActionsTest-1161199312 None] Create snapshot completed successfully
Feb 27 01:25:11 devstack sudo[86861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99
Feb 27 01:25:11 devstack sudo[86861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:12 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-6289ff3b-e064-42b4-8441-a71c56800a29 tempest-VolumeQuotasAdminTestJSON-251349822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:25:12 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-6289ff3b-e064-42b4-8441-a71c56800a29 tempest-VolumeQuotasAdminTestJSON-251349822 None] Flow 'volume_create_manager' (f3e63f21-4f83-4489-9ed7-6e4eae6e7fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:25:12 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-6289ff3b-e064-42b4-8441-a71c56800a29 tempest-VolumeQuotasAdminTestJSON-251349822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4db9e896-ec71-4961-b4dc-b0a5c8d91487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:12 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-6289ff3b-e064-42b4-8441-a71c56800a29 tempest-VolumeQuotasAdminTestJSON-251349822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4db9e896-ec71-4961-b4dc-b0a5c8d91487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:25:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1618754670',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=044f4492-17ae-4e54-90bb-94482cd43f42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5527e0c4500f41bd90e6e4039a74a43e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:25:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:25:12Z,use_quota=True,user_id='166d842ec17240d9a08fe0eee20988f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:12 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-6289ff3b-e064-42b4-8441-a71c56800a29 tempest-VolumeQuotasAdminTestJSON-251349822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5591b99-a565-40e5-880f-26e309254b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:12 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-6289ff3b-e064-42b4-8441-a71c56800a29 tempest-VolumeQuotasAdminTestJSON-251349822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5591b99-a565-40e5-880f-26e309254b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:12 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-6289ff3b-e064-42b4-8441-a71c56800a29 tempest-VolumeQuotasAdminTestJSON-251349822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ca71e9b-a89c-4a74-8b25-01b5bf502d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:12 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-6289ff3b-e064-42b4-8441-a71c56800a29 tempest-VolumeQuotasAdminTestJSON-251349822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ca71e9b-a89c-4a74-8b25-01b5bf502d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '044f4492-17ae-4e54-90bb-94482cd43f42', 'volume_name': 'volume-044f4492-17ae-4e54-90bb-94482cd43f42', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:12 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-6289ff3b-e064-42b4-8441-a71c56800a29 tempest-VolumeQuotasAdminTestJSON-251349822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60d77bc9-a5b5-4c7a-a90a-5e9c83b810fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:12 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-6289ff3b-e064-42b4-8441-a71c56800a29 tempest-VolumeQuotasAdminTestJSON-251349822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60d77bc9-a5b5-4c7a-a90a-5e9c83b810fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:12 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-6289ff3b-e064-42b4-8441-a71c56800a29 tempest-VolumeQuotasAdminTestJSON-251349822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e845ca2-2427-4930-a168-e409361b865b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:12 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-6289ff3b-e064-42b4-8441-a71c56800a29 tempest-VolumeQuotasAdminTestJSON-251349822 None] Volume 044f4492-17ae-4e54-90bb-94482cd43f42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-044f4492-17ae-4e54-90bb-94482cd43f42', 'volume_size': 1}
Feb 27 01:25:12 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-6289ff3b-e064-42b4-8441-a71c56800a29 tempest-VolumeQuotasAdminTestJSON-251349822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:12 devstack sudo[86859]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:12 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a54ffe6e-150a-47fe-a1bf-ed949ad09b0c tempest-GroupSnapshotsV319Test-652929209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-26d9be49-d08f-460a-a70f-cd3d4fb9d56d" returned: 0 in 0.694s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:12 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a54ffe6e-150a-47fe-a1bf-ed949ad09b0c tempest-GroupSnapshotsV319Test-652929209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-26d9be49-d08f-460a-a70f-cd3d4fb9d56d {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:12 devstack sudo[86866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-26d9be49-d08f-460a-a70f-cd3d4fb9d56d
Feb 27 01:25:12 devstack sudo[86866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:12 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-d1d0724c-892b-46d5-9c63-5258981d7452 tempest-SnapshotsActionsTest-200108673 None] Acquiring lock "cinder-897d280c-7bc0-4cf3-857d-4a487905b27c-delete_snapshot" by "delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:12 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-d1d0724c-892b-46d5-9c63-5258981d7452 tempest-SnapshotsActionsTest-200108673 None] Lock "cinder-897d280c-7bc0-4cf3-857d-4a487905b27c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:12 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-d1d0724c-892b-46d5-9c63-5258981d7452 tempest-SnapshotsActionsTest-200108673 None] Acquiring lock "cinder-quobyte-f4cb7fea-935f-40f5-8093-ce89f2d2348a" by "delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:12 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-d1d0724c-892b-46d5-9c63-5258981d7452 tempest-SnapshotsActionsTest-200108673 None] Lock "cinder-quobyte-f4cb7fea-935f-40f5-8093-ce89f2d2348a" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:12 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-d1d0724c-892b-46d5-9c63-5258981d7452 tempest-SnapshotsActionsTest-200108673 None] Acquiring lock "cinder-quobyte-897d280c-7bc0-4cf3-857d-4a487905b27c" by "_delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:12 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-d1d0724c-892b-46d5-9c63-5258981d7452 tempest-SnapshotsActionsTest-200108673 None] Lock "cinder-quobyte-897d280c-7bc0-4cf3-857d-4a487905b27c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:12 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-d1d0724c-892b-46d5-9c63-5258981d7452 tempest-SnapshotsActionsTest-200108673 None] Deleting offline snapshot 897d280c-7bc0-4cf3-857d-4a487905b27c of volume f4cb7fea-935f-40f5-8093-ce89f2d2348a {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:25:12 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-d1d0724c-892b-46d5-9c63-5258981d7452 tempest-SnapshotsActionsTest-200108673 None] snapshot_file for this snap is: volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.897d280c-7bc0-4cf3-857d-4a487905b27c {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:25:12 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6cae7e6-df69-42a1-a1ec-3244499ba2a8]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:12 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d1d0724c-892b-46d5-9c63-5258981d7452 tempest-SnapshotsActionsTest-200108673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.897d280c-7bc0-4cf3-857d-4a487905b27c {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:12 devstack sudo[86861]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:12 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-1e00fcd5-5f84-49dd-8200-6eff041a42d0 tempest-VolumesDeleteCascade-678564053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99" returned: 0 in 0.759s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:12 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-1e00fcd5-5f84-49dd-8200-6eff041a42d0 tempest-VolumesDeleteCascade-678564053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99.f9c7fe3c-af84-40b4-b6ab-85c7209d64e4 1G {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:12 devstack sudo[86872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99.f9c7fe3c-af84-40b4-b6ab-85c7209d64e4 1G
Feb 27 01:25:12 devstack sudo[86872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:12 devstack sudo[86871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.897d280c-7bc0-4cf3-857d-4a487905b27c
Feb 27 01:25:12 devstack sudo[86871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:12 devstack sudo[86866]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:12 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a54ffe6e-150a-47fe-a1bf-ed949ad09b0c tempest-GroupSnapshotsV319Test-652929209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-26d9be49-d08f-460a-a70f-cd3d4fb9d56d" returned: 0 in 0.630s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:12 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-a54ffe6e-150a-47fe-a1bf-ed949ad09b0c tempest-GroupSnapshotsV319Test-652929209 None] Lock "cinder-quobyte-26d9be49-d08f-460a-a70f-cd3d4fb9d56d" released by "delete_volume" :: held 1.371s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:12 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-a54ffe6e-150a-47fe-a1bf-ed949ad09b0c tempest-GroupSnapshotsV319Test-652929209 None] Created reservations ['f5a84a60-cb9d-4e0a-bb75-91afd3b91a59'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:25:13 devstack cinder-volume[83106]: WARNING cinder.quota [None req-a54ffe6e-150a-47fe-a1bf-ed949ad09b0c tempest-GroupSnapshotsV319Test-652929209 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1184452837 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1184452837, it is now deprecated. Please use the default quota class for default quota.
Feb 27 01:25:13 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-a54ffe6e-150a-47fe-a1bf-ed949ad09b0c tempest-GroupSnapshotsV319Test-652929209 None] Created reservations ['4abbedef-964a-459a-b1d7-d099ef6aa7e7', '12cc0ab3-78ca-46c7-a0ea-40cfc2d31aa5', '3c2b11a4-0c3e-4c45-aa89-bab8f7a0602c', 'daa4a9db-e940-4090-95fd-775df8a41177'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:25:13 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-a54ffe6e-150a-47fe-a1bf-ed949ad09b0c tempest-GroupSnapshotsV319Test-652929209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:13 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-a54ffe6e-150a-47fe-a1bf-ed949ad09b0c tempest-GroupSnapshotsV319Test-652929209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:13 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-a54ffe6e-150a-47fe-a1bf-ed949ad09b0c tempest-GroupSnapshotsV319Test-652929209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:25:13 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-a54ffe6e-150a-47fe-a1bf-ed949ad09b0c tempest-GroupSnapshotsV319Test-652929209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:25:13 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-a54ffe6e-150a-47fe-a1bf-ed949ad09b0c tempest-GroupSnapshotsV319Test-652929209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:13 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a54ffe6e-150a-47fe-a1bf-ed949ad09b0c tempest-GroupSnapshotsV319Test-652929209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:13 devstack sudo[86883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:25:13 devstack sudo[86883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:13 devstack sudo[86872]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:13 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-1e00fcd5-5f84-49dd-8200-6eff041a42d0 tempest-VolumesDeleteCascade-678564053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99.f9c7fe3c-af84-40b4-b6ab-85c7209d64e4 1G" returned: 0 in 0.700s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:13 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-1e00fcd5-5f84-49dd-8200-6eff041a42d0 tempest-VolumesDeleteCascade-678564053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99.f9c7fe3c-af84-40b4-b6ab-85c7209d64e4 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:13 devstack sudo[86871]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:13 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d1d0724c-892b-46d5-9c63-5258981d7452 tempest-SnapshotsActionsTest-200108673 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.897d280c-7bc0-4cf3-857d-4a487905b27c" returned: 0 in 0.735s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:13 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-d1d0724c-892b-46d5-9c63-5258981d7452 tempest-SnapshotsActionsTest-200108673 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83106) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:25:13 devstack sudo[86885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99.f9c7fe3c-af84-40b4-b6ab-85c7209d64e4
Feb 27 01:25:13 devstack sudo[86885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:13 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[560037dc-9965-45b2-b371-ad58ec1e6af5]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:13 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d1d0724c-892b-46d5-9c63-5258981d7452 tempest-SnapshotsActionsTest-200108673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.864f055e-6cc0-410f-83c0-64b218ae6d25 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:13 devstack sudo[86887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.864f055e-6cc0-410f-83c0-64b218ae6d25
Feb 27 01:25:13 devstack sudo[86887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:13 devstack sudo[86883]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:13 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a54ffe6e-150a-47fe-a1bf-ed949ad09b0c tempest-GroupSnapshotsV319Test-652929209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.547s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:13 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-a54ffe6e-150a-47fe-a1bf-ed949ad09b0c tempest-GroupSnapshotsV319Test-652929209 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:25:13 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-a54ffe6e-150a-47fe-a1bf-ed949ad09b0c tempest-GroupSnapshotsV319Test-652929209 None] Delete group completed successfully.
Feb 27 01:25:13 devstack sudo[86885]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:13 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-1e00fcd5-5f84-49dd-8200-6eff041a42d0 tempest-VolumesDeleteCascade-678564053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99.f9c7fe3c-af84-40b4-b6ab-85c7209d64e4" returned: 0 in 0.568s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:13 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-1e00fcd5-5f84-49dd-8200-6eff041a42d0 tempest-VolumesDeleteCascade-678564053 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99.f9c7fe3c-af84-40b4-b6ab-85c7209d64e4 is being set with open permissions: ugo+rw
Feb 27 01:25:13 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-1e00fcd5-5f84-49dd-8200-6eff041a42d0 tempest-VolumesDeleteCascade-678564053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99.f9c7fe3c-af84-40b4-b6ab-85c7209d64e4 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:13 devstack sudo[86896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99.f9c7fe3c-af84-40b4-b6ab-85c7209d64e4
Feb 27 01:25:13 devstack sudo[86896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:13 devstack sudo[86887]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:13 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d1d0724c-892b-46d5-9c63-5258981d7452 tempest-SnapshotsActionsTest-200108673 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.864f055e-6cc0-410f-83c0-64b218ae6d25" returned: 0 in 0.682s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:13 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-d1d0724c-892b-46d5-9c63-5258981d7452 tempest-SnapshotsActionsTest-200108673 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83106) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:25:13 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d1d0724c-892b-46d5-9c63-5258981d7452 tempest-SnapshotsActionsTest-200108673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.897d280c-7bc0-4cf3-857d-4a487905b27c {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:13 devstack sudo[86898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.897d280c-7bc0-4cf3-857d-4a487905b27c
Feb 27 01:25:13 devstack sudo[86898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:14 devstack sudo[86896]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:14 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-1e00fcd5-5f84-49dd-8200-6eff041a42d0 tempest-VolumesDeleteCascade-678564053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99.f9c7fe3c-af84-40b4-b6ab-85c7209d64e4" returned: 0 in 0.652s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:14 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-1e00fcd5-5f84-49dd-8200-6eff041a42d0 tempest-VolumesDeleteCascade-678564053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99.info {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:14 devstack sudo[86904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99.info
Feb 27 01:25:14 devstack sudo[86904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:14 devstack sudo[86898]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:14 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d1d0724c-892b-46d5-9c63-5258981d7452 tempest-SnapshotsActionsTest-200108673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.897d280c-7bc0-4cf3-857d-4a487905b27c" returned: 0 in 0.733s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:14 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d1d0724c-892b-46d5-9c63-5258981d7452 tempest-SnapshotsActionsTest-200108673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.897d280c-7bc0-4cf3-857d-4a487905b27c {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:14 devstack sudo[86906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.897d280c-7bc0-4cf3-857d-4a487905b27c
Feb 27 01:25:14 devstack sudo[86906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:15 devstack sudo[86904]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:15 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-1e00fcd5-5f84-49dd-8200-6eff041a42d0 tempest-VolumesDeleteCascade-678564053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99.info" returned: 0 in 0.699s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:15 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-1e00fcd5-5f84-49dd-8200-6eff041a42d0 tempest-VolumesDeleteCascade-678564053 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99.info is being set with open permissions: ugo+rw
Feb 27 01:25:15 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-1e00fcd5-5f84-49dd-8200-6eff041a42d0 tempest-VolumesDeleteCascade-678564053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99.info {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:15 devstack sudo[86911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99.info
Feb 27 01:25:15 devstack sudo[86911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:15 devstack sudo[86906]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:15 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d1d0724c-892b-46d5-9c63-5258981d7452 tempest-SnapshotsActionsTest-200108673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.897d280c-7bc0-4cf3-857d-4a487905b27c" returned: 0 in 0.579s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:15 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-d1d0724c-892b-46d5-9c63-5258981d7452 tempest-SnapshotsActionsTest-200108673 None] Lock "cinder-quobyte-897d280c-7bc0-4cf3-857d-4a487905b27c" released by "_delete_snapshot" :: held 2.839s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:15 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-d1d0724c-892b-46d5-9c63-5258981d7452 tempest-SnapshotsActionsTest-200108673 None] Lock "cinder-quobyte-f4cb7fea-935f-40f5-8093-ce89f2d2348a" released by "delete_snapshot" :: held 2.859s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:15 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-d1d0724c-892b-46d5-9c63-5258981d7452 tempest-SnapshotsActionsTest-200108673 None] Created reservations ['8ad8c1c5-0bac-49c3-a451-5f696b4b6a05', 'c00e3950-11c9-4aa3-8f57-0ba922e93744', 'eb604381-388c-4898-a81a-396bdba5788c', '70bf6082-6b55-4928-b21c-1c99cac07f4d'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:25:15 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-d1d0724c-892b-46d5-9c63-5258981d7452 tempest-SnapshotsActionsTest-200108673 None] Delete snapshot completed successfully.
Feb 27 01:25:15 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-d1d0724c-892b-46d5-9c63-5258981d7452 tempest-SnapshotsActionsTest-200108673 None] Lock "cinder-897d280c-7bc0-4cf3-857d-4a487905b27c-delete_snapshot" released by "delete_snapshot" :: held 3.023s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:15 devstack sudo[86911]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:15 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-1e00fcd5-5f84-49dd-8200-6eff041a42d0 tempest-VolumesDeleteCascade-678564053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99.info" returned: 0 in 0.657s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:15 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-1e00fcd5-5f84-49dd-8200-6eff041a42d0 tempest-VolumesDeleteCascade-678564053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.133s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:15 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-6289ff3b-e064-42b4-8441-a71c56800a29 tempest-VolumeQuotasAdminTestJSON-251349822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.604s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:15 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-6289ff3b-e064-42b4-8441-a71c56800a29 tempest-VolumeQuotasAdminTestJSON-251349822 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:25:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1618754670',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=044f4492-17ae-4e54-90bb-94482cd43f42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5527e0c4500f41bd90e6e4039a74a43e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:25:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:25:12Z,use_quota=True,user_id='166d842ec17240d9a08fe0eee20988f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:25:15 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-6289ff3b-e064-42b4-8441-a71c56800a29 tempest-VolumeQuotasAdminTestJSON-251349822 None] Creating volume 044f4492-17ae-4e54-90bb-94482cd43f42 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:25:15 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-6289ff3b-e064-42b4-8441-a71c56800a29 tempest-VolumeQuotasAdminTestJSON-251349822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:15 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-6289ff3b-e064-42b4-8441-a71c56800a29 tempest-VolumeQuotasAdminTestJSON-251349822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:15 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-6289ff3b-e064-42b4-8441-a71c56800a29 tempest-VolumeQuotasAdminTestJSON-251349822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:25:15 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-6289ff3b-e064-42b4-8441-a71c56800a29 tempest-VolumeQuotasAdminTestJSON-251349822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:25:15 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-6289ff3b-e064-42b4-8441-a71c56800a29 tempest-VolumeQuotasAdminTestJSON-251349822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:15 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-6289ff3b-e064-42b4-8441-a71c56800a29 tempest-VolumeQuotasAdminTestJSON-251349822 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:25:15 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-6289ff3b-e064-42b4-8441-a71c56800a29 tempest-VolumeQuotasAdminTestJSON-251349822 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:25:15 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-6289ff3b-e064-42b4-8441-a71c56800a29 tempest-VolumeQuotasAdminTestJSON-251349822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-044f4492-17ae-4e54-90bb-94482cd43f42 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:15 devstack sudo[86914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-044f4492-17ae-4e54-90bb-94482cd43f42 1073741824
Feb 27 01:25:15 devstack sudo[86914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:15 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-1e00fcd5-5f84-49dd-8200-6eff041a42d0 tempest-VolumesDeleteCascade-678564053 None] Create snapshot completed successfully
Feb 27 01:25:15 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-8c1e4b4a-3b03-47f3-b2f7-684fdfaa3e67 tempest-SnapshotsActionsTest-1161199312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:16 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-426b5adc-4366-4cf4-9723-67ed3759a46a tempest-VolumesDeleteCascade-678564053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:16 devstack sudo[86914]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:16 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-6289ff3b-e064-42b4-8441-a71c56800a29 tempest-VolumeQuotasAdminTestJSON-251349822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-044f4492-17ae-4e54-90bb-94482cd43f42 1073741824" returned: 0 in 0.755s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:16 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-6289ff3b-e064-42b4-8441-a71c56800a29 tempest-VolumeQuotasAdminTestJSON-251349822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-044f4492-17ae-4e54-90bb-94482cd43f42 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:16 devstack sudo[86919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-044f4492-17ae-4e54-90bb-94482cd43f42
Feb 27 01:25:16 devstack sudo[86919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:17 devstack sudo[86919]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:17 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-6289ff3b-e064-42b4-8441-a71c56800a29 tempest-VolumeQuotasAdminTestJSON-251349822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-044f4492-17ae-4e54-90bb-94482cd43f42" returned: 0 in 0.567s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:17 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-6289ff3b-e064-42b4-8441-a71c56800a29 tempest-VolumeQuotasAdminTestJSON-251349822 None] <== create_volume: return (1363ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:25:17 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-6289ff3b-e064-42b4-8441-a71c56800a29 tempest-VolumeQuotasAdminTestJSON-251349822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.366s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:17 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-8c1e4b4a-3b03-47f3-b2f7-684fdfaa3e67 tempest-SnapshotsActionsTest-1161199312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.293s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:17 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-6289ff3b-e064-42b4-8441-a71c56800a29 tempest-VolumeQuotasAdminTestJSON-251349822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e845ca2-2427-4930-a168-e409361b865b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-044f4492-17ae-4e54-90bb-94482cd43f42', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:17 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-6289ff3b-e064-42b4-8441-a71c56800a29 tempest-VolumeQuotasAdminTestJSON-251349822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8ae874e-f6d0-4826-ba18-0ec6e954e42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:17 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-6289ff3b-e064-42b4-8441-a71c56800a29 tempest-VolumeQuotasAdminTestJSON-251349822 None] Volume volume-044f4492-17ae-4e54-90bb-94482cd43f42 (044f4492-17ae-4e54-90bb-94482cd43f42): created successfully
Feb 27 01:25:17 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-6289ff3b-e064-42b4-8441-a71c56800a29 tempest-VolumeQuotasAdminTestJSON-251349822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8ae874e-f6d0-4826-ba18-0ec6e954e42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:17 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-6289ff3b-e064-42b4-8441-a71c56800a29 tempest-VolumeQuotasAdminTestJSON-251349822 None] Flow 'volume_create_manager' (f3e63f21-4f83-4489-9ed7-6e4eae6e7fde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:25:17 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-6289ff3b-e064-42b4-8441-a71c56800a29 tempest-VolumeQuotasAdminTestJSON-251349822 None] Created volume successfully.
Feb 27 01:25:17 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-8c1e4b4a-3b03-47f3-b2f7-684fdfaa3e67 tempest-SnapshotsActionsTest-1161199312 None] Creating offline snapshot 19991da7-21e1-46c5-8562-be90eb34bf62 of volume f4cb7fea-935f-40f5-8093-ce89f2d2348a {{(pid=83106) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:25:17 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff10638-83cf-423e-8121-c8561ce44ad0]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:17 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-8c1e4b4a-3b03-47f3-b2f7-684fdfaa3e67 tempest-SnapshotsActionsTest-1161199312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.864f055e-6cc0-410f-83c0-64b218ae6d25 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:17 devstack sudo[86922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.864f055e-6cc0-410f-83c0-64b218ae6d25
Feb 27 01:25:17 devstack sudo[86922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:17 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-3365f9e8-1abf-4d60-b6a4-54208a0cd05a tempest-VolumeQuotasAdminTestJSON-251349822 None] Acquiring lock "cinder-044f4492-17ae-4e54-90bb-94482cd43f42-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:17 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-3365f9e8-1abf-4d60-b6a4-54208a0cd05a tempest-VolumeQuotasAdminTestJSON-251349822 None] Lock "cinder-044f4492-17ae-4e54-90bb-94482cd43f42-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:17 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-3365f9e8-1abf-4d60-b6a4-54208a0cd05a tempest-VolumeQuotasAdminTestJSON-251349822 None] Acquiring lock "cinder-quobyte-044f4492-17ae-4e54-90bb-94482cd43f42" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:17 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-3365f9e8-1abf-4d60-b6a4-54208a0cd05a tempest-VolumeQuotasAdminTestJSON-251349822 None] Lock "cinder-quobyte-044f4492-17ae-4e54-90bb-94482cd43f42" acquired by "delete_volume" :: waited 0.011s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:17 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f668019-0bab-4b49-a0ee-67812abf4de3]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:17 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-3365f9e8-1abf-4d60-b6a4-54208a0cd05a tempest-VolumeQuotasAdminTestJSON-251349822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-044f4492-17ae-4e54-90bb-94482cd43f42 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:17 devstack sudo[86924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-044f4492-17ae-4e54-90bb-94482cd43f42
Feb 27 01:25:17 devstack sudo[86924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:18 devstack sudo[86922]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:18 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-8c1e4b4a-3b03-47f3-b2f7-684fdfaa3e67 tempest-SnapshotsActionsTest-1161199312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.864f055e-6cc0-410f-83c0-64b218ae6d25" returned: 0 in 0.764s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:18 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-8c1e4b4a-3b03-47f3-b2f7-684fdfaa3e67 tempest-SnapshotsActionsTest-1161199312 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83106) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:25:18 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-8c1e4b4a-3b03-47f3-b2f7-684fdfaa3e67 tempest-SnapshotsActionsTest-1161199312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.864f055e-6cc0-410f-83c0-64b218ae6d25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.19991da7-21e1-46c5-8562-be90eb34bf62 1G {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:18 devstack sudo[86929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.864f055e-6cc0-410f-83c0-64b218ae6d25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.19991da7-21e1-46c5-8562-be90eb34bf62 1G
Feb 27 01:25:18 devstack sudo[86929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:18 devstack sudo[86924]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:18 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-3365f9e8-1abf-4d60-b6a4-54208a0cd05a tempest-VolumeQuotasAdminTestJSON-251349822 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-044f4492-17ae-4e54-90bb-94482cd43f42" returned: 0 in 0.827s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:18 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-3365f9e8-1abf-4d60-b6a4-54208a0cd05a tempest-VolumeQuotasAdminTestJSON-251349822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-044f4492-17ae-4e54-90bb-94482cd43f42 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:18 devstack sudo[86934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-044f4492-17ae-4e54-90bb-94482cd43f42
Feb 27 01:25:18 devstack sudo[86934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:18 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-80ed6ae8-fe16-4209-9c73-9e4f22ba9af9 tempest-GroupsTest-1998620927 None] Group tempest-Group1-44818193: creating
Feb 27 01:25:18 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-80ed6ae8-fe16-4209-9c73-9e4f22ba9af9 tempest-GroupsTest-1998620927 None] Group tempest-Group1-44818193: created successfully
Feb 27 01:25:18 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-80ed6ae8-fe16-4209-9c73-9e4f22ba9af9 tempest-GroupsTest-1998620927 None] Create group completed successfully.
Feb 27 01:25:18 devstack sudo[86929]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:18 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-8c1e4b4a-3b03-47f3-b2f7-684fdfaa3e67 tempest-SnapshotsActionsTest-1161199312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.864f055e-6cc0-410f-83c0-64b218ae6d25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.19991da7-21e1-46c5-8562-be90eb34bf62 1G" returned: 0 in 0.853s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:18 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-8c1e4b4a-3b03-47f3-b2f7-684fdfaa3e67 tempest-SnapshotsActionsTest-1161199312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.864f055e-6cc0-410f-83c0-64b218ae6d25 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.19991da7-21e1-46c5-8562-be90eb34bf62 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:18 devstack sudo[86939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.864f055e-6cc0-410f-83c0-64b218ae6d25 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.19991da7-21e1-46c5-8562-be90eb34bf62
Feb 27 01:25:18 devstack sudo[86939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:19 devstack sudo[86934]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:19 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-3365f9e8-1abf-4d60-b6a4-54208a0cd05a tempest-VolumeQuotasAdminTestJSON-251349822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-044f4492-17ae-4e54-90bb-94482cd43f42" returned: 0 in 0.662s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:19 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-3365f9e8-1abf-4d60-b6a4-54208a0cd05a tempest-VolumeQuotasAdminTestJSON-251349822 None] Lock "cinder-quobyte-044f4492-17ae-4e54-90bb-94482cd43f42" released by "delete_volume" :: held 1.523s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:19 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-3365f9e8-1abf-4d60-b6a4-54208a0cd05a tempest-VolumeQuotasAdminTestJSON-251349822 None] Created reservations ['9a33bc54-e460-44eb-8301-718a27a7e543', '7826045d-4825-44de-b1f4-562eabfb8940', 'a57e1dd1-ae2b-4b6a-bd94-0c9d8b993afa', 'e76ff9f2-c728-4480-8e96-723b1c0e037a'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:25:19 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-3365f9e8-1abf-4d60-b6a4-54208a0cd05a tempest-VolumeQuotasAdminTestJSON-251349822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:19 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-3365f9e8-1abf-4d60-b6a4-54208a0cd05a tempest-VolumeQuotasAdminTestJSON-251349822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:19 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-3365f9e8-1abf-4d60-b6a4-54208a0cd05a tempest-VolumeQuotasAdminTestJSON-251349822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:25:19 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-3365f9e8-1abf-4d60-b6a4-54208a0cd05a tempest-VolumeQuotasAdminTestJSON-251349822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:25:19 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-3365f9e8-1abf-4d60-b6a4-54208a0cd05a tempest-VolumeQuotasAdminTestJSON-251349822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:19 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-3365f9e8-1abf-4d60-b6a4-54208a0cd05a tempest-VolumeQuotasAdminTestJSON-251349822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:19 devstack sudo[86942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:25:19 devstack sudo[86942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:19 devstack sudo[86939]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:19 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-8c1e4b4a-3b03-47f3-b2f7-684fdfaa3e67 tempest-SnapshotsActionsTest-1161199312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.864f055e-6cc0-410f-83c0-64b218ae6d25 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.19991da7-21e1-46c5-8562-be90eb34bf62" returned: 0 in 0.590s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:19 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-8c1e4b4a-3b03-47f3-b2f7-684fdfaa3e67 tempest-SnapshotsActionsTest-1161199312 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.19991da7-21e1-46c5-8562-be90eb34bf62 is being set with open permissions: ugo+rw
Feb 27 01:25:19 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-8c1e4b4a-3b03-47f3-b2f7-684fdfaa3e67 tempest-SnapshotsActionsTest-1161199312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.19991da7-21e1-46c5-8562-be90eb34bf62 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:19 devstack sudo[86947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.19991da7-21e1-46c5-8562-be90eb34bf62
Feb 27 01:25:19 devstack sudo[86947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:19 devstack sudo[86942]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:19 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-3365f9e8-1abf-4d60-b6a4-54208a0cd05a tempest-VolumeQuotasAdminTestJSON-251349822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.557s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:19 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-3365f9e8-1abf-4d60-b6a4-54208a0cd05a tempest-VolumeQuotasAdminTestJSON-251349822 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:25:19 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-3365f9e8-1abf-4d60-b6a4-54208a0cd05a tempest-VolumeQuotasAdminTestJSON-251349822 None] Deleted volume successfully.
Feb 27 01:25:19 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-f1fb8640-0890-4504-962b-ca9237b2321a tempest-GroupsTest-1998620927 None] Group tempest-Group2-2011553655: creating
Feb 27 01:25:19 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-3365f9e8-1abf-4d60-b6a4-54208a0cd05a tempest-VolumeQuotasAdminTestJSON-251349822 None] Lock "cinder-044f4492-17ae-4e54-90bb-94482cd43f42-delete_volume" released by "delete_volume" :: held 2.331s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:19 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-f1fb8640-0890-4504-962b-ca9237b2321a tempest-GroupsTest-1998620927 None] Group tempest-Group2-2011553655: created successfully
Feb 27 01:25:19 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-f1fb8640-0890-4504-962b-ca9237b2321a tempest-GroupsTest-1998620927 None] Create group completed successfully.
Feb 27 01:25:20 devstack sudo[86947]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:20 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-8c1e4b4a-3b03-47f3-b2f7-684fdfaa3e67 tempest-SnapshotsActionsTest-1161199312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.19991da7-21e1-46c5-8562-be90eb34bf62" returned: 0 in 0.639s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:20 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-8c1e4b4a-3b03-47f3-b2f7-684fdfaa3e67 tempest-SnapshotsActionsTest-1161199312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.958s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:20 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-426b5adc-4366-4cf4-9723-67ed3759a46a tempest-VolumesDeleteCascade-678564053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.581s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:20 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-426b5adc-4366-4cf4-9723-67ed3759a46a tempest-VolumesDeleteCascade-678564053 None] Creating offline snapshot d888ae91-7023-47fc-8dee-3e202a39e508 of volume 3ea3a222-5c0d-4a87-a3d0-bccd61775b99 {{(pid=83106) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:25:20 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[c582caae-18ff-40f6-934a-42d45504a2c6]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:20 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-426b5adc-4366-4cf4-9723-67ed3759a46a tempest-VolumesDeleteCascade-678564053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99.f9c7fe3c-af84-40b4-b6ab-85c7209d64e4 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:20 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3fcdbd5-f759-4f91-acb1-7e01be790210 tempest-VolumeQuotasAdminTestJSON-251349822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:25:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a3fcdbd5-f759-4f91-acb1-7e01be790210 tempest-VolumeQuotasAdminTestJSON-251349822 None] Flow 'volume_create_manager' (1cda0cad-1ae6-4a54-ba3d-651d7dc5b4b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:25:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a3fcdbd5-f759-4f91-acb1-7e01be790210 tempest-VolumeQuotasAdminTestJSON-251349822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a81a94b6-1c33-4993-bce6-c7f03e9c2617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:20 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-8c1e4b4a-3b03-47f3-b2f7-684fdfaa3e67 tempest-SnapshotsActionsTest-1161199312 None] Create snapshot completed successfully
Feb 27 01:25:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a3fcdbd5-f759-4f91-acb1-7e01be790210 tempest-VolumeQuotasAdminTestJSON-251349822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a81a94b6-1c33-4993-bce6-c7f03e9c2617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:25:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1982709706',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=600d089c-d591-4db7-ab9e-93a6eea4a481,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5527e0c4500f41bd90e6e4039a74a43e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:25:20Z,use_quota=True,user_id='166d842ec17240d9a08fe0eee20988f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a3fcdbd5-f759-4f91-acb1-7e01be790210 tempest-VolumeQuotasAdminTestJSON-251349822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ffad52f-2346-424e-809c-eabdb262fb93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a3fcdbd5-f759-4f91-acb1-7e01be790210 tempest-VolumeQuotasAdminTestJSON-251349822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ffad52f-2346-424e-809c-eabdb262fb93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a3fcdbd5-f759-4f91-acb1-7e01be790210 tempest-VolumeQuotasAdminTestJSON-251349822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98a241e1-de6e-4da3-91e6-fc0154ca5860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:20 devstack sudo[86975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99.f9c7fe3c-af84-40b4-b6ab-85c7209d64e4
Feb 27 01:25:20 devstack sudo[86975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a3fcdbd5-f759-4f91-acb1-7e01be790210 tempest-VolumeQuotasAdminTestJSON-251349822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98a241e1-de6e-4da3-91e6-fc0154ca5860) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '600d089c-d591-4db7-ab9e-93a6eea4a481', 'volume_name': 'volume-600d089c-d591-4db7-ab9e-93a6eea4a481', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a3fcdbd5-f759-4f91-acb1-7e01be790210 tempest-VolumeQuotasAdminTestJSON-251349822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b4bf34e-bf1a-4080-9881-b14cfb910dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a3fcdbd5-f759-4f91-acb1-7e01be790210 tempest-VolumeQuotasAdminTestJSON-251349822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b4bf34e-bf1a-4080-9881-b14cfb910dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a3fcdbd5-f759-4f91-acb1-7e01be790210 tempest-VolumeQuotasAdminTestJSON-251349822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77f9d012-467b-4279-8a74-8efe2be92ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:20 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-a3fcdbd5-f759-4f91-acb1-7e01be790210 tempest-VolumeQuotasAdminTestJSON-251349822 None] Volume 600d089c-d591-4db7-ab9e-93a6eea4a481: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-600d089c-d591-4db7-ab9e-93a6eea4a481', 'volume_size': 1}
Feb 27 01:25:20 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-a3fcdbd5-f759-4f91-acb1-7e01be790210 tempest-VolumeQuotasAdminTestJSON-251349822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:20 devstack sudo[86975]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:20 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-426b5adc-4366-4cf4-9723-67ed3759a46a tempest-VolumesDeleteCascade-678564053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99.f9c7fe3c-af84-40b4-b6ab-85c7209d64e4" returned: 0 in 0.645s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:20 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-426b5adc-4366-4cf4-9723-67ed3759a46a tempest-VolumesDeleteCascade-678564053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83106) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:25:20 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-426b5adc-4366-4cf4-9723-67ed3759a46a tempest-VolumesDeleteCascade-678564053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99.f9c7fe3c-af84-40b4-b6ab-85c7209d64e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99.d888ae91-7023-47fc-8dee-3e202a39e508 1G {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:20 devstack sudo[87184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99.f9c7fe3c-af84-40b4-b6ab-85c7209d64e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99.d888ae91-7023-47fc-8dee-3e202a39e508 1G
Feb 27 01:25:20 devstack sudo[87184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:21 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-fd17667d-09cc-4775-ba1d-b09a0c8fe411 tempest-SnapshotsActionsTest-200108673 None] Acquiring lock "cinder-19991da7-21e1-46c5-8562-be90eb34bf62-delete_snapshot" by "delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:21 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-fd17667d-09cc-4775-ba1d-b09a0c8fe411 tempest-SnapshotsActionsTest-200108673 None] Lock "cinder-19991da7-21e1-46c5-8562-be90eb34bf62-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:21 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-fd17667d-09cc-4775-ba1d-b09a0c8fe411 tempest-SnapshotsActionsTest-200108673 None] Acquiring lock "cinder-quobyte-f4cb7fea-935f-40f5-8093-ce89f2d2348a" by "delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:21 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-fd17667d-09cc-4775-ba1d-b09a0c8fe411 tempest-SnapshotsActionsTest-200108673 None] Lock "cinder-quobyte-f4cb7fea-935f-40f5-8093-ce89f2d2348a" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:21 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-fd17667d-09cc-4775-ba1d-b09a0c8fe411 tempest-SnapshotsActionsTest-200108673 None] Acquiring lock "cinder-quobyte-19991da7-21e1-46c5-8562-be90eb34bf62" by "_delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:21 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-fd17667d-09cc-4775-ba1d-b09a0c8fe411 tempest-SnapshotsActionsTest-200108673 None] Lock "cinder-quobyte-19991da7-21e1-46c5-8562-be90eb34bf62" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:21 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-fd17667d-09cc-4775-ba1d-b09a0c8fe411 tempest-SnapshotsActionsTest-200108673 None] Deleting offline snapshot 19991da7-21e1-46c5-8562-be90eb34bf62 of volume f4cb7fea-935f-40f5-8093-ce89f2d2348a {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:25:21 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-fd17667d-09cc-4775-ba1d-b09a0c8fe411 tempest-SnapshotsActionsTest-200108673 None] snapshot_file for this snap is: volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.19991da7-21e1-46c5-8562-be90eb34bf62 {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:25:21 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1ae2cf-e9c6-4a40-a869-07d2e7e25cf4]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:21 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-fd17667d-09cc-4775-ba1d-b09a0c8fe411 tempest-SnapshotsActionsTest-200108673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.19991da7-21e1-46c5-8562-be90eb34bf62 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:21 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d0cf259-cf5f-4c13-bf2d-3761df7f44f2 tempest-GroupsTest-1998620927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:25:21 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1d0cf259-cf5f-4c13-bf2d-3761df7f44f2 tempest-GroupsTest-1998620927 None] Flow 'volume_create_manager' (2f6c5623-6e1f-48a9-b165-dbd191128ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:25:21 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1d0cf259-cf5f-4c13-bf2d-3761df7f44f2 tempest-GroupsTest-1998620927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01ed6cb3-3da7-419a-bc2b-f397bec7bf02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:21 devstack sudo[87184]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:21 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1d0cf259-cf5f-4c13-bf2d-3761df7f44f2 tempest-GroupsTest-1998620927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01ed6cb3-3da7-419a-bc2b-f397bec7bf02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1035227683',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8646e1cc-a177-4aaa-83e2-4ae1c421c954,host='devstack@QuobyteHD#QuobyteHD',id=36736644-2d0a-4566-b9c6-15fa1f94a709,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd01644ed2e94ed99424631bd3db4d45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:25:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:25:21Z,use_quota=True,user_id='ec57153f08474572b49ba7aea3c8fb20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60274133-438e-4320-8789-4cd4ebbb9aed),volume_type_id=60274133-438e-4320-8789-4cd4ebbb9aed)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:21 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1d0cf259-cf5f-4c13-bf2d-3761df7f44f2 tempest-GroupsTest-1998620927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bcc69a5-5f8c-4865-b6e6-5003333239a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:21 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1d0cf259-cf5f-4c13-bf2d-3761df7f44f2 tempest-GroupsTest-1998620927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bcc69a5-5f8c-4865-b6e6-5003333239a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:21 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1d0cf259-cf5f-4c13-bf2d-3761df7f44f2 tempest-GroupsTest-1998620927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad45f425-6ecf-420c-b3f7-d316cd14297b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:21 devstack sudo[87189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.19991da7-21e1-46c5-8562-be90eb34bf62
Feb 27 01:25:21 devstack sudo[87189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:21 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1d0cf259-cf5f-4c13-bf2d-3761df7f44f2 tempest-GroupsTest-1998620927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad45f425-6ecf-420c-b3f7-d316cd14297b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36736644-2d0a-4566-b9c6-15fa1f94a709', 'volume_name': 'volume-36736644-2d0a-4566-b9c6-15fa1f94a709', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:21 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1d0cf259-cf5f-4c13-bf2d-3761df7f44f2 tempest-GroupsTest-1998620927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30980afe-24d4-4003-9bc9-3c06db2a0250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:21 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1d0cf259-cf5f-4c13-bf2d-3761df7f44f2 tempest-GroupsTest-1998620927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30980afe-24d4-4003-9bc9-3c06db2a0250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:21 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1d0cf259-cf5f-4c13-bf2d-3761df7f44f2 tempest-GroupsTest-1998620927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dc72c3d-fd8a-4ef0-a661-b757a104968d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:21 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-1d0cf259-cf5f-4c13-bf2d-3761df7f44f2 tempest-GroupsTest-1998620927 None] Volume 36736644-2d0a-4566-b9c6-15fa1f94a709: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36736644-2d0a-4566-b9c6-15fa1f94a709', 'volume_size': 1}
Feb 27 01:25:21 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-1d0cf259-cf5f-4c13-bf2d-3761df7f44f2 tempest-GroupsTest-1998620927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:21 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-426b5adc-4366-4cf4-9723-67ed3759a46a tempest-VolumesDeleteCascade-678564053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99.f9c7fe3c-af84-40b4-b6ab-85c7209d64e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99.d888ae91-7023-47fc-8dee-3e202a39e508 1G" returned: 0 in 0.635s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:21 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-426b5adc-4366-4cf4-9723-67ed3759a46a tempest-VolumesDeleteCascade-678564053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99.f9c7fe3c-af84-40b4-b6ab-85c7209d64e4 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99.d888ae91-7023-47fc-8dee-3e202a39e508 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:21 devstack sudo[87191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99.f9c7fe3c-af84-40b4-b6ab-85c7209d64e4 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99.d888ae91-7023-47fc-8dee-3e202a39e508
Feb 27 01:25:21 devstack sudo[87191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:22 devstack sudo[87189]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:22 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-fd17667d-09cc-4775-ba1d-b09a0c8fe411 tempest-SnapshotsActionsTest-200108673 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.19991da7-21e1-46c5-8562-be90eb34bf62" returned: 0 in 0.572s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:22 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-fd17667d-09cc-4775-ba1d-b09a0c8fe411 tempest-SnapshotsActionsTest-200108673 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83106) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:25:22 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[02233d42-1a11-4aa4-aeb6-388d1b1c9567]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:22 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-fd17667d-09cc-4775-ba1d-b09a0c8fe411 tempest-SnapshotsActionsTest-200108673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.864f055e-6cc0-410f-83c0-64b218ae6d25 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:22 devstack sudo[87191]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:22 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-426b5adc-4366-4cf4-9723-67ed3759a46a tempest-VolumesDeleteCascade-678564053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99.f9c7fe3c-af84-40b4-b6ab-85c7209d64e4 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99.d888ae91-7023-47fc-8dee-3e202a39e508" returned: 0 in 0.511s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:22 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-426b5adc-4366-4cf4-9723-67ed3759a46a tempest-VolumesDeleteCascade-678564053 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99.d888ae91-7023-47fc-8dee-3e202a39e508 is being set with open permissions: ugo+rw
Feb 27 01:25:22 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-426b5adc-4366-4cf4-9723-67ed3759a46a tempest-VolumesDeleteCascade-678564053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99.d888ae91-7023-47fc-8dee-3e202a39e508 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:22 devstack sudo[87200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99.d888ae91-7023-47fc-8dee-3e202a39e508
Feb 27 01:25:22 devstack sudo[87200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:22 devstack sudo[87199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.864f055e-6cc0-410f-83c0-64b218ae6d25
Feb 27 01:25:22 devstack sudo[87199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:22 devstack sudo[87200]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:22 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-426b5adc-4366-4cf4-9723-67ed3759a46a tempest-VolumesDeleteCascade-678564053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99.d888ae91-7023-47fc-8dee-3e202a39e508" returned: 0 in 0.553s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:22 devstack sudo[87199]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:22 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-426b5adc-4366-4cf4-9723-67ed3759a46a tempest-VolumesDeleteCascade-678564053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.468s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:22 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-a3fcdbd5-f759-4f91-acb1-7e01be790210 tempest-VolumeQuotasAdminTestJSON-251349822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.268s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:22 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-a3fcdbd5-f759-4f91-acb1-7e01be790210 tempest-VolumeQuotasAdminTestJSON-251349822 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:25:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1982709706',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=600d089c-d591-4db7-ab9e-93a6eea4a481,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5527e0c4500f41bd90e6e4039a74a43e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:25:20Z,use_quota=True,user_id='166d842ec17240d9a08fe0eee20988f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:25:22 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-a3fcdbd5-f759-4f91-acb1-7e01be790210 tempest-VolumeQuotasAdminTestJSON-251349822 None] Creating volume 600d089c-d591-4db7-ab9e-93a6eea4a481 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:25:22 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-a3fcdbd5-f759-4f91-acb1-7e01be790210 tempest-VolumeQuotasAdminTestJSON-251349822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:22 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-a3fcdbd5-f759-4f91-acb1-7e01be790210 tempest-VolumeQuotasAdminTestJSON-251349822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:22 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-a3fcdbd5-f759-4f91-acb1-7e01be790210 tempest-VolumeQuotasAdminTestJSON-251349822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:25:22 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-a3fcdbd5-f759-4f91-acb1-7e01be790210 tempest-VolumeQuotasAdminTestJSON-251349822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:25:22 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-a3fcdbd5-f759-4f91-acb1-7e01be790210 tempest-VolumeQuotasAdminTestJSON-251349822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:22 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-a3fcdbd5-f759-4f91-acb1-7e01be790210 tempest-VolumeQuotasAdminTestJSON-251349822 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:25:22 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-a3fcdbd5-f759-4f91-acb1-7e01be790210 tempest-VolumeQuotasAdminTestJSON-251349822 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:25:22 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a3fcdbd5-f759-4f91-acb1-7e01be790210 tempest-VolumeQuotasAdminTestJSON-251349822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-600d089c-d591-4db7-ab9e-93a6eea4a481 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:22 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-fd17667d-09cc-4775-ba1d-b09a0c8fe411 tempest-SnapshotsActionsTest-200108673 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.864f055e-6cc0-410f-83c0-64b218ae6d25" returned: 0 in 0.626s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:22 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-fd17667d-09cc-4775-ba1d-b09a0c8fe411 tempest-SnapshotsActionsTest-200108673 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83106) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:25:22 devstack sudo[87207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-600d089c-d591-4db7-ab9e-93a6eea4a481 1073741824
Feb 27 01:25:22 devstack sudo[87207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:22 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-fd17667d-09cc-4775-ba1d-b09a0c8fe411 tempest-SnapshotsActionsTest-200108673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.19991da7-21e1-46c5-8562-be90eb34bf62 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:22 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-426b5adc-4366-4cf4-9723-67ed3759a46a tempest-VolumesDeleteCascade-678564053 None] Create snapshot completed successfully
Feb 27 01:25:22 devstack sudo[87209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.19991da7-21e1-46c5-8562-be90eb34bf62
Feb 27 01:25:22 devstack sudo[87209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:22 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-a233ab8f-8a8a-46f0-abb1-efe8319b9d65 tempest-VolumesDeleteCascade-678564053 None] Acquiring lock "cinder-3ea3a222-5c0d-4a87-a3d0-bccd61775b99-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:23 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-a233ab8f-8a8a-46f0-abb1-efe8319b9d65 tempest-VolumesDeleteCascade-678564053 None] Lock "cinder-3ea3a222-5c0d-4a87-a3d0-bccd61775b99-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:23 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a233ab8f-8a8a-46f0-abb1-efe8319b9d65 tempest-VolumesDeleteCascade-678564053 None] Performing cascade delete. {{(pid=83106) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Feb 27 01:25:23 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-a233ab8f-8a8a-46f0-abb1-efe8319b9d65 tempest-VolumesDeleteCascade-678564053 None] Acquiring lock "cinder-d888ae91-7023-47fc-8dee-3e202a39e508-delete_snapshot" by "delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:23 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-a233ab8f-8a8a-46f0-abb1-efe8319b9d65 tempest-VolumesDeleteCascade-678564053 None] Lock "cinder-d888ae91-7023-47fc-8dee-3e202a39e508-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:23 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-a233ab8f-8a8a-46f0-abb1-efe8319b9d65 tempest-VolumesDeleteCascade-678564053 None] Acquiring lock "cinder-quobyte-3ea3a222-5c0d-4a87-a3d0-bccd61775b99" by "delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:23 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-a233ab8f-8a8a-46f0-abb1-efe8319b9d65 tempest-VolumesDeleteCascade-678564053 None] Lock "cinder-quobyte-3ea3a222-5c0d-4a87-a3d0-bccd61775b99" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:23 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-a233ab8f-8a8a-46f0-abb1-efe8319b9d65 tempest-VolumesDeleteCascade-678564053 None] Acquiring lock "cinder-quobyte-d888ae91-7023-47fc-8dee-3e202a39e508" by "_delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:23 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-a233ab8f-8a8a-46f0-abb1-efe8319b9d65 tempest-VolumesDeleteCascade-678564053 None] Lock "cinder-quobyte-d888ae91-7023-47fc-8dee-3e202a39e508" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:23 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-a233ab8f-8a8a-46f0-abb1-efe8319b9d65 tempest-VolumesDeleteCascade-678564053 None] Deleting offline snapshot d888ae91-7023-47fc-8dee-3e202a39e508 of volume 3ea3a222-5c0d-4a87-a3d0-bccd61775b99 {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:25:23 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-a233ab8f-8a8a-46f0-abb1-efe8319b9d65 tempest-VolumesDeleteCascade-678564053 None] snapshot_file for this snap is: volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99.d888ae91-7023-47fc-8dee-3e202a39e508 {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:25:23 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[265fd7f2-4ee9-49ee-8451-2119b6ffb83e]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:23 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a233ab8f-8a8a-46f0-abb1-efe8319b9d65 tempest-VolumesDeleteCascade-678564053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99.d888ae91-7023-47fc-8dee-3e202a39e508 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:23 devstack sudo[87218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99.d888ae91-7023-47fc-8dee-3e202a39e508
Feb 27 01:25:23 devstack sudo[87218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:23 devstack sudo[87209]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:23 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-fd17667d-09cc-4775-ba1d-b09a0c8fe411 tempest-SnapshotsActionsTest-200108673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.19991da7-21e1-46c5-8562-be90eb34bf62" returned: 0 in 0.536s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:23 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-fd17667d-09cc-4775-ba1d-b09a0c8fe411 tempest-SnapshotsActionsTest-200108673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.19991da7-21e1-46c5-8562-be90eb34bf62 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:23 devstack sudo[87220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.19991da7-21e1-46c5-8562-be90eb34bf62
Feb 27 01:25:23 devstack sudo[87220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:23 devstack sudo[87207]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:23 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a3fcdbd5-f759-4f91-acb1-7e01be790210 tempest-VolumeQuotasAdminTestJSON-251349822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-600d089c-d591-4db7-ab9e-93a6eea4a481 1073741824" returned: 0 in 0.636s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:23 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a3fcdbd5-f759-4f91-acb1-7e01be790210 tempest-VolumeQuotasAdminTestJSON-251349822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-600d089c-d591-4db7-ab9e-93a6eea4a481 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:23 devstack sudo[87222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-600d089c-d591-4db7-ab9e-93a6eea4a481
Feb 27 01:25:23 devstack sudo[87222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:23 devstack sudo[87218]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:23 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a233ab8f-8a8a-46f0-abb1-efe8319b9d65 tempest-VolumesDeleteCascade-678564053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99.d888ae91-7023-47fc-8dee-3e202a39e508" returned: 0 in 0.542s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:23 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-a233ab8f-8a8a-46f0-abb1-efe8319b9d65 tempest-VolumesDeleteCascade-678564053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83106) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:25:23 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[8797ef39-8b66-4ac4-96f2-0e9412fc51cc]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:23 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a233ab8f-8a8a-46f0-abb1-efe8319b9d65 tempest-VolumesDeleteCascade-678564053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99.f9c7fe3c-af84-40b4-b6ab-85c7209d64e4 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:23 devstack sudo[87231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99.f9c7fe3c-af84-40b4-b6ab-85c7209d64e4
Feb 27 01:25:23 devstack sudo[87231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:23 devstack sudo[87220]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:23 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-fd17667d-09cc-4775-ba1d-b09a0c8fe411 tempest-SnapshotsActionsTest-200108673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.19991da7-21e1-46c5-8562-be90eb34bf62" returned: 0 in 0.561s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:23 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-fd17667d-09cc-4775-ba1d-b09a0c8fe411 tempest-SnapshotsActionsTest-200108673 None] Lock "cinder-quobyte-19991da7-21e1-46c5-8562-be90eb34bf62" released by "_delete_snapshot" :: held 2.392s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:23 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-fd17667d-09cc-4775-ba1d-b09a0c8fe411 tempest-SnapshotsActionsTest-200108673 None] Lock "cinder-quobyte-f4cb7fea-935f-40f5-8093-ce89f2d2348a" released by "delete_snapshot" :: held 2.416s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:23 devstack sudo[87222]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:23 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a3fcdbd5-f759-4f91-acb1-7e01be790210 tempest-VolumeQuotasAdminTestJSON-251349822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-600d089c-d591-4db7-ab9e-93a6eea4a481" returned: 0 in 0.514s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:23 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-a3fcdbd5-f759-4f91-acb1-7e01be790210 tempest-VolumeQuotasAdminTestJSON-251349822 None] <== create_volume: return (1187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:25:23 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-a3fcdbd5-f759-4f91-acb1-7e01be790210 tempest-VolumeQuotasAdminTestJSON-251349822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.191s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:23 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-1d0cf259-cf5f-4c13-bf2d-3761df7f44f2 tempest-GroupsTest-1998620927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.297s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:23 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-1d0cf259-cf5f-4c13-bf2d-3761df7f44f2 tempest-GroupsTest-1998620927 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=8646e1cc-a177-4aaa-83e2-4ae1c421c954,created_at=2026-02-27T00:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1035227683',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8646e1cc-a177-4aaa-83e2-4ae1c421c954,host='devstack@QuobyteHD#QuobyteHD',id=36736644-2d0a-4566-b9c6-15fa1f94a709,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd01644ed2e94ed99424631bd3db4d45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:25:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:25:21Z,use_quota=True,user_id='ec57153f08474572b49ba7aea3c8fb20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60274133-438e-4320-8789-4cd4ebbb9aed),volume_type_id=60274133-438e-4320-8789-4cd4ebbb9aed)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:25:23 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-1d0cf259-cf5f-4c13-bf2d-3761df7f44f2 tempest-GroupsTest-1998620927 None] Creating volume 36736644-2d0a-4566-b9c6-15fa1f94a709 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:25:23 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-1d0cf259-cf5f-4c13-bf2d-3761df7f44f2 tempest-GroupsTest-1998620927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:23 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-1d0cf259-cf5f-4c13-bf2d-3761df7f44f2 tempest-GroupsTest-1998620927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:23 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-1d0cf259-cf5f-4c13-bf2d-3761df7f44f2 tempest-GroupsTest-1998620927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:25:23 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-1d0cf259-cf5f-4c13-bf2d-3761df7f44f2 tempest-GroupsTest-1998620927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:25:23 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-1d0cf259-cf5f-4c13-bf2d-3761df7f44f2 tempest-GroupsTest-1998620927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:23 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-1d0cf259-cf5f-4c13-bf2d-3761df7f44f2 tempest-GroupsTest-1998620927 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:25:23 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-1d0cf259-cf5f-4c13-bf2d-3761df7f44f2 tempest-GroupsTest-1998620927 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:25:23 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-1d0cf259-cf5f-4c13-bf2d-3761df7f44f2 tempest-GroupsTest-1998620927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-36736644-2d0a-4566-b9c6-15fa1f94a709 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:23 devstack sudo[87234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-36736644-2d0a-4566-b9c6-15fa1f94a709 1073741824
Feb 27 01:25:23 devstack sudo[87234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:23 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a3fcdbd5-f759-4f91-acb1-7e01be790210 tempest-VolumeQuotasAdminTestJSON-251349822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77f9d012-467b-4279-8a74-8efe2be92ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-600d089c-d591-4db7-ab9e-93a6eea4a481', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:23 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a3fcdbd5-f759-4f91-acb1-7e01be790210 tempest-VolumeQuotasAdminTestJSON-251349822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (444bf946-0766-4210-b801-7e22677b79ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:23 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-a3fcdbd5-f759-4f91-acb1-7e01be790210 tempest-VolumeQuotasAdminTestJSON-251349822 None] Volume volume-600d089c-d591-4db7-ab9e-93a6eea4a481 (600d089c-d591-4db7-ab9e-93a6eea4a481): created successfully
Feb 27 01:25:23 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a3fcdbd5-f759-4f91-acb1-7e01be790210 tempest-VolumeQuotasAdminTestJSON-251349822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (444bf946-0766-4210-b801-7e22677b79ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:23 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a3fcdbd5-f759-4f91-acb1-7e01be790210 tempest-VolumeQuotasAdminTestJSON-251349822 None] Flow 'volume_create_manager' (1cda0cad-1ae6-4a54-ba3d-651d7dc5b4b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:25:23 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-a3fcdbd5-f759-4f91-acb1-7e01be790210 tempest-VolumeQuotasAdminTestJSON-251349822 None] Created volume successfully.
Feb 27 01:25:23 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-fd17667d-09cc-4775-ba1d-b09a0c8fe411 tempest-SnapshotsActionsTest-200108673 None] Created reservations ['f0dab1e2-15de-4315-894a-f3221feaf9a8', '8249de6e-8f07-4969-8cdc-b6f15f4ef136', '093ffa8e-1c17-4190-83f5-625e09f455b9', 'dcc1c693-2214-46cd-97c7-add2f5a6dab1'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:25:24 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-fd17667d-09cc-4775-ba1d-b09a0c8fe411 tempest-SnapshotsActionsTest-200108673 None] Delete snapshot completed successfully.
Feb 27 01:25:24 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-fd17667d-09cc-4775-ba1d-b09a0c8fe411 tempest-SnapshotsActionsTest-200108673 None] Lock "cinder-19991da7-21e1-46c5-8562-be90eb34bf62-delete_snapshot" released by "delete_snapshot" :: held 2.632s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:24 devstack sudo[87231]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:24 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a233ab8f-8a8a-46f0-abb1-efe8319b9d65 tempest-VolumesDeleteCascade-678564053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99.f9c7fe3c-af84-40b4-b6ab-85c7209d64e4" returned: 0 in 0.607s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:24 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-a233ab8f-8a8a-46f0-abb1-efe8319b9d65 tempest-VolumesDeleteCascade-678564053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83106) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:25:24 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a233ab8f-8a8a-46f0-abb1-efe8319b9d65 tempest-VolumesDeleteCascade-678564053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99.d888ae91-7023-47fc-8dee-3e202a39e508 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:24 devstack sudo[87242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99.d888ae91-7023-47fc-8dee-3e202a39e508
Feb 27 01:25:24 devstack sudo[87242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:24 devstack sudo[87234]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:24 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-1d0cf259-cf5f-4c13-bf2d-3761df7f44f2 tempest-GroupsTest-1998620927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-36736644-2d0a-4566-b9c6-15fa1f94a709 1073741824" returned: 0 in 0.638s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:24 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-1d0cf259-cf5f-4c13-bf2d-3761df7f44f2 tempest-GroupsTest-1998620927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-36736644-2d0a-4566-b9c6-15fa1f94a709 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:24 devstack sudo[87244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-36736644-2d0a-4566-b9c6-15fa1f94a709
Feb 27 01:25:24 devstack sudo[87244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:24 devstack sudo[87242]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:24 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a233ab8f-8a8a-46f0-abb1-efe8319b9d65 tempest-VolumesDeleteCascade-678564053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99.d888ae91-7023-47fc-8dee-3e202a39e508" returned: 0 in 0.635s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:24 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a233ab8f-8a8a-46f0-abb1-efe8319b9d65 tempest-VolumesDeleteCascade-678564053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99.d888ae91-7023-47fc-8dee-3e202a39e508 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:24 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-c9a16ff5-eb9d-4de2-b358-28df037bb228 tempest-SnapshotsActionsTest-1161199312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:24 devstack sudo[87249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99.d888ae91-7023-47fc-8dee-3e202a39e508
Feb 27 01:25:24 devstack sudo[87249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:25 devstack sudo[87244]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:25 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-1d0cf259-cf5f-4c13-bf2d-3761df7f44f2 tempest-GroupsTest-1998620927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-36736644-2d0a-4566-b9c6-15fa1f94a709" returned: 0 in 0.627s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:25 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-1d0cf259-cf5f-4c13-bf2d-3761df7f44f2 tempest-GroupsTest-1998620927 None] <== create_volume: return (1319ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:25:25 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-1d0cf259-cf5f-4c13-bf2d-3761df7f44f2 tempest-GroupsTest-1998620927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.323s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:25 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-c9a16ff5-eb9d-4de2-b358-28df037bb228 tempest-SnapshotsActionsTest-1161199312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.249s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:25 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1d0cf259-cf5f-4c13-bf2d-3761df7f44f2 tempest-GroupsTest-1998620927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dc72c3d-fd8a-4ef0-a661-b757a104968d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36736644-2d0a-4566-b9c6-15fa1f94a709', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:25 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1d0cf259-cf5f-4c13-bf2d-3761df7f44f2 tempest-GroupsTest-1998620927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c9512e1-64c6-4ce6-b4d9-c0d71cc69735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:25 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-c9a16ff5-eb9d-4de2-b358-28df037bb228 tempest-SnapshotsActionsTest-1161199312 None] Creating offline snapshot 93b7e6a3-a338-4bfe-b6f1-1afd3bed74fa of volume f4cb7fea-935f-40f5-8093-ce89f2d2348a {{(pid=83106) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:25:25 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-1d0cf259-cf5f-4c13-bf2d-3761df7f44f2 tempest-GroupsTest-1998620927 None] Volume volume-36736644-2d0a-4566-b9c6-15fa1f94a709 (36736644-2d0a-4566-b9c6-15fa1f94a709): created successfully
Feb 27 01:25:25 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1d0cf259-cf5f-4c13-bf2d-3761df7f44f2 tempest-GroupsTest-1998620927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c9512e1-64c6-4ce6-b4d9-c0d71cc69735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:25 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1d0cf259-cf5f-4c13-bf2d-3761df7f44f2 tempest-GroupsTest-1998620927 None] Flow 'volume_create_manager' (2f6c5623-6e1f-48a9-b165-dbd191128ced) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:25:25 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[5747b85c-def3-45f6-ac86-0c614ee619d4]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:25 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c9a16ff5-eb9d-4de2-b358-28df037bb228 tempest-SnapshotsActionsTest-1161199312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.864f055e-6cc0-410f-83c0-64b218ae6d25 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:25 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-1d0cf259-cf5f-4c13-bf2d-3761df7f44f2 tempest-GroupsTest-1998620927 None] Created volume successfully.
Feb 27 01:25:25 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-e4ad0585-c774-49c9-ba49-4178ff28d021 tempest-VolumeQuotasAdminTestJSON-746045877 None] Transfer volume completed successfully.
Feb 27 01:25:25 devstack sudo[87252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.864f055e-6cc0-410f-83c0-64b218ae6d25
Feb 27 01:25:25 devstack sudo[87252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:25 devstack sudo[87249]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:25 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a233ab8f-8a8a-46f0-abb1-efe8319b9d65 tempest-VolumesDeleteCascade-678564053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99.d888ae91-7023-47fc-8dee-3e202a39e508" returned: 0 in 0.552s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:25 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-a233ab8f-8a8a-46f0-abb1-efe8319b9d65 tempest-VolumesDeleteCascade-678564053 None] Lock "cinder-quobyte-d888ae91-7023-47fc-8dee-3e202a39e508" released by "_delete_snapshot" :: held 2.398s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:25 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-a233ab8f-8a8a-46f0-abb1-efe8319b9d65 tempest-VolumesDeleteCascade-678564053 None] Lock "cinder-quobyte-3ea3a222-5c0d-4a87-a3d0-bccd61775b99" released by "delete_snapshot" :: held 2.413s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:25 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-a233ab8f-8a8a-46f0-abb1-efe8319b9d65 tempest-VolumesDeleteCascade-678564053 None] Created reservations ['5b4df3ad-8952-4099-83b8-1099ead1826e', '73022e95-1555-4bdf-9594-de69a9942850', 'b7c4fdcc-cf1c-485b-9121-7ea34e623e7d', 'cba166c4-abb9-40ac-b25f-385d461d1f33'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:25:25 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-a233ab8f-8a8a-46f0-abb1-efe8319b9d65 tempest-VolumesDeleteCascade-678564053 None] Delete snapshot completed successfully.
Feb 27 01:25:25 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-a233ab8f-8a8a-46f0-abb1-efe8319b9d65 tempest-VolumesDeleteCascade-678564053 None] Lock "cinder-d888ae91-7023-47fc-8dee-3e202a39e508-delete_snapshot" released by "delete_snapshot" :: held 2.530s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:25 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-a233ab8f-8a8a-46f0-abb1-efe8319b9d65 tempest-VolumesDeleteCascade-678564053 None] Acquiring lock "cinder-f9c7fe3c-af84-40b4-b6ab-85c7209d64e4-delete_snapshot" by "delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:25 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-a233ab8f-8a8a-46f0-abb1-efe8319b9d65 tempest-VolumesDeleteCascade-678564053 None] Lock "cinder-f9c7fe3c-af84-40b4-b6ab-85c7209d64e4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:25 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-a233ab8f-8a8a-46f0-abb1-efe8319b9d65 tempest-VolumesDeleteCascade-678564053 None] Acquiring lock "cinder-quobyte-3ea3a222-5c0d-4a87-a3d0-bccd61775b99" by "delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:25 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-a233ab8f-8a8a-46f0-abb1-efe8319b9d65 tempest-VolumesDeleteCascade-678564053 None] Lock "cinder-quobyte-3ea3a222-5c0d-4a87-a3d0-bccd61775b99" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:25 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-a233ab8f-8a8a-46f0-abb1-efe8319b9d65 tempest-VolumesDeleteCascade-678564053 None] Acquiring lock "cinder-quobyte-f9c7fe3c-af84-40b4-b6ab-85c7209d64e4" by "_delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:25 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-a233ab8f-8a8a-46f0-abb1-efe8319b9d65 tempest-VolumesDeleteCascade-678564053 None] Lock "cinder-quobyte-f9c7fe3c-af84-40b4-b6ab-85c7209d64e4" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:25 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-a233ab8f-8a8a-46f0-abb1-efe8319b9d65 tempest-VolumesDeleteCascade-678564053 None] Deleting offline snapshot f9c7fe3c-af84-40b4-b6ab-85c7209d64e4 of volume 3ea3a222-5c0d-4a87-a3d0-bccd61775b99 {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:25:25 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-a233ab8f-8a8a-46f0-abb1-efe8319b9d65 tempest-VolumesDeleteCascade-678564053 None] snapshot_file for this snap is: volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99.f9c7fe3c-af84-40b4-b6ab-85c7209d64e4 {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:25:25 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[738a45fd-0c4d-4977-8a8e-7b9154c4314e]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:25 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a233ab8f-8a8a-46f0-abb1-efe8319b9d65 tempest-VolumesDeleteCascade-678564053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99.f9c7fe3c-af84-40b4-b6ab-85c7209d64e4 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:25 devstack sudo[87255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99.f9c7fe3c-af84-40b4-b6ab-85c7209d64e4
Feb 27 01:25:25 devstack sudo[87255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:26 devstack sudo[87252]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:26 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c9a16ff5-eb9d-4de2-b358-28df037bb228 tempest-SnapshotsActionsTest-1161199312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.864f055e-6cc0-410f-83c0-64b218ae6d25" returned: 0 in 0.717s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:26 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-c9a16ff5-eb9d-4de2-b358-28df037bb228 tempest-SnapshotsActionsTest-1161199312 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83106) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:25:26 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c9a16ff5-eb9d-4de2-b358-28df037bb228 tempest-SnapshotsActionsTest-1161199312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.864f055e-6cc0-410f-83c0-64b218ae6d25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.93b7e6a3-a338-4bfe-b6f1-1afd3bed74fa 1G {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:26 devstack sudo[87260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.864f055e-6cc0-410f-83c0-64b218ae6d25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.93b7e6a3-a338-4bfe-b6f1-1afd3bed74fa 1G
Feb 27 01:25:26 devstack sudo[87260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:26 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-dcfb1bd6-24c0-4408-8952-da4f4bab5b7b tempest-VolumeQuotasAdminTestJSON-1220978872 None] Acquiring lock "cinder-600d089c-d591-4db7-ab9e-93a6eea4a481-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:26 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-daed1432-e8ba-49ae-b522-b31275a6dc61 tempest-GroupsTest-1998620927 None] Acquiring lock "cinder-quobyte-36736644-2d0a-4566-b9c6-15fa1f94a709" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:26 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-daed1432-e8ba-49ae-b522-b31275a6dc61 tempest-GroupsTest-1998620927 None] Lock "cinder-quobyte-36736644-2d0a-4566-b9c6-15fa1f94a709" acquired by "delete_volume" :: waited 0.019s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:26 devstack sudo[87255]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:26 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-dcfb1bd6-24c0-4408-8952-da4f4bab5b7b tempest-VolumeQuotasAdminTestJSON-1220978872 None] Lock "cinder-600d089c-d591-4db7-ab9e-93a6eea4a481-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:26 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f135889-f293-4a8e-98c6-8a5f2613746c]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:26 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-daed1432-e8ba-49ae-b522-b31275a6dc61 tempest-GroupsTest-1998620927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-36736644-2d0a-4566-b9c6-15fa1f94a709 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:26 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a233ab8f-8a8a-46f0-abb1-efe8319b9d65 tempest-VolumesDeleteCascade-678564053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99.f9c7fe3c-af84-40b4-b6ab-85c7209d64e4" returned: 0 in 0.805s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:26 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-a233ab8f-8a8a-46f0-abb1-efe8319b9d65 tempest-VolumesDeleteCascade-678564053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83106) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:25:26 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba05dc16-b3ff-4de0-b41d-6378d049f57a]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:26 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a233ab8f-8a8a-46f0-abb1-efe8319b9d65 tempest-VolumesDeleteCascade-678564053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:26 devstack sudo[87267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-36736644-2d0a-4566-b9c6-15fa1f94a709
Feb 27 01:25:26 devstack sudo[87267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:26 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-dcfb1bd6-24c0-4408-8952-da4f4bab5b7b tempest-VolumeQuotasAdminTestJSON-1220978872 None] Acquiring lock "cinder-quobyte-600d089c-d591-4db7-ab9e-93a6eea4a481" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:26 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-dcfb1bd6-24c0-4408-8952-da4f4bab5b7b tempest-VolumeQuotasAdminTestJSON-1220978872 None] Lock "cinder-quobyte-600d089c-d591-4db7-ab9e-93a6eea4a481" acquired by "delete_volume" :: waited 0.012s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:26 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[761ea9ac-bfd8-42f2-9da0-2c9288503ad9]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:26 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-dcfb1bd6-24c0-4408-8952-da4f4bab5b7b tempest-VolumeQuotasAdminTestJSON-1220978872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-600d089c-d591-4db7-ab9e-93a6eea4a481 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:26 devstack sudo[87269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99
Feb 27 01:25:26 devstack sudo[87269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:26 devstack sudo[87260]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:26 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c9a16ff5-eb9d-4de2-b358-28df037bb228 tempest-SnapshotsActionsTest-1161199312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.864f055e-6cc0-410f-83c0-64b218ae6d25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.93b7e6a3-a338-4bfe-b6f1-1afd3bed74fa 1G" returned: 0 in 0.592s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:26 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c9a16ff5-eb9d-4de2-b358-28df037bb228 tempest-SnapshotsActionsTest-1161199312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.864f055e-6cc0-410f-83c0-64b218ae6d25 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.93b7e6a3-a338-4bfe-b6f1-1afd3bed74fa {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:26 devstack sudo[87273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.864f055e-6cc0-410f-83c0-64b218ae6d25 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.93b7e6a3-a338-4bfe-b6f1-1afd3bed74fa
Feb 27 01:25:26 devstack sudo[87273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:26 devstack sudo[87271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-600d089c-d591-4db7-ab9e-93a6eea4a481
Feb 27 01:25:26 devstack sudo[87271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:26 devstack sudo[87267]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:26 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-daed1432-e8ba-49ae-b522-b31275a6dc61 tempest-GroupsTest-1998620927 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-36736644-2d0a-4566-b9c6-15fa1f94a709" returned: 0 in 0.505s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:26 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-daed1432-e8ba-49ae-b522-b31275a6dc61 tempest-GroupsTest-1998620927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-36736644-2d0a-4566-b9c6-15fa1f94a709 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:27 devstack sudo[87280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-36736644-2d0a-4566-b9c6-15fa1f94a709
Feb 27 01:25:27 devstack sudo[87280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:27 devstack sudo[87271]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-dcfb1bd6-24c0-4408-8952-da4f4bab5b7b tempest-VolumeQuotasAdminTestJSON-1220978872 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-600d089c-d591-4db7-ab9e-93a6eea4a481" returned: 0 in 0.559s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-dcfb1bd6-24c0-4408-8952-da4f4bab5b7b tempest-VolumeQuotasAdminTestJSON-1220978872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-600d089c-d591-4db7-ab9e-93a6eea4a481 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:27 devstack sudo[87273]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c9a16ff5-eb9d-4de2-b358-28df037bb228 tempest-SnapshotsActionsTest-1161199312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.864f055e-6cc0-410f-83c0-64b218ae6d25 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.93b7e6a3-a338-4bfe-b6f1-1afd3bed74fa" returned: 0 in 0.530s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:27 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-c9a16ff5-eb9d-4de2-b358-28df037bb228 tempest-SnapshotsActionsTest-1161199312 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.93b7e6a3-a338-4bfe-b6f1-1afd3bed74fa is being set with open permissions: ugo+rw
Feb 27 01:25:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c9a16ff5-eb9d-4de2-b358-28df037bb228 tempest-SnapshotsActionsTest-1161199312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.93b7e6a3-a338-4bfe-b6f1-1afd3bed74fa {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:27 devstack sudo[87269]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a233ab8f-8a8a-46f0-abb1-efe8319b9d65 tempest-VolumesDeleteCascade-678564053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99" returned: 0 in 0.671s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a233ab8f-8a8a-46f0-abb1-efe8319b9d65 tempest-VolumesDeleteCascade-678564053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99.f9c7fe3c-af84-40b4-b6ab-85c7209d64e4 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:27 devstack sudo[87290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-600d089c-d591-4db7-ab9e-93a6eea4a481
Feb 27 01:25:27 devstack sudo[87291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.93b7e6a3-a338-4bfe-b6f1-1afd3bed74fa
Feb 27 01:25:27 devstack sudo[87290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:27 devstack sudo[87291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:27 devstack sudo[87294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99.f9c7fe3c-af84-40b4-b6ab-85c7209d64e4
Feb 27 01:25:27 devstack sudo[87294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:27 devstack sudo[87280]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-daed1432-e8ba-49ae-b522-b31275a6dc61 tempest-GroupsTest-1998620927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-36736644-2d0a-4566-b9c6-15fa1f94a709" returned: 0 in 0.583s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:27 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-daed1432-e8ba-49ae-b522-b31275a6dc61 tempest-GroupsTest-1998620927 None] Lock "cinder-quobyte-36736644-2d0a-4566-b9c6-15fa1f94a709" released by "delete_volume" :: held 1.131s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:27 devstack sudo[87291]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c9a16ff5-eb9d-4de2-b358-28df037bb228 tempest-SnapshotsActionsTest-1161199312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.93b7e6a3-a338-4bfe-b6f1-1afd3bed74fa" returned: 0 in 0.434s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-c9a16ff5-eb9d-4de2-b358-28df037bb228 tempest-SnapshotsActionsTest-1161199312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.410s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:27 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-daed1432-e8ba-49ae-b522-b31275a6dc61 tempest-GroupsTest-1998620927 None] Created reservations ['5f670d63-83dd-4d13-9da9-be48803b5c32'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:25:27 devstack cinder-volume[83106]: WARNING cinder.quota [None req-daed1432-e8ba-49ae-b522-b31275a6dc61 tempest-GroupsTest-1998620927 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2097656602 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2097656602, it is now deprecated. Please use the default quota class for default quota.
Feb 27 01:25:27 devstack cinder-volume[83106]: WARNING cinder.quota [None req-daed1432-e8ba-49ae-b522-b31275a6dc61 tempest-GroupsTest-1998620927 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2097656602 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2097656602, it is now deprecated. Please use the default quota class for default quota.
Feb 27 01:25:27 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-daed1432-e8ba-49ae-b522-b31275a6dc61 tempest-GroupsTest-1998620927 None] Created reservations ['858655a9-3752-4c9e-b230-5eb244ee5c64', '49da79d3-95c2-4791-8a65-d1de7c675f09', 'f9cd3b64-0e65-43ec-990d-5d0386234e8b', '09a2b6ef-a127-4375-b0b1-af65dbc9258d'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:25:27 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-c9a16ff5-eb9d-4de2-b358-28df037bb228 tempest-SnapshotsActionsTest-1161199312 None] Create snapshot completed successfully
Feb 27 01:25:27 devstack sudo[87290]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-dcfb1bd6-24c0-4408-8952-da4f4bab5b7b tempest-VolumeQuotasAdminTestJSON-1220978872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-600d089c-d591-4db7-ab9e-93a6eea4a481" returned: 0 in 0.651s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:27 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-dcfb1bd6-24c0-4408-8952-da4f4bab5b7b tempest-VolumeQuotasAdminTestJSON-1220978872 None] Lock "cinder-quobyte-600d089c-d591-4db7-ab9e-93a6eea4a481" released by "delete_volume" :: held 1.242s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:27 devstack sudo[87294]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-daed1432-e8ba-49ae-b522-b31275a6dc61 tempest-GroupsTest-1998620927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-daed1432-e8ba-49ae-b522-b31275a6dc61 tempest-GroupsTest-1998620927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:27 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-daed1432-e8ba-49ae-b522-b31275a6dc61 tempest-GroupsTest-1998620927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:25:27 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-daed1432-e8ba-49ae-b522-b31275a6dc61 tempest-GroupsTest-1998620927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:25:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-daed1432-e8ba-49ae-b522-b31275a6dc61 tempest-GroupsTest-1998620927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-daed1432-e8ba-49ae-b522-b31275a6dc61 tempest-GroupsTest-1998620927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a233ab8f-8a8a-46f0-abb1-efe8319b9d65 tempest-VolumesDeleteCascade-678564053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99.f9c7fe3c-af84-40b4-b6ab-85c7209d64e4" returned: 0 in 0.684s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a233ab8f-8a8a-46f0-abb1-efe8319b9d65 tempest-VolumesDeleteCascade-678564053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99.f9c7fe3c-af84-40b4-b6ab-85c7209d64e4 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:27 devstack sudo[87302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:25:27 devstack sudo[87302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:27 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-dcfb1bd6-24c0-4408-8952-da4f4bab5b7b tempest-VolumeQuotasAdminTestJSON-1220978872 None] Created reservations ['2a614889-5b75-4458-88cf-ba3dcda0d85c', '4c45ab9a-aa28-4418-97b8-3e3df312a4c2', 'ed81c263-aea9-4b83-a803-637c99982979', 'a12f156b-b3c9-47a5-8943-4eaa75432ae4'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:25:27 devstack sudo[87303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99.f9c7fe3c-af84-40b4-b6ab-85c7209d64e4
Feb 27 01:25:27 devstack sudo[87303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-dcfb1bd6-24c0-4408-8952-da4f4bab5b7b tempest-VolumeQuotasAdminTestJSON-1220978872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-dcfb1bd6-24c0-4408-8952-da4f4bab5b7b tempest-VolumeQuotasAdminTestJSON-1220978872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:27 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-dcfb1bd6-24c0-4408-8952-da4f4bab5b7b tempest-VolumeQuotasAdminTestJSON-1220978872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:25:27 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-dcfb1bd6-24c0-4408-8952-da4f4bab5b7b tempest-VolumeQuotasAdminTestJSON-1220978872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:25:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-dcfb1bd6-24c0-4408-8952-da4f4bab5b7b tempest-VolumeQuotasAdminTestJSON-1220978872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-dcfb1bd6-24c0-4408-8952-da4f4bab5b7b tempest-VolumeQuotasAdminTestJSON-1220978872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:27 devstack sudo[87306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:25:27 devstack sudo[87306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:28 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-b5a167f0-5782-4dff-861a-e16f68ea7115 tempest-SnapshotsActionsTest-200108673 None] Acquiring lock "cinder-93b7e6a3-a338-4bfe-b6f1-1afd3bed74fa-delete_snapshot" by "delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:28 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-b5a167f0-5782-4dff-861a-e16f68ea7115 tempest-SnapshotsActionsTest-200108673 None] Lock "cinder-93b7e6a3-a338-4bfe-b6f1-1afd3bed74fa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:28 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-b5a167f0-5782-4dff-861a-e16f68ea7115 tempest-SnapshotsActionsTest-200108673 None] Acquiring lock "cinder-quobyte-f4cb7fea-935f-40f5-8093-ce89f2d2348a" by "delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:28 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-b5a167f0-5782-4dff-861a-e16f68ea7115 tempest-SnapshotsActionsTest-200108673 None] Lock "cinder-quobyte-f4cb7fea-935f-40f5-8093-ce89f2d2348a" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:28 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-b5a167f0-5782-4dff-861a-e16f68ea7115 tempest-SnapshotsActionsTest-200108673 None] Acquiring lock "cinder-quobyte-93b7e6a3-a338-4bfe-b6f1-1afd3bed74fa" by "_delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:28 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-b5a167f0-5782-4dff-861a-e16f68ea7115 tempest-SnapshotsActionsTest-200108673 None] Lock "cinder-quobyte-93b7e6a3-a338-4bfe-b6f1-1afd3bed74fa" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:28 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-b5a167f0-5782-4dff-861a-e16f68ea7115 tempest-SnapshotsActionsTest-200108673 None] Deleting offline snapshot 93b7e6a3-a338-4bfe-b6f1-1afd3bed74fa of volume f4cb7fea-935f-40f5-8093-ce89f2d2348a {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:25:28 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-b5a167f0-5782-4dff-861a-e16f68ea7115 tempest-SnapshotsActionsTest-200108673 None] snapshot_file for this snap is: volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.93b7e6a3-a338-4bfe-b6f1-1afd3bed74fa {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:25:28 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b2ebef-689b-49d0-8806-619c1155842d]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:28 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b5a167f0-5782-4dff-861a-e16f68ea7115 tempest-SnapshotsActionsTest-200108673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.93b7e6a3-a338-4bfe-b6f1-1afd3bed74fa {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:28 devstack sudo[87302]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:28 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-daed1432-e8ba-49ae-b522-b31275a6dc61 tempest-GroupsTest-1998620927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.487s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:28 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-daed1432-e8ba-49ae-b522-b31275a6dc61 tempest-GroupsTest-1998620927 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:25:28 devstack sudo[87309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.93b7e6a3-a338-4bfe-b6f1-1afd3bed74fa
Feb 27 01:25:28 devstack sudo[87309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:28 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-daed1432-e8ba-49ae-b522-b31275a6dc61 tempest-GroupsTest-1998620927 None] Delete group completed successfully.
Feb 27 01:25:28 devstack sudo[87303]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:28 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a233ab8f-8a8a-46f0-abb1-efe8319b9d65 tempest-VolumesDeleteCascade-678564053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99.f9c7fe3c-af84-40b4-b6ab-85c7209d64e4" returned: 0 in 0.528s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:28 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-a233ab8f-8a8a-46f0-abb1-efe8319b9d65 tempest-VolumesDeleteCascade-678564053 None] Lock "cinder-quobyte-f9c7fe3c-af84-40b4-b6ab-85c7209d64e4" released by "_delete_snapshot" :: held 2.754s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:28 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-a233ab8f-8a8a-46f0-abb1-efe8319b9d65 tempest-VolumesDeleteCascade-678564053 None] Lock "cinder-quobyte-3ea3a222-5c0d-4a87-a3d0-bccd61775b99" released by "delete_snapshot" :: held 2.766s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:28 devstack sudo[87306]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:28 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-dcfb1bd6-24c0-4408-8952-da4f4bab5b7b tempest-VolumeQuotasAdminTestJSON-1220978872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.485s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:28 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-dcfb1bd6-24c0-4408-8952-da4f4bab5b7b tempest-VolumeQuotasAdminTestJSON-1220978872 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:25:28 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-dcfb1bd6-24c0-4408-8952-da4f4bab5b7b tempest-VolumeQuotasAdminTestJSON-1220978872 None] Deleted volume successfully.
Feb 27 01:25:28 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-dcfb1bd6-24c0-4408-8952-da4f4bab5b7b tempest-VolumeQuotasAdminTestJSON-1220978872 None] Lock "cinder-600d089c-d591-4db7-ab9e-93a6eea4a481-delete_volume" released by "delete_volume" :: held 1.991s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:28 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-a233ab8f-8a8a-46f0-abb1-efe8319b9d65 tempest-VolumesDeleteCascade-678564053 None] Created reservations ['227f91e7-abb8-4730-9f2d-05541a6bfb19', '48c9dfbb-343c-4714-a7e0-a63cf42b46ec', '495f3144-78e7-4dae-8b78-c7a6a76e5a24', '45552d49-3e7b-4ad7-815a-10bdfe9bcd96'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:25:28 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-a233ab8f-8a8a-46f0-abb1-efe8319b9d65 tempest-VolumesDeleteCascade-678564053 None] Delete snapshot completed successfully.
Feb 27 01:25:28 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-a233ab8f-8a8a-46f0-abb1-efe8319b9d65 tempest-VolumesDeleteCascade-678564053 None] Lock "cinder-f9c7fe3c-af84-40b4-b6ab-85c7209d64e4-delete_snapshot" released by "delete_snapshot" :: held 2.879s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:28 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a233ab8f-8a8a-46f0-abb1-efe8319b9d65 tempest-VolumesDeleteCascade-678564053 None] Snapshots deleted, issuing volume delete {{(pid=83106) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Feb 27 01:25:28 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-a233ab8f-8a8a-46f0-abb1-efe8319b9d65 tempest-VolumesDeleteCascade-678564053 None] Acquiring lock "cinder-quobyte-3ea3a222-5c0d-4a87-a3d0-bccd61775b99" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:28 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-a233ab8f-8a8a-46f0-abb1-efe8319b9d65 tempest-VolumesDeleteCascade-678564053 None] Lock "cinder-quobyte-3ea3a222-5c0d-4a87-a3d0-bccd61775b99" acquired by "delete_volume" :: waited 0.011s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:28 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7f7154-6a0e-434c-8899-3d6f50497de7]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:28 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a233ab8f-8a8a-46f0-abb1-efe8319b9d65 tempest-VolumesDeleteCascade-678564053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:28 devstack sudo[87313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99
Feb 27 01:25:28 devstack sudo[87313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:28 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-8448ccad-0fed-4e9a-b4f4-6036ca11149d tempest-GroupsTest-1998620927 None] Created reservations ['1fe88afc-e2fa-4d5f-a687-1df2d31e1ac5'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:25:28 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-8448ccad-0fed-4e9a-b4f4-6036ca11149d tempest-GroupsTest-1998620927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:28 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-8448ccad-0fed-4e9a-b4f4-6036ca11149d tempest-GroupsTest-1998620927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:28 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-8448ccad-0fed-4e9a-b4f4-6036ca11149d tempest-GroupsTest-1998620927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:25:28 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-8448ccad-0fed-4e9a-b4f4-6036ca11149d tempest-GroupsTest-1998620927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:25:28 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-8448ccad-0fed-4e9a-b4f4-6036ca11149d tempest-GroupsTest-1998620927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:28 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-8448ccad-0fed-4e9a-b4f4-6036ca11149d tempest-GroupsTest-1998620927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:28 devstack sudo[87317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:25:28 devstack sudo[87317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:29 devstack sudo[87309]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:29 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b5a167f0-5782-4dff-861a-e16f68ea7115 tempest-SnapshotsActionsTest-200108673 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.93b7e6a3-a338-4bfe-b6f1-1afd3bed74fa" returned: 0 in 0.803s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:29 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-b5a167f0-5782-4dff-861a-e16f68ea7115 tempest-SnapshotsActionsTest-200108673 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83106) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:25:29 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[5caa1a40-08cf-4f05-a5ba-c4fbb9df768b]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:29 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b5a167f0-5782-4dff-861a-e16f68ea7115 tempest-SnapshotsActionsTest-200108673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.864f055e-6cc0-410f-83c0-64b218ae6d25 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:29 devstack sudo[87320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.864f055e-6cc0-410f-83c0-64b218ae6d25
Feb 27 01:25:29 devstack sudo[87320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:29 devstack sudo[87313]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:29 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a233ab8f-8a8a-46f0-abb1-efe8319b9d65 tempest-VolumesDeleteCascade-678564053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99" returned: 0 in 0.797s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:29 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a233ab8f-8a8a-46f0-abb1-efe8319b9d65 tempest-VolumesDeleteCascade-678564053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:29 devstack sudo[87326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99
Feb 27 01:25:29 devstack sudo[87326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:29 devstack sudo[87317]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:29 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-8448ccad-0fed-4e9a-b4f4-6036ca11149d tempest-GroupsTest-1998620927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.621s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:29 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-8448ccad-0fed-4e9a-b4f4-6036ca11149d tempest-GroupsTest-1998620927 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:25:29 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-8448ccad-0fed-4e9a-b4f4-6036ca11149d tempest-GroupsTest-1998620927 None] Delete group completed successfully.
Feb 27 01:25:29 devstack sudo[87320]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:29 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b5a167f0-5782-4dff-861a-e16f68ea7115 tempest-SnapshotsActionsTest-200108673 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.864f055e-6cc0-410f-83c0-64b218ae6d25" returned: 0 in 0.586s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:29 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-b5a167f0-5782-4dff-861a-e16f68ea7115 tempest-SnapshotsActionsTest-200108673 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83106) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:25:29 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b5a167f0-5782-4dff-861a-e16f68ea7115 tempest-SnapshotsActionsTest-200108673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.93b7e6a3-a338-4bfe-b6f1-1afd3bed74fa {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:29 devstack sudo[87331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.93b7e6a3-a338-4bfe-b6f1-1afd3bed74fa
Feb 27 01:25:29 devstack sudo[87331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:29 devstack sudo[87326]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:29 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a233ab8f-8a8a-46f0-abb1-efe8319b9d65 tempest-VolumesDeleteCascade-678564053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3ea3a222-5c0d-4a87-a3d0-bccd61775b99" returned: 0 in 0.563s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:29 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-a233ab8f-8a8a-46f0-abb1-efe8319b9d65 tempest-VolumesDeleteCascade-678564053 None] Lock "cinder-quobyte-3ea3a222-5c0d-4a87-a3d0-bccd61775b99" released by "delete_volume" :: held 1.415s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:29 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-a233ab8f-8a8a-46f0-abb1-efe8319b9d65 tempest-VolumesDeleteCascade-678564053 None] Created reservations ['5293dc95-6d38-4ea6-b7e3-5d2d27ea7e7e', 'a323b7f3-737e-445f-9df8-190425036abf', '31d8d5b3-b306-425b-af5e-2ac7a0fc7581', '60641349-cf7d-426c-be5e-83e91ed7b1b1'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:25:30 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-a233ab8f-8a8a-46f0-abb1-efe8319b9d65 tempest-VolumesDeleteCascade-678564053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:30 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-a233ab8f-8a8a-46f0-abb1-efe8319b9d65 tempest-VolumesDeleteCascade-678564053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:30 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-a233ab8f-8a8a-46f0-abb1-efe8319b9d65 tempest-VolumesDeleteCascade-678564053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:25:30 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-a233ab8f-8a8a-46f0-abb1-efe8319b9d65 tempest-VolumesDeleteCascade-678564053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:25:30 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-a233ab8f-8a8a-46f0-abb1-efe8319b9d65 tempest-VolumesDeleteCascade-678564053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:30 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a233ab8f-8a8a-46f0-abb1-efe8319b9d65 tempest-VolumesDeleteCascade-678564053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:30 devstack sudo[87336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:25:30 devstack sudo[87336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:30 devstack sudo[87331]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:30 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b5a167f0-5782-4dff-861a-e16f68ea7115 tempest-SnapshotsActionsTest-200108673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.93b7e6a3-a338-4bfe-b6f1-1afd3bed74fa" returned: 0 in 0.663s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:30 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b5a167f0-5782-4dff-861a-e16f68ea7115 tempest-SnapshotsActionsTest-200108673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.93b7e6a3-a338-4bfe-b6f1-1afd3bed74fa {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:30 devstack sudo[87339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.93b7e6a3-a338-4bfe-b6f1-1afd3bed74fa
Feb 27 01:25:30 devstack sudo[87339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:30 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-262481b6-629c-4f83-a95f-dc6bf0769e5b tempest-GroupsTest-1998620927 None] Group tempest-GroupsTest-Group-1782283080: creating
Feb 27 01:25:30 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-262481b6-629c-4f83-a95f-dc6bf0769e5b tempest-GroupsTest-1998620927 None] Group tempest-GroupsTest-Group-1782283080: created successfully
Feb 27 01:25:30 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-262481b6-629c-4f83-a95f-dc6bf0769e5b tempest-GroupsTest-1998620927 None] Create group completed successfully.
Feb 27 01:25:30 devstack sudo[87336]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:30 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a233ab8f-8a8a-46f0-abb1-efe8319b9d65 tempest-VolumesDeleteCascade-678564053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.718s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:30 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-a233ab8f-8a8a-46f0-abb1-efe8319b9d65 tempest-VolumesDeleteCascade-678564053 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:25:30 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-a233ab8f-8a8a-46f0-abb1-efe8319b9d65 tempest-VolumesDeleteCascade-678564053 None] Deleted volume successfully.
Feb 27 01:25:30 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-a233ab8f-8a8a-46f0-abb1-efe8319b9d65 tempest-VolumesDeleteCascade-678564053 None] Lock "cinder-3ea3a222-5c0d-4a87-a3d0-bccd61775b99-delete_volume" released by "delete_volume" :: held 7.808s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:30 devstack sudo[87339]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:30 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b5a167f0-5782-4dff-861a-e16f68ea7115 tempest-SnapshotsActionsTest-200108673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.93b7e6a3-a338-4bfe-b6f1-1afd3bed74fa" returned: 0 in 0.540s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:30 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-b5a167f0-5782-4dff-861a-e16f68ea7115 tempest-SnapshotsActionsTest-200108673 None] Lock "cinder-quobyte-93b7e6a3-a338-4bfe-b6f1-1afd3bed74fa" released by "_delete_snapshot" :: held 2.665s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:30 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-b5a167f0-5782-4dff-861a-e16f68ea7115 tempest-SnapshotsActionsTest-200108673 None] Lock "cinder-quobyte-f4cb7fea-935f-40f5-8093-ce89f2d2348a" released by "delete_snapshot" :: held 2.683s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:30 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-b5a167f0-5782-4dff-861a-e16f68ea7115 tempest-SnapshotsActionsTest-200108673 None] Created reservations ['9c3dadf4-5d4b-47ac-b093-04fc507972f0', 'c11f81ca-d4ab-4454-923d-4d027093e739', '5dc1f5e2-2eb5-45fb-bbec-165362431e5a', '55f92d77-9381-4b31-a022-7cb49d7f1df6'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:25:30 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-b5a167f0-5782-4dff-861a-e16f68ea7115 tempest-SnapshotsActionsTest-200108673 None] Delete snapshot completed successfully.
Feb 27 01:25:30 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-b5a167f0-5782-4dff-861a-e16f68ea7115 tempest-SnapshotsActionsTest-200108673 None] Lock "cinder-93b7e6a3-a338-4bfe-b6f1-1afd3bed74fa-delete_snapshot" released by "delete_snapshot" :: held 2.809s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:31 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-c80f3c44-a6e6-43d0-ae8f-7469ccc1cd0f tempest-VolumesDeleteCascade-678564053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:25:31 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c80f3c44-a6e6-43d0-ae8f-7469ccc1cd0f tempest-VolumesDeleteCascade-678564053 None] Flow 'volume_create_manager' (9d910735-1686-4742-90fe-9b9bb1eb1a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:25:31 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c80f3c44-a6e6-43d0-ae8f-7469ccc1cd0f tempest-VolumesDeleteCascade-678564053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba46a020-df4b-4cc6-9f31-bb15e3d41b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:31 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c80f3c44-a6e6-43d0-ae8f-7469ccc1cd0f tempest-VolumesDeleteCascade-678564053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba46a020-df4b-4cc6-9f31-bb15e3d41b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-912748409',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e23314fa89a64fb69ef0eeb80359765d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:25:31Z,use_quota=True,user_id='b516876a5a1f4760b83f013927ad30ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:31 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c80f3c44-a6e6-43d0-ae8f-7469ccc1cd0f tempest-VolumesDeleteCascade-678564053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a085a5dd-1408-450d-805a-95106be524c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:31 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c80f3c44-a6e6-43d0-ae8f-7469ccc1cd0f tempest-VolumesDeleteCascade-678564053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a085a5dd-1408-450d-805a-95106be524c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:31 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c80f3c44-a6e6-43d0-ae8f-7469ccc1cd0f tempest-VolumesDeleteCascade-678564053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e226ce9-34a1-4d4c-9f6d-2b74f2f18bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:31 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c80f3c44-a6e6-43d0-ae8f-7469ccc1cd0f tempest-VolumesDeleteCascade-678564053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e226ce9-34a1-4d4c-9f6d-2b74f2f18bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5', 'volume_name': 'volume-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:31 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c80f3c44-a6e6-43d0-ae8f-7469ccc1cd0f tempest-VolumesDeleteCascade-678564053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b8c902a-ae64-49d4-aacf-6b02932b22d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:31 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c80f3c44-a6e6-43d0-ae8f-7469ccc1cd0f tempest-VolumesDeleteCascade-678564053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b8c902a-ae64-49d4-aacf-6b02932b22d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:31 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c80f3c44-a6e6-43d0-ae8f-7469ccc1cd0f tempest-VolumesDeleteCascade-678564053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65e59f97-e8ce-4d1c-acc5-e0247f65ca7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:31 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-c80f3c44-a6e6-43d0-ae8f-7469ccc1cd0f tempest-VolumesDeleteCascade-678564053 None] Volume 5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5', 'volume_size': 1}
Feb 27 01:25:31 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-c80f3c44-a6e6-43d0-ae8f-7469ccc1cd0f tempest-VolumesDeleteCascade-678564053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:31 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-c80f3c44-a6e6-43d0-ae8f-7469ccc1cd0f tempest-VolumesDeleteCascade-678564053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:31 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-c80f3c44-a6e6-43d0-ae8f-7469ccc1cd0f tempest-VolumesDeleteCascade-678564053 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-912748409',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e23314fa89a64fb69ef0eeb80359765d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:25:31Z,use_quota=True,user_id='b516876a5a1f4760b83f013927ad30ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:25:31 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-c80f3c44-a6e6-43d0-ae8f-7469ccc1cd0f tempest-VolumesDeleteCascade-678564053 None] Creating volume 5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:25:31 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-c80f3c44-a6e6-43d0-ae8f-7469ccc1cd0f tempest-VolumesDeleteCascade-678564053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:31 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-c80f3c44-a6e6-43d0-ae8f-7469ccc1cd0f tempest-VolumesDeleteCascade-678564053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:31 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-c80f3c44-a6e6-43d0-ae8f-7469ccc1cd0f tempest-VolumesDeleteCascade-678564053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:25:31 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-c80f3c44-a6e6-43d0-ae8f-7469ccc1cd0f tempest-VolumesDeleteCascade-678564053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:25:31 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-c80f3c44-a6e6-43d0-ae8f-7469ccc1cd0f tempest-VolumesDeleteCascade-678564053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:31 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-c80f3c44-a6e6-43d0-ae8f-7469ccc1cd0f tempest-VolumesDeleteCascade-678564053 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:25:31 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-c80f3c44-a6e6-43d0-ae8f-7469ccc1cd0f tempest-VolumesDeleteCascade-678564053 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:25:31 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c80f3c44-a6e6-43d0-ae8f-7469ccc1cd0f tempest-VolumesDeleteCascade-678564053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:31 devstack sudo[87343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5 1073741824
Feb 27 01:25:31 devstack sudo[87343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:31 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5d355b5d-f20c-428b-a3c4-00a1a0418c33 tempest-SnapshotsActionsTest-1161199312 None] Acquiring lock "cinder-864f055e-6cc0-410f-83c0-64b218ae6d25-delete_snapshot" by "delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:31 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5d355b5d-f20c-428b-a3c4-00a1a0418c33 tempest-SnapshotsActionsTest-1161199312 None] Lock "cinder-864f055e-6cc0-410f-83c0-64b218ae6d25-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:31 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5d355b5d-f20c-428b-a3c4-00a1a0418c33 tempest-SnapshotsActionsTest-1161199312 None] Acquiring lock "cinder-quobyte-f4cb7fea-935f-40f5-8093-ce89f2d2348a" by "delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:31 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5d355b5d-f20c-428b-a3c4-00a1a0418c33 tempest-SnapshotsActionsTest-1161199312 None] Lock "cinder-quobyte-f4cb7fea-935f-40f5-8093-ce89f2d2348a" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:31 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5d355b5d-f20c-428b-a3c4-00a1a0418c33 tempest-SnapshotsActionsTest-1161199312 None] Acquiring lock "cinder-quobyte-864f055e-6cc0-410f-83c0-64b218ae6d25" by "_delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:31 devstack sudo[87343]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:31 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c80f3c44-a6e6-43d0-ae8f-7469ccc1cd0f tempest-VolumesDeleteCascade-678564053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5 1073741824" returned: 0 in 0.696s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:31 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5d355b5d-f20c-428b-a3c4-00a1a0418c33 tempest-SnapshotsActionsTest-1161199312 None] Lock "cinder-quobyte-864f055e-6cc0-410f-83c0-64b218ae6d25" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:31 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-5d355b5d-f20c-428b-a3c4-00a1a0418c33 tempest-SnapshotsActionsTest-1161199312 None] Deleting offline snapshot 864f055e-6cc0-410f-83c0-64b218ae6d25 of volume f4cb7fea-935f-40f5-8093-ce89f2d2348a {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:25:31 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-5d355b5d-f20c-428b-a3c4-00a1a0418c33 tempest-SnapshotsActionsTest-1161199312 None] snapshot_file for this snap is: volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.864f055e-6cc0-410f-83c0-64b218ae6d25 {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:25:31 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c7d70a-90e8-4947-8203-a9a41bd597d5]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:31 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5d355b5d-f20c-428b-a3c4-00a1a0418c33 tempest-SnapshotsActionsTest-1161199312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.864f055e-6cc0-410f-83c0-64b218ae6d25 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:31 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c80f3c44-a6e6-43d0-ae8f-7469ccc1cd0f tempest-VolumesDeleteCascade-678564053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:31 devstack sudo[87349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5
Feb 27 01:25:31 devstack sudo[87349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:31 devstack sudo[87348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.864f055e-6cc0-410f-83c0-64b218ae6d25
Feb 27 01:25:31 devstack sudo[87348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:32 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-7eabe8b4-a51b-403a-8985-b8ef4fe17ab5 tempest-GroupsTest-1998620927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:25:32 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7eabe8b4-a51b-403a-8985-b8ef4fe17ab5 tempest-GroupsTest-1998620927 None] Flow 'volume_create_manager' (5fa4ffdc-b4b7-43e2-af1c-19c6b555902d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:25:32 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7eabe8b4-a51b-403a-8985-b8ef4fe17ab5 tempest-GroupsTest-1998620927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3642e1fb-e68b-49e6-a3a9-3cdbeaaa76b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:32 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7eabe8b4-a51b-403a-8985-b8ef4fe17ab5 tempest-GroupsTest-1998620927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3642e1fb-e68b-49e6-a3a9-3cdbeaaa76b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:25:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-510818599',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=369ffc10-2812-4096-bc33-8c238e4c6c21,host='devstack@QuobyteHD#QuobyteHD',id=f453d81d-eacd-4c39-a6f3-a3632dd47a7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd01644ed2e94ed99424631bd3db4d45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:25:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:25:32Z,use_quota=True,user_id='ec57153f08474572b49ba7aea3c8fb20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b94a29ed-5cec-458f-a03b-1b7cde95a226),volume_type_id=b94a29ed-5cec-458f-a03b-1b7cde95a226)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:32 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7eabe8b4-a51b-403a-8985-b8ef4fe17ab5 tempest-GroupsTest-1998620927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (497ced25-b833-4316-bf3d-be614e506681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:32 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7eabe8b4-a51b-403a-8985-b8ef4fe17ab5 tempest-GroupsTest-1998620927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (497ced25-b833-4316-bf3d-be614e506681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:32 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7eabe8b4-a51b-403a-8985-b8ef4fe17ab5 tempest-GroupsTest-1998620927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02ddbedd-a194-4468-96ca-47faa06127a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:32 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7eabe8b4-a51b-403a-8985-b8ef4fe17ab5 tempest-GroupsTest-1998620927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02ddbedd-a194-4468-96ca-47faa06127a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f453d81d-eacd-4c39-a6f3-a3632dd47a7b', 'volume_name': 'volume-f453d81d-eacd-4c39-a6f3-a3632dd47a7b', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:32 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7eabe8b4-a51b-403a-8985-b8ef4fe17ab5 tempest-GroupsTest-1998620927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a067152e-ec9b-4503-85d7-f25009ee6e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:32 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7eabe8b4-a51b-403a-8985-b8ef4fe17ab5 tempest-GroupsTest-1998620927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a067152e-ec9b-4503-85d7-f25009ee6e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:32 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7eabe8b4-a51b-403a-8985-b8ef4fe17ab5 tempest-GroupsTest-1998620927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d278139-0a00-4967-8171-20bd39d887b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:32 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-7eabe8b4-a51b-403a-8985-b8ef4fe17ab5 tempest-GroupsTest-1998620927 None] Volume f453d81d-eacd-4c39-a6f3-a3632dd47a7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f453d81d-eacd-4c39-a6f3-a3632dd47a7b', 'volume_size': 1}
Feb 27 01:25:32 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-7eabe8b4-a51b-403a-8985-b8ef4fe17ab5 tempest-GroupsTest-1998620927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:32 devstack sudo[87348]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:32 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5d355b5d-f20c-428b-a3c4-00a1a0418c33 tempest-SnapshotsActionsTest-1161199312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.864f055e-6cc0-410f-83c0-64b218ae6d25" returned: 0 in 0.705s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:32 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-5d355b5d-f20c-428b-a3c4-00a1a0418c33 tempest-SnapshotsActionsTest-1161199312 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83106) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:25:32 devstack sudo[87349]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:32 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c80f3c44-a6e6-43d0-ae8f-7469ccc1cd0f tempest-VolumesDeleteCascade-678564053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5" returned: 0 in 0.695s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:32 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-c80f3c44-a6e6-43d0-ae8f-7469ccc1cd0f tempest-VolumesDeleteCascade-678564053 None] <== create_volume: return (1467ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:25:32 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-c80f3c44-a6e6-43d0-ae8f-7469ccc1cd0f tempest-VolumesDeleteCascade-678564053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.471s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:32 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[a576b053-286f-48a5-bd5c-b46cfad3e581]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:32 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-7eabe8b4-a51b-403a-8985-b8ef4fe17ab5 tempest-GroupsTest-1998620927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.504s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:32 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-7eabe8b4-a51b-403a-8985-b8ef4fe17ab5 tempest-GroupsTest-1998620927 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=369ffc10-2812-4096-bc33-8c238e4c6c21,created_at=2026-02-27T00:25:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-510818599',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=369ffc10-2812-4096-bc33-8c238e4c6c21,host='devstack@QuobyteHD#QuobyteHD',id=f453d81d-eacd-4c39-a6f3-a3632dd47a7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd01644ed2e94ed99424631bd3db4d45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:25:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:25:32Z,use_quota=True,user_id='ec57153f08474572b49ba7aea3c8fb20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b94a29ed-5cec-458f-a03b-1b7cde95a226),volume_type_id=b94a29ed-5cec-458f-a03b-1b7cde95a226)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:25:32 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-7eabe8b4-a51b-403a-8985-b8ef4fe17ab5 tempest-GroupsTest-1998620927 None] Creating volume f453d81d-eacd-4c39-a6f3-a3632dd47a7b {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:25:32 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-7eabe8b4-a51b-403a-8985-b8ef4fe17ab5 tempest-GroupsTest-1998620927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:32 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-7eabe8b4-a51b-403a-8985-b8ef4fe17ab5 tempest-GroupsTest-1998620927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:32 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-7eabe8b4-a51b-403a-8985-b8ef4fe17ab5 tempest-GroupsTest-1998620927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:25:32 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-7eabe8b4-a51b-403a-8985-b8ef4fe17ab5 tempest-GroupsTest-1998620927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:25:32 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-7eabe8b4-a51b-403a-8985-b8ef4fe17ab5 tempest-GroupsTest-1998620927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:32 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-7eabe8b4-a51b-403a-8985-b8ef4fe17ab5 tempest-GroupsTest-1998620927 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:25:32 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-7eabe8b4-a51b-403a-8985-b8ef4fe17ab5 tempest-GroupsTest-1998620927 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:25:32 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7eabe8b4-a51b-403a-8985-b8ef4fe17ab5 tempest-GroupsTest-1998620927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f453d81d-eacd-4c39-a6f3-a3632dd47a7b 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:32 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5d355b5d-f20c-428b-a3c4-00a1a0418c33 tempest-SnapshotsActionsTest-1161199312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:32 devstack sudo[87356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f453d81d-eacd-4c39-a6f3-a3632dd47a7b 1073741824
Feb 27 01:25:32 devstack sudo[87356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:32 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c80f3c44-a6e6-43d0-ae8f-7469ccc1cd0f tempest-VolumesDeleteCascade-678564053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65e59f97-e8ce-4d1c-acc5-e0247f65ca7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:32 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c80f3c44-a6e6-43d0-ae8f-7469ccc1cd0f tempest-VolumesDeleteCascade-678564053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80077431-e2ec-47cf-8dde-551c0061d9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:32 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-c80f3c44-a6e6-43d0-ae8f-7469ccc1cd0f tempest-VolumesDeleteCascade-678564053 None] Volume volume-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5 (5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5): created successfully
Feb 27 01:25:32 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c80f3c44-a6e6-43d0-ae8f-7469ccc1cd0f tempest-VolumesDeleteCascade-678564053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80077431-e2ec-47cf-8dde-551c0061d9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:32 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c80f3c44-a6e6-43d0-ae8f-7469ccc1cd0f tempest-VolumesDeleteCascade-678564053 None] Flow 'volume_create_manager' (9d910735-1686-4742-90fe-9b9bb1eb1a15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:25:32 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-c80f3c44-a6e6-43d0-ae8f-7469ccc1cd0f tempest-VolumesDeleteCascade-678564053 None] Created volume successfully.
Feb 27 01:25:32 devstack sudo[87357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a
Feb 27 01:25:32 devstack sudo[87357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:33 devstack sudo[87357]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:33 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5d355b5d-f20c-428b-a3c4-00a1a0418c33 tempest-SnapshotsActionsTest-1161199312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a" returned: 0 in 0.623s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:33 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5d355b5d-f20c-428b-a3c4-00a1a0418c33 tempest-SnapshotsActionsTest-1161199312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.864f055e-6cc0-410f-83c0-64b218ae6d25 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:33 devstack sudo[87367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.864f055e-6cc0-410f-83c0-64b218ae6d25
Feb 27 01:25:33 devstack sudo[87367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:33 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-9f46e1f5-7c90-4e32-a3e8-609ef0df0812 tempest-VolumesDeleteCascade-678564053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:33 devstack sudo[87356]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:33 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7eabe8b4-a51b-403a-8985-b8ef4fe17ab5 tempest-GroupsTest-1998620927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f453d81d-eacd-4c39-a6f3-a3632dd47a7b 1073741824" returned: 0 in 0.746s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:33 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7eabe8b4-a51b-403a-8985-b8ef4fe17ab5 tempest-GroupsTest-1998620927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f453d81d-eacd-4c39-a6f3-a3632dd47a7b {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:33 devstack sudo[87369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f453d81d-eacd-4c39-a6f3-a3632dd47a7b
Feb 27 01:25:33 devstack sudo[87369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:33 devstack sudo[87367]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:33 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5d355b5d-f20c-428b-a3c4-00a1a0418c33 tempest-SnapshotsActionsTest-1161199312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.864f055e-6cc0-410f-83c0-64b218ae6d25" returned: 0 in 0.580s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:33 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5d355b5d-f20c-428b-a3c4-00a1a0418c33 tempest-SnapshotsActionsTest-1161199312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.864f055e-6cc0-410f-83c0-64b218ae6d25 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:33 devstack sudo[87374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.864f055e-6cc0-410f-83c0-64b218ae6d25
Feb 27 01:25:33 devstack sudo[87374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:33 devstack sudo[87369]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:33 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7eabe8b4-a51b-403a-8985-b8ef4fe17ab5 tempest-GroupsTest-1998620927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f453d81d-eacd-4c39-a6f3-a3632dd47a7b" returned: 0 in 0.612s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:34 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-7eabe8b4-a51b-403a-8985-b8ef4fe17ab5 tempest-GroupsTest-1998620927 None] <== create_volume: return (1393ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:25:34 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-7eabe8b4-a51b-403a-8985-b8ef4fe17ab5 tempest-GroupsTest-1998620927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.398s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:34 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-9f46e1f5-7c90-4e32-a3e8-609ef0df0812 tempest-VolumesDeleteCascade-678564053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.694s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:34 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7eabe8b4-a51b-403a-8985-b8ef4fe17ab5 tempest-GroupsTest-1998620927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d278139-0a00-4967-8171-20bd39d887b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f453d81d-eacd-4c39-a6f3-a3632dd47a7b', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:34 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7eabe8b4-a51b-403a-8985-b8ef4fe17ab5 tempest-GroupsTest-1998620927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ccf1878-2ad9-4456-8f0c-12882b9e0f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:34 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-9f46e1f5-7c90-4e32-a3e8-609ef0df0812 tempest-VolumesDeleteCascade-678564053 None] Creating offline snapshot b917fe9d-24d6-4bca-aa23-587fe0f4601f of volume 5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5 {{(pid=83106) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:25:34 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-7eabe8b4-a51b-403a-8985-b8ef4fe17ab5 tempest-GroupsTest-1998620927 None] Volume volume-f453d81d-eacd-4c39-a6f3-a3632dd47a7b (f453d81d-eacd-4c39-a6f3-a3632dd47a7b): created successfully
Feb 27 01:25:34 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7eabe8b4-a51b-403a-8985-b8ef4fe17ab5 tempest-GroupsTest-1998620927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ccf1878-2ad9-4456-8f0c-12882b9e0f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:34 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7eabe8b4-a51b-403a-8985-b8ef4fe17ab5 tempest-GroupsTest-1998620927 None] Flow 'volume_create_manager' (5fa4ffdc-b4b7-43e2-af1c-19c6b555902d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:25:34 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c9867d-88e7-48b8-a77e-39f616f8d062]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:34 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9f46e1f5-7c90-4e32-a3e8-609ef0df0812 tempest-VolumesDeleteCascade-678564053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:34 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-7eabe8b4-a51b-403a-8985-b8ef4fe17ab5 tempest-GroupsTest-1998620927 None] Created volume successfully.
Feb 27 01:25:34 devstack sudo[87377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5
Feb 27 01:25:34 devstack sudo[87377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:34 devstack sudo[87374]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:34 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5d355b5d-f20c-428b-a3c4-00a1a0418c33 tempest-SnapshotsActionsTest-1161199312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a.864f055e-6cc0-410f-83c0-64b218ae6d25" returned: 0 in 0.449s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:34 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5d355b5d-f20c-428b-a3c4-00a1a0418c33 tempest-SnapshotsActionsTest-1161199312 None] Lock "cinder-quobyte-864f055e-6cc0-410f-83c0-64b218ae6d25" released by "_delete_snapshot" :: held 2.462s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:34 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5d355b5d-f20c-428b-a3c4-00a1a0418c33 tempest-SnapshotsActionsTest-1161199312 None] Lock "cinder-quobyte-f4cb7fea-935f-40f5-8093-ce89f2d2348a" released by "delete_snapshot" :: held 2.486s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:34 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-5d355b5d-f20c-428b-a3c4-00a1a0418c33 tempest-SnapshotsActionsTest-1161199312 None] Created reservations ['bac4b820-fc33-4dcb-bd1d-1708715940e6', 'd9208180-a27a-4c92-9829-3edb71a7e442', '68a55656-df13-44a3-b0b4-41590a271f33', 'a61745e0-496b-44d9-88bc-c01fa5819583'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:25:34 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-5d355b5d-f20c-428b-a3c4-00a1a0418c33 tempest-SnapshotsActionsTest-1161199312 None] Delete snapshot completed successfully.
Feb 27 01:25:34 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5d355b5d-f20c-428b-a3c4-00a1a0418c33 tempest-SnapshotsActionsTest-1161199312 None] Lock "cinder-864f055e-6cc0-410f-83c0-64b218ae6d25-delete_snapshot" released by "delete_snapshot" :: held 2.613s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:34 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2bc7432-93f7-4d29-8a84-e898e9a591ea tempest-GroupsTest-1998620927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:25:34 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-e2bc7432-93f7-4d29-8a84-e898e9a591ea tempest-GroupsTest-1998620927 None] Flow 'volume_create_manager' (49417959-148e-4bdf-ad62-9eadd7e5b48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:25:34 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-e2bc7432-93f7-4d29-8a84-e898e9a591ea tempest-GroupsTest-1998620927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe4a0dfa-0712-4eeb-ae3b-680038272ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:34 devstack sudo[87377]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:34 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-e2bc7432-93f7-4d29-8a84-e898e9a591ea tempest-GroupsTest-1998620927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe4a0dfa-0712-4eeb-ae3b-680038272ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:25:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1490290421',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=369ffc10-2812-4096-bc33-8c238e4c6c21,host='devstack@QuobyteHD#QuobyteHD',id=d013c4a0-9fc7-49ee-92db-16801ac29968,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd01644ed2e94ed99424631bd3db4d45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:25:35Z,use_quota=True,user_id='ec57153f08474572b49ba7aea3c8fb20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b94a29ed-5cec-458f-a03b-1b7cde95a226),volume_type_id=b94a29ed-5cec-458f-a03b-1b7cde95a226)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:34 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-e2bc7432-93f7-4d29-8a84-e898e9a591ea tempest-GroupsTest-1998620927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d31f39a9-56ad-444e-ac9e-51a610a709e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:34 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-e2bc7432-93f7-4d29-8a84-e898e9a591ea tempest-GroupsTest-1998620927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d31f39a9-56ad-444e-ac9e-51a610a709e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:34 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-e2bc7432-93f7-4d29-8a84-e898e9a591ea tempest-GroupsTest-1998620927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c9fea93-f1ac-481b-8b78-f55bc8a87588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:34 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-e2bc7432-93f7-4d29-8a84-e898e9a591ea tempest-GroupsTest-1998620927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c9fea93-f1ac-481b-8b78-f55bc8a87588) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd013c4a0-9fc7-49ee-92db-16801ac29968', 'volume_name': 'volume-d013c4a0-9fc7-49ee-92db-16801ac29968', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:34 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-e2bc7432-93f7-4d29-8a84-e898e9a591ea tempest-GroupsTest-1998620927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (165e68fc-c1d3-487c-a2ad-63865443a935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:34 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-e2bc7432-93f7-4d29-8a84-e898e9a591ea tempest-GroupsTest-1998620927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (165e68fc-c1d3-487c-a2ad-63865443a935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:34 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-e2bc7432-93f7-4d29-8a84-e898e9a591ea tempest-GroupsTest-1998620927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95e2e1a9-b7d4-4d71-9e64-a17d20029330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:34 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-e2bc7432-93f7-4d29-8a84-e898e9a591ea tempest-GroupsTest-1998620927 None] Volume d013c4a0-9fc7-49ee-92db-16801ac29968: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d013c4a0-9fc7-49ee-92db-16801ac29968', 'volume_size': 1}
Feb 27 01:25:34 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-e2bc7432-93f7-4d29-8a84-e898e9a591ea tempest-GroupsTest-1998620927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:34 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9f46e1f5-7c90-4e32-a3e8-609ef0df0812 tempest-VolumesDeleteCascade-678564053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5" returned: 0 in 0.664s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:34 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9f46e1f5-7c90-4e32-a3e8-609ef0df0812 tempest-VolumesDeleteCascade-678564053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5.b917fe9d-24d6-4bca-aa23-587fe0f4601f 1G {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:34 devstack sudo[87383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5.b917fe9d-24d6-4bca-aa23-587fe0f4601f 1G
Feb 27 01:25:34 devstack sudo[87383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:34 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa73e94b-e741-43b9-9860-de46604ddfd5 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:25:34 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-aa73e94b-e741-43b9-9860-de46604ddfd5 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Flow 'volume_create_manager' (99fd6aab-1c08-40a9-9477-083279cf431b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:25:34 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-aa73e94b-e741-43b9-9860-de46604ddfd5 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (420f4f89-6b81-480f-a720-46c9d8788222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:35 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-aa73e94b-e741-43b9-9860-de46604ddfd5 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (420f4f89-6b81-480f-a720-46c9d8788222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-853888642',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f3950da-f996-4947-95f2-22376678d243,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='890b57b41b78488484c44c93e4a49459',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:25:35Z,use_quota=True,user_id='de724b36a7b3440685b9e51cbfa71df0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:35 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-aa73e94b-e741-43b9-9860-de46604ddfd5 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edef0ac2-1159-43ca-a6ee-74318379ba0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:35 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-aa73e94b-e741-43b9-9860-de46604ddfd5 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edef0ac2-1159-43ca-a6ee-74318379ba0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:35 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-aa73e94b-e741-43b9-9860-de46604ddfd5 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf099d6c-fac1-4b5c-8be3-059e68e409bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:35 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-aa73e94b-e741-43b9-9860-de46604ddfd5 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf099d6c-fac1-4b5c-8be3-059e68e409bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f3950da-f996-4947-95f2-22376678d243', 'volume_name': 'volume-8f3950da-f996-4947-95f2-22376678d243', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:35 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-aa73e94b-e741-43b9-9860-de46604ddfd5 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9edca05c-dc18-40b6-b3f6-c8a3afd77240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:35 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-aa73e94b-e741-43b9-9860-de46604ddfd5 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9edca05c-dc18-40b6-b3f6-c8a3afd77240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:35 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-aa73e94b-e741-43b9-9860-de46604ddfd5 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bc18524-df00-430a-902e-18984ae5c8d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:35 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-aa73e94b-e741-43b9-9860-de46604ddfd5 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Volume 8f3950da-f996-4947-95f2-22376678d243: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f3950da-f996-4947-95f2-22376678d243', 'volume_size': 1}
Feb 27 01:25:35 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-aa73e94b-e741-43b9-9860-de46604ddfd5 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:35 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-958f76c4-7163-4c5d-acae-62c3d78a3669 tempest-SnapshotsActionsTest-1161199312 None] Acquiring lock "cinder-f4cb7fea-935f-40f5-8093-ce89f2d2348a-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:35 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-958f76c4-7163-4c5d-acae-62c3d78a3669 tempest-SnapshotsActionsTest-1161199312 None] Lock "cinder-f4cb7fea-935f-40f5-8093-ce89f2d2348a-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:35 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-958f76c4-7163-4c5d-acae-62c3d78a3669 tempest-SnapshotsActionsTest-1161199312 None] Acquiring lock "cinder-quobyte-f4cb7fea-935f-40f5-8093-ce89f2d2348a" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:35 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-958f76c4-7163-4c5d-acae-62c3d78a3669 tempest-SnapshotsActionsTest-1161199312 None] Lock "cinder-quobyte-f4cb7fea-935f-40f5-8093-ce89f2d2348a" acquired by "delete_volume" :: waited 0.016s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:35 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f6a3ed-28a9-4f9f-905a-1b6a94431f20]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:35 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-958f76c4-7163-4c5d-acae-62c3d78a3669 tempest-SnapshotsActionsTest-1161199312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:35 devstack sudo[87388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a
Feb 27 01:25:35 devstack sudo[87388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:35 devstack sudo[87383]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:35 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9f46e1f5-7c90-4e32-a3e8-609ef0df0812 tempest-VolumesDeleteCascade-678564053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5.b917fe9d-24d6-4bca-aa23-587fe0f4601f 1G" returned: 0 in 0.572s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:35 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9f46e1f5-7c90-4e32-a3e8-609ef0df0812 tempest-VolumesDeleteCascade-678564053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5.b917fe9d-24d6-4bca-aa23-587fe0f4601f {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:35 devstack sudo[87390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5.b917fe9d-24d6-4bca-aa23-587fe0f4601f
Feb 27 01:25:35 devstack sudo[87390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:35 devstack sudo[87390]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:35 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9f46e1f5-7c90-4e32-a3e8-609ef0df0812 tempest-VolumesDeleteCascade-678564053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5.b917fe9d-24d6-4bca-aa23-587fe0f4601f" returned: 0 in 0.550s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:35 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-9f46e1f5-7c90-4e32-a3e8-609ef0df0812 tempest-VolumesDeleteCascade-678564053 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5.b917fe9d-24d6-4bca-aa23-587fe0f4601f is being set with open permissions: ugo+rw
Feb 27 01:25:35 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9f46e1f5-7c90-4e32-a3e8-609ef0df0812 tempest-VolumesDeleteCascade-678564053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5.b917fe9d-24d6-4bca-aa23-587fe0f4601f {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:35 devstack sudo[87388]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:35 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-958f76c4-7163-4c5d-acae-62c3d78a3669 tempest-SnapshotsActionsTest-1161199312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a" returned: 0 in 0.694s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:35 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-958f76c4-7163-4c5d-acae-62c3d78a3669 tempest-SnapshotsActionsTest-1161199312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:35 devstack sudo[87398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5.b917fe9d-24d6-4bca-aa23-587fe0f4601f
Feb 27 01:25:35 devstack sudo[87398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:35 devstack sudo[87399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a
Feb 27 01:25:35 devstack sudo[87399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:36 devstack sudo[87398]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:36 devstack sudo[87399]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:36 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9f46e1f5-7c90-4e32-a3e8-609ef0df0812 tempest-VolumesDeleteCascade-678564053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5.b917fe9d-24d6-4bca-aa23-587fe0f4601f" returned: 0 in 0.500s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:36 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-958f76c4-7163-4c5d-acae-62c3d78a3669 tempest-SnapshotsActionsTest-1161199312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f4cb7fea-935f-40f5-8093-ce89f2d2348a" returned: 0 in 0.489s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:36 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-958f76c4-7163-4c5d-acae-62c3d78a3669 tempest-SnapshotsActionsTest-1161199312 None] Lock "cinder-quobyte-f4cb7fea-935f-40f5-8093-ce89f2d2348a" released by "delete_volume" :: held 1.224s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:36 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9f46e1f5-7c90-4e32-a3e8-609ef0df0812 tempest-VolumesDeleteCascade-678564053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5.info {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:36 devstack sudo[87404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5.info
Feb 27 01:25:36 devstack sudo[87404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:36 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-958f76c4-7163-4c5d-acae-62c3d78a3669 tempest-SnapshotsActionsTest-1161199312 None] Created reservations ['a86528e4-c9ee-4b97-ad64-645601bfce22', '1525614f-9486-49a6-8540-19259b78e203', 'fc09bf5c-deef-4343-971e-f7537bd916a0', '2a114678-b940-4923-ba76-187021c3d192'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:25:36 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-958f76c4-7163-4c5d-acae-62c3d78a3669 tempest-SnapshotsActionsTest-1161199312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:36 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-958f76c4-7163-4c5d-acae-62c3d78a3669 tempest-SnapshotsActionsTest-1161199312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:36 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-958f76c4-7163-4c5d-acae-62c3d78a3669 tempest-SnapshotsActionsTest-1161199312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:25:36 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-958f76c4-7163-4c5d-acae-62c3d78a3669 tempest-SnapshotsActionsTest-1161199312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:25:36 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-958f76c4-7163-4c5d-acae-62c3d78a3669 tempest-SnapshotsActionsTest-1161199312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:36 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-958f76c4-7163-4c5d-acae-62c3d78a3669 tempest-SnapshotsActionsTest-1161199312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:36 devstack sudo[87406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:25:36 devstack sudo[87406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:36 devstack sudo[87404]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:36 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9f46e1f5-7c90-4e32-a3e8-609ef0df0812 tempest-VolumesDeleteCascade-678564053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5.info" returned: 0 in 0.422s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:36 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-9f46e1f5-7c90-4e32-a3e8-609ef0df0812 tempest-VolumesDeleteCascade-678564053 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5.info is being set with open permissions: ugo+rw
Feb 27 01:25:36 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9f46e1f5-7c90-4e32-a3e8-609ef0df0812 tempest-VolumesDeleteCascade-678564053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5.info {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:36 devstack sudo[87409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5.info
Feb 27 01:25:36 devstack sudo[87409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:37 devstack sudo[87406]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-958f76c4-7163-4c5d-acae-62c3d78a3669 tempest-SnapshotsActionsTest-1161199312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.528s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:37 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-958f76c4-7163-4c5d-acae-62c3d78a3669 tempest-SnapshotsActionsTest-1161199312 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:25:37 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-958f76c4-7163-4c5d-acae-62c3d78a3669 tempest-SnapshotsActionsTest-1161199312 None] Deleted volume successfully.
Feb 27 01:25:37 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-958f76c4-7163-4c5d-acae-62c3d78a3669 tempest-SnapshotsActionsTest-1161199312 None] Lock "cinder-f4cb7fea-935f-40f5-8093-ce89f2d2348a-delete_volume" released by "delete_volume" :: held 2.000s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:37 devstack sudo[87409]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9f46e1f5-7c90-4e32-a3e8-609ef0df0812 tempest-VolumesDeleteCascade-678564053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5.info" returned: 0 in 0.456s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-9f46e1f5-7c90-4e32-a3e8-609ef0df0812 tempest-VolumesDeleteCascade-678564053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.288s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-e2bc7432-93f7-4d29-8a84-e898e9a591ea tempest-GroupsTest-1998620927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.575s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:37 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-e2bc7432-93f7-4d29-8a84-e898e9a591ea tempest-GroupsTest-1998620927 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=369ffc10-2812-4096-bc33-8c238e4c6c21,created_at=2026-02-27T00:25:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1490290421',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=369ffc10-2812-4096-bc33-8c238e4c6c21,host='devstack@QuobyteHD#QuobyteHD',id=d013c4a0-9fc7-49ee-92db-16801ac29968,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd01644ed2e94ed99424631bd3db4d45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:25:35Z,use_quota=True,user_id='ec57153f08474572b49ba7aea3c8fb20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b94a29ed-5cec-458f-a03b-1b7cde95a226),volume_type_id=b94a29ed-5cec-458f-a03b-1b7cde95a226)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:25:37 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-e2bc7432-93f7-4d29-8a84-e898e9a591ea tempest-GroupsTest-1998620927 None] Creating volume d013c4a0-9fc7-49ee-92db-16801ac29968 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:25:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-e2bc7432-93f7-4d29-8a84-e898e9a591ea tempest-GroupsTest-1998620927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-e2bc7432-93f7-4d29-8a84-e898e9a591ea tempest-GroupsTest-1998620927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:37 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-e2bc7432-93f7-4d29-8a84-e898e9a591ea tempest-GroupsTest-1998620927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:25:37 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-e2bc7432-93f7-4d29-8a84-e898e9a591ea tempest-GroupsTest-1998620927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:25:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-e2bc7432-93f7-4d29-8a84-e898e9a591ea tempest-GroupsTest-1998620927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:37 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-e2bc7432-93f7-4d29-8a84-e898e9a591ea tempest-GroupsTest-1998620927 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:25:37 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-e2bc7432-93f7-4d29-8a84-e898e9a591ea tempest-GroupsTest-1998620927 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:25:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-e2bc7432-93f7-4d29-8a84-e898e9a591ea tempest-GroupsTest-1998620927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-d013c4a0-9fc7-49ee-92db-16801ac29968 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:37 devstack sudo[87413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-d013c4a0-9fc7-49ee-92db-16801ac29968 1073741824
Feb 27 01:25:37 devstack sudo[87413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:37 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-9f46e1f5-7c90-4e32-a3e8-609ef0df0812 tempest-VolumesDeleteCascade-678564053 None] Create snapshot completed successfully
Feb 27 01:25:37 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-00884f30-2402-4947-ad54-c70bf09bacbd tempest-VolumesDeleteCascade-678564053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:25:37 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-00884f30-2402-4947-ad54-c70bf09bacbd tempest-VolumesDeleteCascade-678564053 None] Flow 'volume_create_manager' (f9c4c746-6f82-462f-a2bb-7d17474afb75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:25:37 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-00884f30-2402-4947-ad54-c70bf09bacbd tempest-VolumesDeleteCascade-678564053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97c67ea5-9520-4833-ac67-770a8d72f250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:37 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-00884f30-2402-4947-ad54-c70bf09bacbd tempest-VolumesDeleteCascade-678564053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97c67ea5-9520-4833-ac67-770a8d72f250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:25:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2128254097',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c486af87-be5d-46ce-a62a-78a5af739808,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e23314fa89a64fb69ef0eeb80359765d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:25:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b917fe9d-24d6-4bca-aa23-587fe0f4601f,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:25:38Z,use_quota=True,user_id='b516876a5a1f4760b83f013927ad30ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:37 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-00884f30-2402-4947-ad54-c70bf09bacbd tempest-VolumesDeleteCascade-678564053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd6e5b88-6247-4212-9442-56b9e0ab5e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:37 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-00884f30-2402-4947-ad54-c70bf09bacbd tempest-VolumesDeleteCascade-678564053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd6e5b88-6247-4212-9442-56b9e0ab5e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:37 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-00884f30-2402-4947-ad54-c70bf09bacbd tempest-VolumesDeleteCascade-678564053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (152eddfd-19b5-4bf3-8d35-52859c7c152a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:37 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-00884f30-2402-4947-ad54-c70bf09bacbd tempest-VolumesDeleteCascade-678564053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (152eddfd-19b5-4bf3-8d35-52859c7c152a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c486af87-be5d-46ce-a62a-78a5af739808', 'volume_name': 'volume-c486af87-be5d-46ce-a62a-78a5af739808', 'volume_size': 1, 'snapshot_id': 'b917fe9d-24d6-4bca-aa23-587fe0f4601f'}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:37 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-00884f30-2402-4947-ad54-c70bf09bacbd tempest-VolumesDeleteCascade-678564053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9e6315a-12da-467e-9066-d82b9675aea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:37 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-00884f30-2402-4947-ad54-c70bf09bacbd tempest-VolumesDeleteCascade-678564053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9e6315a-12da-467e-9066-d82b9675aea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:37 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-00884f30-2402-4947-ad54-c70bf09bacbd tempest-VolumesDeleteCascade-678564053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8093d2d7-3ca0-49cd-9881-9099e952da79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:37 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-00884f30-2402-4947-ad54-c70bf09bacbd tempest-VolumesDeleteCascade-678564053 None] Volume c486af87-be5d-46ce-a62a-78a5af739808: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c486af87-be5d-46ce-a62a-78a5af739808', 'volume_size': 1, 'snapshot_id': 'b917fe9d-24d6-4bca-aa23-587fe0f4601f'}
Feb 27 01:25:38 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-00884f30-2402-4947-ad54-c70bf09bacbd tempest-VolumesDeleteCascade-678564053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:38 devstack sudo[87413]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:38 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-e2bc7432-93f7-4d29-8a84-e898e9a591ea tempest-GroupsTest-1998620927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-d013c4a0-9fc7-49ee-92db-16801ac29968 1073741824" returned: 0 in 0.717s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:38 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-e2bc7432-93f7-4d29-8a84-e898e9a591ea tempest-GroupsTest-1998620927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-d013c4a0-9fc7-49ee-92db-16801ac29968 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:38 devstack sudo[87418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-d013c4a0-9fc7-49ee-92db-16801ac29968
Feb 27 01:25:38 devstack sudo[87418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:38 devstack sudo[87418]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:38 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-e2bc7432-93f7-4d29-8a84-e898e9a591ea tempest-GroupsTest-1998620927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-d013c4a0-9fc7-49ee-92db-16801ac29968" returned: 0 in 0.515s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:38 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-e2bc7432-93f7-4d29-8a84-e898e9a591ea tempest-GroupsTest-1998620927 None] <== create_volume: return (1268ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:25:38 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-e2bc7432-93f7-4d29-8a84-e898e9a591ea tempest-GroupsTest-1998620927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.271s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:38 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-aa73e94b-e741-43b9-9860-de46604ddfd5 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.533s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:38 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-aa73e94b-e741-43b9-9860-de46604ddfd5 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-853888642',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f3950da-f996-4947-95f2-22376678d243,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='890b57b41b78488484c44c93e4a49459',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:25:35Z,use_quota=True,user_id='de724b36a7b3440685b9e51cbfa71df0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:25:38 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-aa73e94b-e741-43b9-9860-de46604ddfd5 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Creating volume 8f3950da-f996-4947-95f2-22376678d243 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:25:38 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-aa73e94b-e741-43b9-9860-de46604ddfd5 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:38 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-aa73e94b-e741-43b9-9860-de46604ddfd5 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:38 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-aa73e94b-e741-43b9-9860-de46604ddfd5 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:25:38 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-aa73e94b-e741-43b9-9860-de46604ddfd5 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:25:38 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-aa73e94b-e741-43b9-9860-de46604ddfd5 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:38 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-aa73e94b-e741-43b9-9860-de46604ddfd5 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:25:38 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-aa73e94b-e741-43b9-9860-de46604ddfd5 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:25:38 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-aa73e94b-e741-43b9-9860-de46604ddfd5 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8f3950da-f996-4947-95f2-22376678d243 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:38 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-e2bc7432-93f7-4d29-8a84-e898e9a591ea tempest-GroupsTest-1998620927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95e2e1a9-b7d4-4d71-9e64-a17d20029330) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d013c4a0-9fc7-49ee-92db-16801ac29968', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:38 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-e2bc7432-93f7-4d29-8a84-e898e9a591ea tempest-GroupsTest-1998620927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20ba898f-fff5-4ea6-bb08-216998db3b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:38 devstack sudo[87421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8f3950da-f996-4947-95f2-22376678d243 1073741824
Feb 27 01:25:38 devstack sudo[87421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:38 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-e2bc7432-93f7-4d29-8a84-e898e9a591ea tempest-GroupsTest-1998620927 None] Volume volume-d013c4a0-9fc7-49ee-92db-16801ac29968 (d013c4a0-9fc7-49ee-92db-16801ac29968): created successfully
Feb 27 01:25:38 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-e2bc7432-93f7-4d29-8a84-e898e9a591ea tempest-GroupsTest-1998620927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20ba898f-fff5-4ea6-bb08-216998db3b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:38 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-e2bc7432-93f7-4d29-8a84-e898e9a591ea tempest-GroupsTest-1998620927 None] Flow 'volume_create_manager' (49417959-148e-4bdf-ad62-9eadd7e5b48d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:25:38 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-e2bc7432-93f7-4d29-8a84-e898e9a591ea tempest-GroupsTest-1998620927 None] Created volume successfully.
Feb 27 01:25:39 devstack sudo[87421]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:39 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-6a5fb080-3364-4a63-9752-8ca9710d2e6d tempest-GroupsTest-1998620927 None] Update group completed successfully.
Feb 27 01:25:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-aa73e94b-e741-43b9-9860-de46604ddfd5 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8f3950da-f996-4947-95f2-22376678d243 1073741824" returned: 0 in 0.688s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-aa73e94b-e741-43b9-9860-de46604ddfd5 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8f3950da-f996-4947-95f2-22376678d243 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:39 devstack sudo[87426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8f3950da-f996-4947-95f2-22376678d243
Feb 27 01:25:39 devstack sudo[87426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:39 devstack sudo[87426]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-aa73e94b-e741-43b9-9860-de46604ddfd5 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8f3950da-f996-4947-95f2-22376678d243" returned: 0 in 0.514s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:39 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-aa73e94b-e741-43b9-9860-de46604ddfd5 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] <== create_volume: return (1233ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:25:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-aa73e94b-e741-43b9-9860-de46604ddfd5 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.237s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-00884f30-2402-4947-ad54-c70bf09bacbd tempest-VolumesDeleteCascade-678564053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.812s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:39 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-00884f30-2402-4947-ad54-c70bf09bacbd tempest-VolumesDeleteCascade-678564053 None] Acquiring lock "cinder-quobyte-b917fe9d-24d6-4bca-aa23-587fe0f4601f-c486af87-be5d-46ce-a62a-78a5af739808" by "_create_volume_from_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:39 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-aa73e94b-e741-43b9-9860-de46604ddfd5 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bc18524-df00-430a-902e-18984ae5c8d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f3950da-f996-4947-95f2-22376678d243', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:39 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-aa73e94b-e741-43b9-9860-de46604ddfd5 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd05660f-271e-4cb9-8dfa-28be61dc91b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:39 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-00884f30-2402-4947-ad54-c70bf09bacbd tempest-VolumesDeleteCascade-678564053 None] Lock "cinder-quobyte-b917fe9d-24d6-4bca-aa23-587fe0f4601f-c486af87-be5d-46ce-a62a-78a5af739808" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:39 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-00884f30-2402-4947-ad54-c70bf09bacbd tempest-VolumesDeleteCascade-678564053 None] Creating volume c486af87-be5d-46ce-a62a-78a5af739808 from snapshot b917fe9d-24d6-4bca-aa23-587fe0f4601f {{(pid=83106) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Feb 27 01:25:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-00884f30-2402-4947-ad54-c70bf09bacbd tempest-VolumesDeleteCascade-678564053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-00884f30-2402-4947-ad54-c70bf09bacbd tempest-VolumesDeleteCascade-678564053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:39 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-00884f30-2402-4947-ad54-c70bf09bacbd tempest-VolumesDeleteCascade-678564053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:25:39 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-00884f30-2402-4947-ad54-c70bf09bacbd tempest-VolumesDeleteCascade-678564053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:25:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-00884f30-2402-4947-ad54-c70bf09bacbd tempest-VolumesDeleteCascade-678564053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:39 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-00884f30-2402-4947-ad54-c70bf09bacbd tempest-VolumesDeleteCascade-678564053 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:25:39 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-00884f30-2402-4947-ad54-c70bf09bacbd tempest-VolumesDeleteCascade-678564053 None] Acquiring lock "cinder-quobyte-c486af87-be5d-46ce-a62a-78a5af739808" by "_copy_volume_from_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:39 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-aa73e94b-e741-43b9-9860-de46604ddfd5 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Volume volume-8f3950da-f996-4947-95f2-22376678d243 (8f3950da-f996-4947-95f2-22376678d243): created successfully
Feb 27 01:25:39 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-aa73e94b-e741-43b9-9860-de46604ddfd5 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd05660f-271e-4cb9-8dfa-28be61dc91b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:39 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-aa73e94b-e741-43b9-9860-de46604ddfd5 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Flow 'volume_create_manager' (99fd6aab-1c08-40a9-9477-083279cf431b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:25:39 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-00884f30-2402-4947-ad54-c70bf09bacbd tempest-VolumesDeleteCascade-678564053 None] Lock "cinder-quobyte-c486af87-be5d-46ce-a62a-78a5af739808" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:39 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-00884f30-2402-4947-ad54-c70bf09bacbd tempest-VolumesDeleteCascade-678564053 None] snapshot: b917fe9d-24d6-4bca-aa23-587fe0f4601f, volume: c486af87-be5d-46ce-a62a-78a5af739808,  {{(pid=83106) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Feb 27 01:25:39 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-aa73e94b-e741-43b9-9860-de46604ddfd5 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Created volume successfully.
Feb 27 01:25:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-00884f30-2402-4947-ad54-c70bf09bacbd tempest-VolumesDeleteCascade-678564053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-00884f30-2402-4947-ad54-c70bf09bacbd tempest-VolumesDeleteCascade-678564053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:39 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-00884f30-2402-4947-ad54-c70bf09bacbd tempest-VolumesDeleteCascade-678564053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:25:39 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-00884f30-2402-4947-ad54-c70bf09bacbd tempest-VolumesDeleteCascade-678564053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:25:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-00884f30-2402-4947-ad54-c70bf09bacbd tempest-VolumesDeleteCascade-678564053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:39 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[5745cb0a-1fdc-4745-a24c-26174db11135]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-00884f30-2402-4947-ad54-c70bf09bacbd tempest-VolumesDeleteCascade-678564053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5.b917fe9d-24d6-4bca-aa23-587fe0f4601f {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:40 devstack sudo[87429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5.b917fe9d-24d6-4bca-aa23-587fe0f4601f
Feb 27 01:25:40 devstack sudo[87429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:40 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-ad0938b6-132e-4ee6-ac76-62292e96ce61 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:40 devstack sudo[87429]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:40 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-00884f30-2402-4947-ad54-c70bf09bacbd tempest-VolumesDeleteCascade-678564053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5.b917fe9d-24d6-4bca-aa23-587fe0f4601f" returned: 0 in 0.585s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:40 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-00884f30-2402-4947-ad54-c70bf09bacbd tempest-VolumesDeleteCascade-678564053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83106) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:25:40 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-00884f30-2402-4947-ad54-c70bf09bacbd tempest-VolumesDeleteCascade-678564053 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5 {{(pid=83106) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Feb 27 01:25:40 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-00884f30-2402-4947-ad54-c70bf09bacbd tempest-VolumesDeleteCascade-678564053 None] Creating direct copy from snapshot {{(pid=83106) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Feb 27 01:25:40 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8abc74b-e730-41c8-b539-b30b971b56aa]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:40 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-00884f30-2402-4947-ad54-c70bf09bacbd tempest-VolumesDeleteCascade-678564053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:40 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-1763c920-8d70-4646-bf8b-1ff2b1b2bf38 tempest-GroupsTest-1998620927 None] Update group completed successfully.
Feb 27 01:25:40 devstack sudo[87434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5
Feb 27 01:25:40 devstack sudo[87434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:41 devstack sudo[87434]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:41 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-00884f30-2402-4947-ad54-c70bf09bacbd tempest-VolumesDeleteCascade-678564053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5" returned: 0 in 0.583s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:41 devstack cinder-volume[83106]: DEBUG cinder.utils [None req-00884f30-2402-4947-ad54-c70bf09bacbd tempest-VolumesDeleteCascade-678564053 None] Path /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c486af87-be5d-46ce-a62a-78a5af739808 not found in is_blk_device check {{(pid=83106) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Feb 27 01:25:41 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-00884f30-2402-4947-ad54-c70bf09bacbd tempest-VolumesDeleteCascade-678564053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c486af87-be5d-46ce-a62a-78a5af739808 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:41 devstack sudo[87439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c486af87-be5d-46ce-a62a-78a5af739808
Feb 27 01:25:41 devstack sudo[87439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:41 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-eeb0e157-86d8-42fd-b06c-b03139f23850 tempest-VolumeQuotasNegativeTestJSON-1665835495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:25:41 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-eeb0e157-86d8-42fd-b06c-b03139f23850 tempest-VolumeQuotasNegativeTestJSON-1665835495 None] Flow 'volume_create_manager' (cae99f55-02f9-468d-8d2e-d43810046f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:25:41 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-eeb0e157-86d8-42fd-b06c-b03139f23850 tempest-VolumeQuotasNegativeTestJSON-1665835495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe62c0fa-dffe-4884-b14e-d9f69b52c347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:41 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-eeb0e157-86d8-42fd-b06c-b03139f23850 tempest-VolumeQuotasNegativeTestJSON-1665835495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe62c0fa-dffe-4884-b14e-d9f69b52c347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:25:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-167375040',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38832f51-01e1-4f3b-b858-68a4f8cd95f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9b53b9140b04b25bd552d70c5a6cd59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:25:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:25:41Z,use_quota=True,user_id='5044906a0e3b4efba13044d1f8b8a06a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:41 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-eeb0e157-86d8-42fd-b06c-b03139f23850 tempest-VolumeQuotasNegativeTestJSON-1665835495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb78c478-32d2-4e10-b8fa-a33e365a27c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:41 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-eeb0e157-86d8-42fd-b06c-b03139f23850 tempest-VolumeQuotasNegativeTestJSON-1665835495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb78c478-32d2-4e10-b8fa-a33e365a27c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:41 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-eeb0e157-86d8-42fd-b06c-b03139f23850 tempest-VolumeQuotasNegativeTestJSON-1665835495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0273ff9a-148c-4858-b288-de9fd09916c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:41 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-eeb0e157-86d8-42fd-b06c-b03139f23850 tempest-VolumeQuotasNegativeTestJSON-1665835495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0273ff9a-148c-4858-b288-de9fd09916c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38832f51-01e1-4f3b-b858-68a4f8cd95f0', 'volume_name': 'volume-38832f51-01e1-4f3b-b858-68a4f8cd95f0', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:41 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-eeb0e157-86d8-42fd-b06c-b03139f23850 tempest-VolumeQuotasNegativeTestJSON-1665835495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2531a682-0877-4f3d-9032-b841e01b93f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:41 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-eeb0e157-86d8-42fd-b06c-b03139f23850 tempest-VolumeQuotasNegativeTestJSON-1665835495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2531a682-0877-4f3d-9032-b841e01b93f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:41 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-eeb0e157-86d8-42fd-b06c-b03139f23850 tempest-VolumeQuotasNegativeTestJSON-1665835495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c852bb0c-0a13-43e9-9fb1-d1645478c76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:41 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-eeb0e157-86d8-42fd-b06c-b03139f23850 tempest-VolumeQuotasNegativeTestJSON-1665835495 None] Volume 38832f51-01e1-4f3b-b858-68a4f8cd95f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38832f51-01e1-4f3b-b858-68a4f8cd95f0', 'volume_size': 1}
Feb 27 01:25:41 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-eeb0e157-86d8-42fd-b06c-b03139f23850 tempest-VolumeQuotasNegativeTestJSON-1665835495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:42 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-072d1ec7-a9e5-46ee-83e1-e77bed58b61e tempest-GroupsTest-1998620927 None] Acquiring lock "cinder-quobyte-d013c4a0-9fc7-49ee-92db-16801ac29968" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:42 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-072d1ec7-a9e5-46ee-83e1-e77bed58b61e tempest-GroupsTest-1998620927 None] Lock "cinder-quobyte-d013c4a0-9fc7-49ee-92db-16801ac29968" acquired by "delete_volume" :: waited 0.025s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:42 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f35268-400c-4588-a3cc-1ef743dd50a5]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:42 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-072d1ec7-a9e5-46ee-83e1-e77bed58b61e tempest-GroupsTest-1998620927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-d013c4a0-9fc7-49ee-92db-16801ac29968 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:42 devstack sudo[87452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-d013c4a0-9fc7-49ee-92db-16801ac29968
Feb 27 01:25:42 devstack sudo[87452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:43 devstack sudo[87439]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:43 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-00884f30-2402-4947-ad54-c70bf09bacbd tempest-VolumesDeleteCascade-678564053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c486af87-be5d-46ce-a62a-78a5af739808" returned: 0 in 2.679s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:43 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e99c00b-9c16-40f1-9e53-ff32b8109b7a]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:43 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-00884f30-2402-4947-ad54-c70bf09bacbd tempest-VolumesDeleteCascade-678564053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:43 devstack sudo[87452]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:43 devstack sudo[87458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5
Feb 27 01:25:43 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-072d1ec7-a9e5-46ee-83e1-e77bed58b61e tempest-GroupsTest-1998620927 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-d013c4a0-9fc7-49ee-92db-16801ac29968" returned: 0 in 1.354s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:43 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-072d1ec7-a9e5-46ee-83e1-e77bed58b61e tempest-GroupsTest-1998620927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-d013c4a0-9fc7-49ee-92db-16801ac29968 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:43 devstack sudo[87458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:43 devstack sudo[87460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-d013c4a0-9fc7-49ee-92db-16801ac29968
Feb 27 01:25:43 devstack sudo[87460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:44 devstack sudo[87460]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:44 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-072d1ec7-a9e5-46ee-83e1-e77bed58b61e tempest-GroupsTest-1998620927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-d013c4a0-9fc7-49ee-92db-16801ac29968" returned: 0 in 0.435s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:44 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-072d1ec7-a9e5-46ee-83e1-e77bed58b61e tempest-GroupsTest-1998620927 None] Lock "cinder-quobyte-d013c4a0-9fc7-49ee-92db-16801ac29968" released by "delete_volume" :: held 1.853s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:44 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-072d1ec7-a9e5-46ee-83e1-e77bed58b61e tempest-GroupsTest-1998620927 None] Acquiring lock "cinder-quobyte-f453d81d-eacd-4c39-a6f3-a3632dd47a7b" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:44 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-072d1ec7-a9e5-46ee-83e1-e77bed58b61e tempest-GroupsTest-1998620927 None] Lock "cinder-quobyte-f453d81d-eacd-4c39-a6f3-a3632dd47a7b" acquired by "delete_volume" :: waited 0.007s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:44 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b605a6f-4d96-4043-b6fc-983ec311a1e5]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:44 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-072d1ec7-a9e5-46ee-83e1-e77bed58b61e tempest-GroupsTest-1998620927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f453d81d-eacd-4c39-a6f3-a3632dd47a7b {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:44 devstack sudo[87465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f453d81d-eacd-4c39-a6f3-a3632dd47a7b
Feb 27 01:25:44 devstack sudo[87465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:44 devstack sudo[87458]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:44 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-00884f30-2402-4947-ad54-c70bf09bacbd tempest-VolumesDeleteCascade-678564053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5" returned: 0 in 0.644s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:44 devstack cinder-volume[83106]: DEBUG cinder.image.image_utils [None req-00884f30-2402-4947-ad54-c70bf09bacbd tempest-VolumesDeleteCascade-678564053 None] Image conversion details: src /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5, size 1024.00 MB, duration 2.68 sec, destination /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c486af87-be5d-46ce-a62a-78a5af739808 {{(pid=83106) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 27 01:25:44 devstack cinder-volume[83106]: INFO cinder.image.image_utils [None req-00884f30-2402-4947-ad54-c70bf09bacbd tempest-VolumesDeleteCascade-678564053 None] Converted 1024.00 MB image at 381.94 MB/s
Feb 27 01:25:44 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-00884f30-2402-4947-ad54-c70bf09bacbd tempest-VolumesDeleteCascade-678564053 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c486af87-be5d-46ce-a62a-78a5af739808 is being set with open permissions: ugo+rw
Feb 27 01:25:44 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-00884f30-2402-4947-ad54-c70bf09bacbd tempest-VolumesDeleteCascade-678564053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c486af87-be5d-46ce-a62a-78a5af739808 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:44 devstack sudo[87468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c486af87-be5d-46ce-a62a-78a5af739808
Feb 27 01:25:44 devstack sudo[87468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:44 devstack sudo[87468]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:44 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-00884f30-2402-4947-ad54-c70bf09bacbd tempest-VolumesDeleteCascade-678564053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c486af87-be5d-46ce-a62a-78a5af739808" returned: 0 in 0.451s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:44 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-00884f30-2402-4947-ad54-c70bf09bacbd tempest-VolumesDeleteCascade-678564053 None] Lock "cinder-quobyte-c486af87-be5d-46ce-a62a-78a5af739808" released by "_copy_volume_from_snapshot" :: held 5.022s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:44 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-00884f30-2402-4947-ad54-c70bf09bacbd tempest-VolumesDeleteCascade-678564053 None] Lock "cinder-quobyte-b917fe9d-24d6-4bca-aa23-587fe0f4601f-c486af87-be5d-46ce-a62a-78a5af739808" released by "_create_volume_from_snapshot" :: held 5.055s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:44 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-00884f30-2402-4947-ad54-c70bf09bacbd tempest-VolumesDeleteCascade-678564053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.079s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:44 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-ad0938b6-132e-4ee6-ac76-62292e96ce61 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.458s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:44 devstack sudo[87465]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:44 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-072d1ec7-a9e5-46ee-83e1-e77bed58b61e tempest-GroupsTest-1998620927 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f453d81d-eacd-4c39-a6f3-a3632dd47a7b" returned: 0 in 0.590s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:44 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-072d1ec7-a9e5-46ee-83e1-e77bed58b61e tempest-GroupsTest-1998620927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f453d81d-eacd-4c39-a6f3-a3632dd47a7b {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:44 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-00884f30-2402-4947-ad54-c70bf09bacbd tempest-VolumesDeleteCascade-678564053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8093d2d7-3ca0-49cd-9881-9099e952da79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c486af87-be5d-46ce-a62a-78a5af739808', 'volume_size': 1, 'snapshot_id': 'b917fe9d-24d6-4bca-aa23-587fe0f4601f'}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:44 devstack sudo[87474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f453d81d-eacd-4c39-a6f3-a3632dd47a7b
Feb 27 01:25:44 devstack sudo[87474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:44 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-00884f30-2402-4947-ad54-c70bf09bacbd tempest-VolumesDeleteCascade-678564053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0a443dc-7b22-4af8-9144-49750c45c35c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:44 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-ad0938b6-132e-4ee6-ac76-62292e96ce61 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Creating offline snapshot 12ae42f9-9964-4b97-98cb-7457101b5743 of volume 8f3950da-f996-4947-95f2-22376678d243 {{(pid=83106) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:25:44 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-00884f30-2402-4947-ad54-c70bf09bacbd tempest-VolumesDeleteCascade-678564053 None] Volume volume-c486af87-be5d-46ce-a62a-78a5af739808 (c486af87-be5d-46ce-a62a-78a5af739808): created successfully
Feb 27 01:25:44 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-00884f30-2402-4947-ad54-c70bf09bacbd tempest-VolumesDeleteCascade-678564053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0a443dc-7b22-4af8-9144-49750c45c35c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:44 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-00884f30-2402-4947-ad54-c70bf09bacbd tempest-VolumesDeleteCascade-678564053 None] Flow 'volume_create_manager' (f9c4c746-6f82-462f-a2bb-7d17474afb75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:25:44 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[022e773e-1c08-4241-997e-bf3555b7dc39]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:44 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ad0938b6-132e-4ee6-ac76-62292e96ce61 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8f3950da-f996-4947-95f2-22376678d243 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:44 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-00884f30-2402-4947-ad54-c70bf09bacbd tempest-VolumesDeleteCascade-678564053 None] Created volume successfully.
Feb 27 01:25:45 devstack sudo[87476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8f3950da-f996-4947-95f2-22376678d243
Feb 27 01:25:45 devstack sudo[87476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:45 devstack sudo[87474]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:45 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-072d1ec7-a9e5-46ee-83e1-e77bed58b61e tempest-GroupsTest-1998620927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f453d81d-eacd-4c39-a6f3-a3632dd47a7b" returned: 0 in 0.429s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:45 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-072d1ec7-a9e5-46ee-83e1-e77bed58b61e tempest-GroupsTest-1998620927 None] Lock "cinder-quobyte-f453d81d-eacd-4c39-a6f3-a3632dd47a7b" released by "delete_volume" :: held 1.042s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:45 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-072d1ec7-a9e5-46ee-83e1-e77bed58b61e tempest-GroupsTest-1998620927 None] Created reservations ['0f262c9d-d079-4b1a-a58d-180a140eab8c'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:25:45 devstack cinder-volume[83106]: WARNING cinder.quota [None req-072d1ec7-a9e5-46ee-83e1-e77bed58b61e tempest-GroupsTest-1998620927 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1772814791 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1772814791, it is now deprecated. Please use the default quota class for default quota.
Feb 27 01:25:45 devstack cinder-volume[83106]: WARNING cinder.quota [None req-072d1ec7-a9e5-46ee-83e1-e77bed58b61e tempest-GroupsTest-1998620927 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1772814791 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1772814791, it is now deprecated. Please use the default quota class for default quota.
Feb 27 01:25:45 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-072d1ec7-a9e5-46ee-83e1-e77bed58b61e tempest-GroupsTest-1998620927 None] Created reservations ['b0c4b09a-2328-4399-9df3-d5ee7321bc45', 'f6cfe733-ab38-4d03-91ae-dc7c96e37952', 'b0b90f13-6a31-41cc-a540-52c156d16d93', '562acd76-2fce-40a9-bf8d-436ba4b1995b'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:25:45 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-717dc627-cf74-4afa-bcf8-97d8e61cc22f tempest-VolumesDeleteCascade-678564053 None] Acquiring lock "cinder-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:45 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-717dc627-cf74-4afa-bcf8-97d8e61cc22f tempest-VolumesDeleteCascade-678564053 None] Lock "cinder-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:45 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-717dc627-cf74-4afa-bcf8-97d8e61cc22f tempest-VolumesDeleteCascade-678564053 None] Performing cascade delete. {{(pid=83106) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Feb 27 01:25:45 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-717dc627-cf74-4afa-bcf8-97d8e61cc22f tempest-VolumesDeleteCascade-678564053 None] Acquiring lock "cinder-b917fe9d-24d6-4bca-aa23-587fe0f4601f-delete_snapshot" by "delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:45 devstack sudo[87476]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:45 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ad0938b6-132e-4ee6-ac76-62292e96ce61 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8f3950da-f996-4947-95f2-22376678d243" returned: 0 in 0.593s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:45 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ad0938b6-132e-4ee6-ac76-62292e96ce61 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8f3950da-f996-4947-95f2-22376678d243,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8f3950da-f996-4947-95f2-22376678d243.12ae42f9-9964-4b97-98cb-7457101b5743 1G {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:45 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-717dc627-cf74-4afa-bcf8-97d8e61cc22f tempest-VolumesDeleteCascade-678564053 None] Lock "cinder-b917fe9d-24d6-4bca-aa23-587fe0f4601f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:45 devstack sudo[87482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8f3950da-f996-4947-95f2-22376678d243,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8f3950da-f996-4947-95f2-22376678d243.12ae42f9-9964-4b97-98cb-7457101b5743 1G
Feb 27 01:25:45 devstack sudo[87482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:45 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-717dc627-cf74-4afa-bcf8-97d8e61cc22f tempest-VolumesDeleteCascade-678564053 None] Acquiring lock "cinder-quobyte-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5" by "delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:45 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-717dc627-cf74-4afa-bcf8-97d8e61cc22f tempest-VolumesDeleteCascade-678564053 None] Lock "cinder-quobyte-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5" acquired by "delete_snapshot" :: waited 0.026s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:45 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-717dc627-cf74-4afa-bcf8-97d8e61cc22f tempest-VolumesDeleteCascade-678564053 None] Acquiring lock "cinder-quobyte-b917fe9d-24d6-4bca-aa23-587fe0f4601f" by "_delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:45 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-072d1ec7-a9e5-46ee-83e1-e77bed58b61e tempest-GroupsTest-1998620927 None] Created reservations ['8750c7ba-f721-4c1b-b2c8-3cc48eb30c23', '41d49f59-357b-48c7-8386-6e43937b3485', 'c52732c3-2687-4020-b07e-01cca0e65ecd', '551d2f38-763f-4986-928b-6419486d82e5'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:25:45 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-717dc627-cf74-4afa-bcf8-97d8e61cc22f tempest-VolumesDeleteCascade-678564053 None] Lock "cinder-quobyte-b917fe9d-24d6-4bca-aa23-587fe0f4601f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:45 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-717dc627-cf74-4afa-bcf8-97d8e61cc22f tempest-VolumesDeleteCascade-678564053 None] Deleting offline snapshot b917fe9d-24d6-4bca-aa23-587fe0f4601f of volume 5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5 {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:25:45 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-717dc627-cf74-4afa-bcf8-97d8e61cc22f tempest-VolumesDeleteCascade-678564053 None] snapshot_file for this snap is: volume-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5.b917fe9d-24d6-4bca-aa23-587fe0f4601f {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:25:45 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[77207ab2-37b5-4bec-b065-f3507dbac89b]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:45 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-717dc627-cf74-4afa-bcf8-97d8e61cc22f tempest-VolumesDeleteCascade-678564053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5.b917fe9d-24d6-4bca-aa23-587fe0f4601f {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:45 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-072d1ec7-a9e5-46ee-83e1-e77bed58b61e tempest-GroupsTest-1998620927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:45 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-072d1ec7-a9e5-46ee-83e1-e77bed58b61e tempest-GroupsTest-1998620927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:45 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-072d1ec7-a9e5-46ee-83e1-e77bed58b61e tempest-GroupsTest-1998620927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:25:45 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-072d1ec7-a9e5-46ee-83e1-e77bed58b61e tempest-GroupsTest-1998620927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:25:45 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-072d1ec7-a9e5-46ee-83e1-e77bed58b61e tempest-GroupsTest-1998620927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:45 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-072d1ec7-a9e5-46ee-83e1-e77bed58b61e tempest-GroupsTest-1998620927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:45 devstack sudo[87485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:25:45 devstack sudo[87485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:45 devstack sudo[87484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5.b917fe9d-24d6-4bca-aa23-587fe0f4601f
Feb 27 01:25:45 devstack sudo[87484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:46 devstack sudo[87482]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:46 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ad0938b6-132e-4ee6-ac76-62292e96ce61 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8f3950da-f996-4947-95f2-22376678d243,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8f3950da-f996-4947-95f2-22376678d243.12ae42f9-9964-4b97-98cb-7457101b5743 1G" returned: 0 in 0.633s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:46 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ad0938b6-132e-4ee6-ac76-62292e96ce61 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f3950da-f996-4947-95f2-22376678d243 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8f3950da-f996-4947-95f2-22376678d243.12ae42f9-9964-4b97-98cb-7457101b5743 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:46 devstack sudo[87495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f3950da-f996-4947-95f2-22376678d243 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8f3950da-f996-4947-95f2-22376678d243.12ae42f9-9964-4b97-98cb-7457101b5743
Feb 27 01:25:46 devstack sudo[87495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:46 devstack sudo[87485]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:46 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-072d1ec7-a9e5-46ee-83e1-e77bed58b61e tempest-GroupsTest-1998620927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.523s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:46 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-072d1ec7-a9e5-46ee-83e1-e77bed58b61e tempest-GroupsTest-1998620927 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:25:46 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-072d1ec7-a9e5-46ee-83e1-e77bed58b61e tempest-GroupsTest-1998620927 None] Delete group completed successfully.
Feb 27 01:25:46 devstack sudo[87484]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:46 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-717dc627-cf74-4afa-bcf8-97d8e61cc22f tempest-VolumesDeleteCascade-678564053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5.b917fe9d-24d6-4bca-aa23-587fe0f4601f" returned: 0 in 0.613s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:46 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-717dc627-cf74-4afa-bcf8-97d8e61cc22f tempest-VolumesDeleteCascade-678564053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83106) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:25:46 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc0978a1-a3c6-49a6-aa68-3de681dc2a47]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:46 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-717dc627-cf74-4afa-bcf8-97d8e61cc22f tempest-VolumesDeleteCascade-678564053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:46 devstack sudo[87497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5
Feb 27 01:25:46 devstack sudo[87497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:46 devstack sudo[87495]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:46 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ad0938b6-132e-4ee6-ac76-62292e96ce61 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f3950da-f996-4947-95f2-22376678d243 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8f3950da-f996-4947-95f2-22376678d243.12ae42f9-9964-4b97-98cb-7457101b5743" returned: 0 in 0.534s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:46 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-ad0938b6-132e-4ee6-ac76-62292e96ce61 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8f3950da-f996-4947-95f2-22376678d243.12ae42f9-9964-4b97-98cb-7457101b5743 is being set with open permissions: ugo+rw
Feb 27 01:25:46 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ad0938b6-132e-4ee6-ac76-62292e96ce61 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8f3950da-f996-4947-95f2-22376678d243.12ae42f9-9964-4b97-98cb-7457101b5743 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:46 devstack sudo[87502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8f3950da-f996-4947-95f2-22376678d243.12ae42f9-9964-4b97-98cb-7457101b5743
Feb 27 01:25:46 devstack sudo[87502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:46 devstack sudo[87497]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:46 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-717dc627-cf74-4afa-bcf8-97d8e61cc22f tempest-VolumesDeleteCascade-678564053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5" returned: 0 in 0.617s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:46 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-717dc627-cf74-4afa-bcf8-97d8e61cc22f tempest-VolumesDeleteCascade-678564053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5.b917fe9d-24d6-4bca-aa23-587fe0f4601f {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:46 devstack sudo[87507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5.b917fe9d-24d6-4bca-aa23-587fe0f4601f
Feb 27 01:25:46 devstack sudo[87507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:47 devstack sudo[87502]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:47 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ad0938b6-132e-4ee6-ac76-62292e96ce61 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8f3950da-f996-4947-95f2-22376678d243.12ae42f9-9964-4b97-98cb-7457101b5743" returned: 0 in 0.459s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:47 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ad0938b6-132e-4ee6-ac76-62292e96ce61 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8f3950da-f996-4947-95f2-22376678d243.info {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:47 devstack sudo[87510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8f3950da-f996-4947-95f2-22376678d243.info
Feb 27 01:25:47 devstack sudo[87510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:47 devstack sudo[87507]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:47 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-717dc627-cf74-4afa-bcf8-97d8e61cc22f tempest-VolumesDeleteCascade-678564053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5.b917fe9d-24d6-4bca-aa23-587fe0f4601f" returned: 0 in 0.557s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:47 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-717dc627-cf74-4afa-bcf8-97d8e61cc22f tempest-VolumesDeleteCascade-678564053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5.b917fe9d-24d6-4bca-aa23-587fe0f4601f {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:47 devstack sudo[87515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5.b917fe9d-24d6-4bca-aa23-587fe0f4601f
Feb 27 01:25:47 devstack sudo[87515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:47 devstack sudo[87510]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:47 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ad0938b6-132e-4ee6-ac76-62292e96ce61 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8f3950da-f996-4947-95f2-22376678d243.info" returned: 0 in 0.523s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:47 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-ad0938b6-132e-4ee6-ac76-62292e96ce61 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8f3950da-f996-4947-95f2-22376678d243.info is being set with open permissions: ugo+rw
Feb 27 01:25:47 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ad0938b6-132e-4ee6-ac76-62292e96ce61 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8f3950da-f996-4947-95f2-22376678d243.info {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:47 devstack sudo[87518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8f3950da-f996-4947-95f2-22376678d243.info
Feb 27 01:25:47 devstack sudo[87518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:47 devstack sudo[87515]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:47 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-717dc627-cf74-4afa-bcf8-97d8e61cc22f tempest-VolumesDeleteCascade-678564053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5.b917fe9d-24d6-4bca-aa23-587fe0f4601f" returned: 0 in 0.491s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:47 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-717dc627-cf74-4afa-bcf8-97d8e61cc22f tempest-VolumesDeleteCascade-678564053 None] Lock "cinder-quobyte-b917fe9d-24d6-4bca-aa23-587fe0f4601f" released by "_delete_snapshot" :: held 2.360s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:47 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-717dc627-cf74-4afa-bcf8-97d8e61cc22f tempest-VolumesDeleteCascade-678564053 None] Lock "cinder-quobyte-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5" released by "delete_snapshot" :: held 2.382s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:48 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-717dc627-cf74-4afa-bcf8-97d8e61cc22f tempest-VolumesDeleteCascade-678564053 None] Created reservations ['11f469f3-91b6-4b11-b2c7-24957e7eca6d', 'd8bb65ec-c98e-4fee-9f06-388d08a73c85', '2b44aee0-388c-411e-989f-0d01049f1334', '420527ac-3d81-4e22-9889-13d686eb261b'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:25:48 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-717dc627-cf74-4afa-bcf8-97d8e61cc22f tempest-VolumesDeleteCascade-678564053 None] Delete snapshot completed successfully.
Feb 27 01:25:48 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-717dc627-cf74-4afa-bcf8-97d8e61cc22f tempest-VolumesDeleteCascade-678564053 None] Lock "cinder-b917fe9d-24d6-4bca-aa23-587fe0f4601f-delete_snapshot" released by "delete_snapshot" :: held 2.513s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:48 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-717dc627-cf74-4afa-bcf8-97d8e61cc22f tempest-VolumesDeleteCascade-678564053 None] Snapshots deleted, issuing volume delete {{(pid=83106) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Feb 27 01:25:48 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-717dc627-cf74-4afa-bcf8-97d8e61cc22f tempest-VolumesDeleteCascade-678564053 None] Acquiring lock "cinder-quobyte-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:48 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-717dc627-cf74-4afa-bcf8-97d8e61cc22f tempest-VolumesDeleteCascade-678564053 None] Lock "cinder-quobyte-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5" acquired by "delete_volume" :: waited 0.007s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:48 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[a602e0a2-f97a-4a1a-b8f3-78435cbff2c3]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:48 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-717dc627-cf74-4afa-bcf8-97d8e61cc22f tempest-VolumesDeleteCascade-678564053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:48 devstack sudo[87521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5
Feb 27 01:25:48 devstack sudo[87521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:48 devstack sudo[87518]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:48 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ad0938b6-132e-4ee6-ac76-62292e96ce61 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8f3950da-f996-4947-95f2-22376678d243.info" returned: 0 in 0.509s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:48 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-ad0938b6-132e-4ee6-ac76-62292e96ce61 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.365s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:48 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-eeb0e157-86d8-42fd-b06c-b03139f23850 tempest-VolumeQuotasNegativeTestJSON-1665835495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.067s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:48 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-eeb0e157-86d8-42fd-b06c-b03139f23850 tempest-VolumeQuotasNegativeTestJSON-1665835495 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:25:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-167375040',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38832f51-01e1-4f3b-b858-68a4f8cd95f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9b53b9140b04b25bd552d70c5a6cd59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:25:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:25:41Z,use_quota=True,user_id='5044906a0e3b4efba13044d1f8b8a06a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:25:48 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-eeb0e157-86d8-42fd-b06c-b03139f23850 tempest-VolumeQuotasNegativeTestJSON-1665835495 None] Creating volume 38832f51-01e1-4f3b-b858-68a4f8cd95f0 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:25:48 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-eeb0e157-86d8-42fd-b06c-b03139f23850 tempest-VolumeQuotasNegativeTestJSON-1665835495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:48 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-eeb0e157-86d8-42fd-b06c-b03139f23850 tempest-VolumeQuotasNegativeTestJSON-1665835495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:48 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-eeb0e157-86d8-42fd-b06c-b03139f23850 tempest-VolumeQuotasNegativeTestJSON-1665835495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:25:48 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-eeb0e157-86d8-42fd-b06c-b03139f23850 tempest-VolumeQuotasNegativeTestJSON-1665835495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:25:48 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-eeb0e157-86d8-42fd-b06c-b03139f23850 tempest-VolumeQuotasNegativeTestJSON-1665835495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:48 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-eeb0e157-86d8-42fd-b06c-b03139f23850 tempest-VolumeQuotasNegativeTestJSON-1665835495 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:25:48 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-eeb0e157-86d8-42fd-b06c-b03139f23850 tempest-VolumeQuotasNegativeTestJSON-1665835495 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:25:48 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-eeb0e157-86d8-42fd-b06c-b03139f23850 tempest-VolumeQuotasNegativeTestJSON-1665835495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-38832f51-01e1-4f3b-b858-68a4f8cd95f0 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:48 devstack sudo[87524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-38832f51-01e1-4f3b-b858-68a4f8cd95f0 1073741824
Feb 27 01:25:48 devstack sudo[87524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:48 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-ad0938b6-132e-4ee6-ac76-62292e96ce61 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Create snapshot completed successfully
Feb 27 01:25:48 devstack sudo[87521]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:48 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-717dc627-cf74-4afa-bcf8-97d8e61cc22f tempest-VolumesDeleteCascade-678564053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5" returned: 0 in 0.547s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:48 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-717dc627-cf74-4afa-bcf8-97d8e61cc22f tempest-VolumesDeleteCascade-678564053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:48 devstack sudo[87529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5
Feb 27 01:25:48 devstack sudo[87529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:48 devstack sudo[87524]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:48 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-eeb0e157-86d8-42fd-b06c-b03139f23850 tempest-VolumeQuotasNegativeTestJSON-1665835495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-38832f51-01e1-4f3b-b858-68a4f8cd95f0 1073741824" returned: 0 in 0.653s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:48 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-eeb0e157-86d8-42fd-b06c-b03139f23850 tempest-VolumeQuotasNegativeTestJSON-1665835495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-38832f51-01e1-4f3b-b858-68a4f8cd95f0 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:49 devstack sudo[87534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-38832f51-01e1-4f3b-b858-68a4f8cd95f0
Feb 27 01:25:49 devstack sudo[87534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:49 devstack sudo[87529]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-717dc627-cf74-4afa-bcf8-97d8e61cc22f tempest-VolumesDeleteCascade-678564053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5" returned: 0 in 0.521s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:49 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-11c7c1e4-828f-40a1-be68-df7927786bb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Acquiring lock "cinder-12ae42f9-9964-4b97-98cb-7457101b5743-delete_snapshot" by "delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:49 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-717dc627-cf74-4afa-bcf8-97d8e61cc22f tempest-VolumesDeleteCascade-678564053 None] Lock "cinder-quobyte-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5" released by "delete_volume" :: held 1.143s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:49 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-11c7c1e4-828f-40a1-be68-df7927786bb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Lock "cinder-12ae42f9-9964-4b97-98cb-7457101b5743-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:49 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-11c7c1e4-828f-40a1-be68-df7927786bb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Acquiring lock "cinder-quobyte-8f3950da-f996-4947-95f2-22376678d243" by "delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:49 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-11c7c1e4-828f-40a1-be68-df7927786bb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Lock "cinder-quobyte-8f3950da-f996-4947-95f2-22376678d243" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:49 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-11c7c1e4-828f-40a1-be68-df7927786bb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Acquiring lock "cinder-quobyte-12ae42f9-9964-4b97-98cb-7457101b5743" by "_delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:49 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-11c7c1e4-828f-40a1-be68-df7927786bb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Lock "cinder-quobyte-12ae42f9-9964-4b97-98cb-7457101b5743" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:49 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-11c7c1e4-828f-40a1-be68-df7927786bb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Deleting offline snapshot 12ae42f9-9964-4b97-98cb-7457101b5743 of volume 8f3950da-f996-4947-95f2-22376678d243 {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:25:49 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-11c7c1e4-828f-40a1-be68-df7927786bb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] snapshot_file for this snap is: volume-8f3950da-f996-4947-95f2-22376678d243.12ae42f9-9964-4b97-98cb-7457101b5743 {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:25:49 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3689c6e-05ef-4e70-ba8d-996ed4ac3ce2]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-11c7c1e4-828f-40a1-be68-df7927786bb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8f3950da-f996-4947-95f2-22376678d243.12ae42f9-9964-4b97-98cb-7457101b5743 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:49 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-717dc627-cf74-4afa-bcf8-97d8e61cc22f tempest-VolumesDeleteCascade-678564053 None] Created reservations ['5ca16088-7321-417a-bb6d-9c4b67310728', '94279780-ae32-40e4-8a53-ecf4ded508da', 'f61da3e8-542c-43ce-8c13-ec0194b582de', 'babce06e-db59-4d5f-b5e4-6a9381ad7943'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:25:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-717dc627-cf74-4afa-bcf8-97d8e61cc22f tempest-VolumesDeleteCascade-678564053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-717dc627-cf74-4afa-bcf8-97d8e61cc22f tempest-VolumesDeleteCascade-678564053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:49 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-717dc627-cf74-4afa-bcf8-97d8e61cc22f tempest-VolumesDeleteCascade-678564053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:25:49 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-717dc627-cf74-4afa-bcf8-97d8e61cc22f tempest-VolumesDeleteCascade-678564053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:25:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-717dc627-cf74-4afa-bcf8-97d8e61cc22f tempest-VolumesDeleteCascade-678564053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-717dc627-cf74-4afa-bcf8-97d8e61cc22f tempest-VolumesDeleteCascade-678564053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:49 devstack sudo[87537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8f3950da-f996-4947-95f2-22376678d243.12ae42f9-9964-4b97-98cb-7457101b5743
Feb 27 01:25:49 devstack sudo[87537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:49 devstack sudo[87538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:25:49 devstack sudo[87538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:49 devstack sudo[87534]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-eeb0e157-86d8-42fd-b06c-b03139f23850 tempest-VolumeQuotasNegativeTestJSON-1665835495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-38832f51-01e1-4f3b-b858-68a4f8cd95f0" returned: 0 in 0.537s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:49 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-eeb0e157-86d8-42fd-b06c-b03139f23850 tempest-VolumeQuotasNegativeTestJSON-1665835495 None] <== create_volume: return (1229ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:25:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-eeb0e157-86d8-42fd-b06c-b03139f23850 tempest-VolumeQuotasNegativeTestJSON-1665835495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.234s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:49 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-eeb0e157-86d8-42fd-b06c-b03139f23850 tempest-VolumeQuotasNegativeTestJSON-1665835495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c852bb0c-0a13-43e9-9fb1-d1645478c76e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38832f51-01e1-4f3b-b858-68a4f8cd95f0', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:49 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-eeb0e157-86d8-42fd-b06c-b03139f23850 tempest-VolumeQuotasNegativeTestJSON-1665835495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fe7c101-22d0-4b09-8103-44a30f33a010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:49 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-eeb0e157-86d8-42fd-b06c-b03139f23850 tempest-VolumeQuotasNegativeTestJSON-1665835495 None] Volume volume-38832f51-01e1-4f3b-b858-68a4f8cd95f0 (38832f51-01e1-4f3b-b858-68a4f8cd95f0): created successfully
Feb 27 01:25:49 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-eeb0e157-86d8-42fd-b06c-b03139f23850 tempest-VolumeQuotasNegativeTestJSON-1665835495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fe7c101-22d0-4b09-8103-44a30f33a010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:49 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-eeb0e157-86d8-42fd-b06c-b03139f23850 tempest-VolumeQuotasNegativeTestJSON-1665835495 None] Flow 'volume_create_manager' (cae99f55-02f9-468d-8d2e-d43810046f77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:25:49 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-eeb0e157-86d8-42fd-b06c-b03139f23850 tempest-VolumeQuotasNegativeTestJSON-1665835495 None] Created volume successfully.
Feb 27 01:25:49 devstack sudo[87538]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-717dc627-cf74-4afa-bcf8-97d8e61cc22f tempest-VolumesDeleteCascade-678564053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.489s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:49 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-717dc627-cf74-4afa-bcf8-97d8e61cc22f tempest-VolumesDeleteCascade-678564053 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:25:49 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-717dc627-cf74-4afa-bcf8-97d8e61cc22f tempest-VolumesDeleteCascade-678564053 None] Deleted volume successfully.
Feb 27 01:25:49 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-717dc627-cf74-4afa-bcf8-97d8e61cc22f tempest-VolumesDeleteCascade-678564053 None] Lock "cinder-5aa7b0b7-dcd1-4adc-9a5f-64466d6563d5-delete_volume" released by "delete_volume" :: held 4.394s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:49 devstack sudo[87537]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-11c7c1e4-828f-40a1-be68-df7927786bb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8f3950da-f996-4947-95f2-22376678d243.12ae42f9-9964-4b97-98cb-7457101b5743" returned: 0 in 0.651s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:49 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-11c7c1e4-828f-40a1-be68-df7927786bb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f3950da-f996-4947-95f2-22376678d243(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83106) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:25:49 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e29b1f2-781a-4405-879d-c514110219cc]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-11c7c1e4-828f-40a1-be68-df7927786bb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8f3950da-f996-4947-95f2-22376678d243 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:50 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-05c1918b-c57f-4eb8-83b2-70316b95bd38 tempest-VolumesDeleteCascade-678564053 None] Acquiring lock "cinder-c486af87-be5d-46ce-a62a-78a5af739808-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:50 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-05c1918b-c57f-4eb8-83b2-70316b95bd38 tempest-VolumesDeleteCascade-678564053 None] Lock "cinder-c486af87-be5d-46ce-a62a-78a5af739808-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:50 devstack sudo[87546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8f3950da-f996-4947-95f2-22376678d243
Feb 27 01:25:50 devstack sudo[87546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:50 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-05c1918b-c57f-4eb8-83b2-70316b95bd38 tempest-VolumesDeleteCascade-678564053 None] Acquiring lock "cinder-quobyte-c486af87-be5d-46ce-a62a-78a5af739808" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:50 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-05c1918b-c57f-4eb8-83b2-70316b95bd38 tempest-VolumesDeleteCascade-678564053 None] Lock "cinder-quobyte-c486af87-be5d-46ce-a62a-78a5af739808" acquired by "delete_volume" :: waited 0.009s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:50 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a673a9-cbc8-4e51-b3fb-d53571ba055f]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:50 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-05c1918b-c57f-4eb8-83b2-70316b95bd38 tempest-VolumesDeleteCascade-678564053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c486af87-be5d-46ce-a62a-78a5af739808 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:50 devstack sudo[87548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c486af87-be5d-46ce-a62a-78a5af739808
Feb 27 01:25:50 devstack sudo[87548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:50 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-aa93152d-4bb2-4df1-b4e8-98cdf9f44b0e tempest-VolumeQuotasNegativeTestJSON-1665835495 None] Acquiring lock "cinder-38832f51-01e1-4f3b-b858-68a4f8cd95f0-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:50 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-aa93152d-4bb2-4df1-b4e8-98cdf9f44b0e tempest-VolumeQuotasNegativeTestJSON-1665835495 None] Lock "cinder-38832f51-01e1-4f3b-b858-68a4f8cd95f0-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:50 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-aa93152d-4bb2-4df1-b4e8-98cdf9f44b0e tempest-VolumeQuotasNegativeTestJSON-1665835495 None] Acquiring lock "cinder-quobyte-38832f51-01e1-4f3b-b858-68a4f8cd95f0" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:50 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-aa93152d-4bb2-4df1-b4e8-98cdf9f44b0e tempest-VolumeQuotasNegativeTestJSON-1665835495 None] Lock "cinder-quobyte-38832f51-01e1-4f3b-b858-68a4f8cd95f0" acquired by "delete_volume" :: waited 0.010s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:50 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0bd907c-7763-481f-b346-2fd7ccd654a8]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:50 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-aa93152d-4bb2-4df1-b4e8-98cdf9f44b0e tempest-VolumeQuotasNegativeTestJSON-1665835495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-38832f51-01e1-4f3b-b858-68a4f8cd95f0 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:50 devstack sudo[87546]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:50 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-11c7c1e4-828f-40a1-be68-df7927786bb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8f3950da-f996-4947-95f2-22376678d243" returned: 0 in 0.640s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:50 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-11c7c1e4-828f-40a1-be68-df7927786bb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8f3950da-f996-4947-95f2-22376678d243.12ae42f9-9964-4b97-98cb-7457101b5743 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:50 devstack sudo[87554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8f3950da-f996-4947-95f2-22376678d243.12ae42f9-9964-4b97-98cb-7457101b5743
Feb 27 01:25:50 devstack sudo[87554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:50 devstack sudo[87553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-38832f51-01e1-4f3b-b858-68a4f8cd95f0
Feb 27 01:25:50 devstack sudo[87553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:50 devstack sudo[87548]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:50 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-05c1918b-c57f-4eb8-83b2-70316b95bd38 tempest-VolumesDeleteCascade-678564053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c486af87-be5d-46ce-a62a-78a5af739808" returned: 0 in 0.710s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:50 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-05c1918b-c57f-4eb8-83b2-70316b95bd38 tempest-VolumesDeleteCascade-678564053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c486af87-be5d-46ce-a62a-78a5af739808 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:50 devstack sudo[87560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c486af87-be5d-46ce-a62a-78a5af739808
Feb 27 01:25:50 devstack sudo[87560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:51 devstack sudo[87553]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:51 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-aa93152d-4bb2-4df1-b4e8-98cdf9f44b0e tempest-VolumeQuotasNegativeTestJSON-1665835495 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-38832f51-01e1-4f3b-b858-68a4f8cd95f0" returned: 0 in 0.651s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:51 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-aa93152d-4bb2-4df1-b4e8-98cdf9f44b0e tempest-VolumeQuotasNegativeTestJSON-1665835495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-38832f51-01e1-4f3b-b858-68a4f8cd95f0 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:51 devstack sudo[87568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-38832f51-01e1-4f3b-b858-68a4f8cd95f0
Feb 27 01:25:51 devstack sudo[87568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:51 devstack sudo[87554]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:51 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-11c7c1e4-828f-40a1-be68-df7927786bb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8f3950da-f996-4947-95f2-22376678d243.12ae42f9-9964-4b97-98cb-7457101b5743" returned: 0 in 0.613s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:51 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-11c7c1e4-828f-40a1-be68-df7927786bb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8f3950da-f996-4947-95f2-22376678d243.12ae42f9-9964-4b97-98cb-7457101b5743 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:51 devstack sudo[87571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8f3950da-f996-4947-95f2-22376678d243.12ae42f9-9964-4b97-98cb-7457101b5743
Feb 27 01:25:51 devstack sudo[87571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:51 devstack sudo[87560]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:51 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-05c1918b-c57f-4eb8-83b2-70316b95bd38 tempest-VolumesDeleteCascade-678564053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c486af87-be5d-46ce-a62a-78a5af739808" returned: 0 in 0.523s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:51 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-05c1918b-c57f-4eb8-83b2-70316b95bd38 tempest-VolumesDeleteCascade-678564053 None] Lock "cinder-quobyte-c486af87-be5d-46ce-a62a-78a5af739808" released by "delete_volume" :: held 1.257s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:51 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-05c1918b-c57f-4eb8-83b2-70316b95bd38 tempest-VolumesDeleteCascade-678564053 None] Created reservations ['4e788cc8-ebc3-4f56-8bf3-b5e6a0b298ce', 'ce099c57-9683-4eee-93a1-f280db44f0ef', 'c5d09b40-3de3-4e9b-bbbe-3b938a0cd245', '43f191ed-5c33-41d6-ae7f-152c4e61deee'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:25:51 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-05c1918b-c57f-4eb8-83b2-70316b95bd38 tempest-VolumesDeleteCascade-678564053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:51 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-05c1918b-c57f-4eb8-83b2-70316b95bd38 tempest-VolumesDeleteCascade-678564053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:51 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-05c1918b-c57f-4eb8-83b2-70316b95bd38 tempest-VolumesDeleteCascade-678564053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:25:51 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-05c1918b-c57f-4eb8-83b2-70316b95bd38 tempest-VolumesDeleteCascade-678564053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:25:51 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-05c1918b-c57f-4eb8-83b2-70316b95bd38 tempest-VolumesDeleteCascade-678564053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:51 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-05c1918b-c57f-4eb8-83b2-70316b95bd38 tempest-VolumesDeleteCascade-678564053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:51 devstack sudo[87573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:25:51 devstack sudo[87573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:51 devstack sudo[87568]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:51 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-aa93152d-4bb2-4df1-b4e8-98cdf9f44b0e tempest-VolumeQuotasNegativeTestJSON-1665835495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-38832f51-01e1-4f3b-b858-68a4f8cd95f0" returned: 0 in 0.495s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:51 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-aa93152d-4bb2-4df1-b4e8-98cdf9f44b0e tempest-VolumeQuotasNegativeTestJSON-1665835495 None] Lock "cinder-quobyte-38832f51-01e1-4f3b-b858-68a4f8cd95f0" released by "delete_volume" :: held 1.178s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:51 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-aa93152d-4bb2-4df1-b4e8-98cdf9f44b0e tempest-VolumeQuotasNegativeTestJSON-1665835495 None] Created reservations ['b9bd87a3-aecb-4a4d-81a0-5bbad9f852e8', '8cdedebc-0946-40e1-b8fa-97a8969f1030', 'c31d52bb-a568-4849-8cb1-78cc9c34bc23', '45debdb2-8b13-4170-bfa9-e1c07247b5f4'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:25:51 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-aa93152d-4bb2-4df1-b4e8-98cdf9f44b0e tempest-VolumeQuotasNegativeTestJSON-1665835495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:51 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-aa93152d-4bb2-4df1-b4e8-98cdf9f44b0e tempest-VolumeQuotasNegativeTestJSON-1665835495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:51 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-aa93152d-4bb2-4df1-b4e8-98cdf9f44b0e tempest-VolumeQuotasNegativeTestJSON-1665835495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:25:51 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-aa93152d-4bb2-4df1-b4e8-98cdf9f44b0e tempest-VolumeQuotasNegativeTestJSON-1665835495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:25:51 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-aa93152d-4bb2-4df1-b4e8-98cdf9f44b0e tempest-VolumeQuotasNegativeTestJSON-1665835495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:51 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-aa93152d-4bb2-4df1-b4e8-98cdf9f44b0e tempest-VolumeQuotasNegativeTestJSON-1665835495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:51 devstack sudo[87571]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:51 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-11c7c1e4-828f-40a1-be68-df7927786bb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8f3950da-f996-4947-95f2-22376678d243.12ae42f9-9964-4b97-98cb-7457101b5743" returned: 0 in 0.584s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:51 devstack sudo[87577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:25:51 devstack sudo[87577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:51 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-11c7c1e4-828f-40a1-be68-df7927786bb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Lock "cinder-quobyte-12ae42f9-9964-4b97-98cb-7457101b5743" released by "_delete_snapshot" :: held 2.586s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:51 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-11c7c1e4-828f-40a1-be68-df7927786bb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Lock "cinder-quobyte-8f3950da-f996-4947-95f2-22376678d243" released by "delete_snapshot" :: held 2.601s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:51 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-11c7c1e4-828f-40a1-be68-df7927786bb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Created reservations ['14047a9d-1825-4747-afbe-d6a6bc23cf38', '0133fc44-27b7-4518-a797-ef6b932a95eb', '3a862462-be88-4598-bc23-afbfe654af07', 'dec62c83-6d54-4227-87fb-bc1c3dc923f1'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:25:51 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-11c7c1e4-828f-40a1-be68-df7927786bb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Delete snapshot completed successfully.
Feb 27 01:25:51 devstack sudo[87573]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:51 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-11c7c1e4-828f-40a1-be68-df7927786bb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Lock "cinder-12ae42f9-9964-4b97-98cb-7457101b5743-delete_snapshot" released by "delete_snapshot" :: held 2.734s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:51 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-05c1918b-c57f-4eb8-83b2-70316b95bd38 tempest-VolumesDeleteCascade-678564053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.528s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:51 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-05c1918b-c57f-4eb8-83b2-70316b95bd38 tempest-VolumesDeleteCascade-678564053 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:25:51 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-05c1918b-c57f-4eb8-83b2-70316b95bd38 tempest-VolumesDeleteCascade-678564053 None] Deleted volume successfully.
Feb 27 01:25:52 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-05c1918b-c57f-4eb8-83b2-70316b95bd38 tempest-VolumesDeleteCascade-678564053 None] Lock "cinder-c486af87-be5d-46ce-a62a-78a5af739808-delete_volume" released by "delete_volume" :: held 1.948s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:52 devstack sudo[87577]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:52 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-aa93152d-4bb2-4df1-b4e8-98cdf9f44b0e tempest-VolumeQuotasNegativeTestJSON-1665835495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.505s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:52 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-aa93152d-4bb2-4df1-b4e8-98cdf9f44b0e tempest-VolumeQuotasNegativeTestJSON-1665835495 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:25:52 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-aa93152d-4bb2-4df1-b4e8-98cdf9f44b0e tempest-VolumeQuotasNegativeTestJSON-1665835495 None] Deleted volume successfully.
Feb 27 01:25:52 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-aa93152d-4bb2-4df1-b4e8-98cdf9f44b0e tempest-VolumeQuotasNegativeTestJSON-1665835495 None] Lock "cinder-38832f51-01e1-4f3b-b858-68a4f8cd95f0-delete_volume" released by "delete_volume" :: held 1.868s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:52 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5247bbc5-8c96-4136-b6d9-24d637ba6fe0 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Acquiring lock "cinder-8f3950da-f996-4947-95f2-22376678d243-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:52 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5247bbc5-8c96-4136-b6d9-24d637ba6fe0 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Lock "cinder-8f3950da-f996-4947-95f2-22376678d243-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:52 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5247bbc5-8c96-4136-b6d9-24d637ba6fe0 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Acquiring lock "cinder-quobyte-8f3950da-f996-4947-95f2-22376678d243" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:25:52 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5247bbc5-8c96-4136-b6d9-24d637ba6fe0 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Lock "cinder-quobyte-8f3950da-f996-4947-95f2-22376678d243" acquired by "delete_volume" :: waited 0.009s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:25:52 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2eaf74e-6a7a-41de-8ef7-27809db3a9f5]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:52 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5247bbc5-8c96-4136-b6d9-24d637ba6fe0 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8f3950da-f996-4947-95f2-22376678d243 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:52 devstack sudo[87581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8f3950da-f996-4947-95f2-22376678d243
Feb 27 01:25:52 devstack sudo[87581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:53 devstack sudo[87581]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:53 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5247bbc5-8c96-4136-b6d9-24d637ba6fe0 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8f3950da-f996-4947-95f2-22376678d243" returned: 0 in 0.707s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:53 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5247bbc5-8c96-4136-b6d9-24d637ba6fe0 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8f3950da-f996-4947-95f2-22376678d243 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:53 devstack sudo[87589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8f3950da-f996-4947-95f2-22376678d243
Feb 27 01:25:53 devstack sudo[87589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:53 devstack sudo[87589]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:53 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5247bbc5-8c96-4136-b6d9-24d637ba6fe0 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8f3950da-f996-4947-95f2-22376678d243" returned: 0 in 0.635s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:53 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5247bbc5-8c96-4136-b6d9-24d637ba6fe0 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Lock "cinder-quobyte-8f3950da-f996-4947-95f2-22376678d243" released by "delete_volume" :: held 1.386s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:53 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-5247bbc5-8c96-4136-b6d9-24d637ba6fe0 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Created reservations ['d1495889-d700-49d0-a5e9-2db131796cbc', '151a0c14-ae7b-4748-83eb-f13837fc2094', '5cc61e14-ffca-4168-9b43-058de2c1b46a', 'a2c27950-a8dc-486d-87a2-b1fc232f4fbe'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:25:53 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-5247bbc5-8c96-4136-b6d9-24d637ba6fe0 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:53 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-5247bbc5-8c96-4136-b6d9-24d637ba6fe0 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:53 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-5247bbc5-8c96-4136-b6d9-24d637ba6fe0 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:25:53 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-5247bbc5-8c96-4136-b6d9-24d637ba6fe0 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:25:53 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-5247bbc5-8c96-4136-b6d9-24d637ba6fe0 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:53 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5247bbc5-8c96-4136-b6d9-24d637ba6fe0 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:54 devstack sudo[87592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:25:54 devstack sudo[87592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:54 devstack sudo[87592]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:54 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5247bbc5-8c96-4136-b6d9-24d637ba6fe0 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.782s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:54 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-5247bbc5-8c96-4136-b6d9-24d637ba6fe0 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:25:54 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-5247bbc5-8c96-4136-b6d9-24d637ba6fe0 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Deleted volume successfully.
Feb 27 01:25:54 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5247bbc5-8c96-4136-b6d9-24d637ba6fe0 tempest-VolumeSnapshotQuotasNegativeTestJSON-898129715 None] Lock "cinder-8f3950da-f996-4947-95f2-22376678d243-delete_volume" released by "delete_volume" :: held 2.360s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:25:55 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-a708228b-2e93-4101-b81b-373cf7e9fea4 tempest-VolumesCloneTest-1984154689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:25:55 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a708228b-2e93-4101-b81b-373cf7e9fea4 tempest-VolumesCloneTest-1984154689 None] Flow 'volume_create_manager' (3e214dcb-7efa-4bd1-a481-20849b4636fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:25:55 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a708228b-2e93-4101-b81b-373cf7e9fea4 tempest-VolumesCloneTest-1984154689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da3b3376-c7f9-430f-ab8d-2c65531b63cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:55 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a708228b-2e93-4101-b81b-373cf7e9fea4 tempest-VolumesCloneTest-1984154689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da3b3376-c7f9-430f-ab8d-2c65531b63cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:25:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1367978899',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ca4bd5a-fe88-44ef-a294-0327935327c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='099a92715b7c47f38b7f424123a52051',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:25:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:25:55Z,use_quota=True,user_id='69e66537561a4b74a77897244fa1251e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:55 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a708228b-2e93-4101-b81b-373cf7e9fea4 tempest-VolumesCloneTest-1984154689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fd810c8-f78e-4c11-8e59-78589502ed46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:55 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a708228b-2e93-4101-b81b-373cf7e9fea4 tempest-VolumesCloneTest-1984154689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fd810c8-f78e-4c11-8e59-78589502ed46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:55 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a708228b-2e93-4101-b81b-373cf7e9fea4 tempest-VolumesCloneTest-1984154689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15ff6370-f0d3-4896-b05f-75df49e2fd6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:55 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a708228b-2e93-4101-b81b-373cf7e9fea4 tempest-VolumesCloneTest-1984154689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15ff6370-f0d3-4896-b05f-75df49e2fd6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ca4bd5a-fe88-44ef-a294-0327935327c5', 'volume_name': 'volume-9ca4bd5a-fe88-44ef-a294-0327935327c5', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:55 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a708228b-2e93-4101-b81b-373cf7e9fea4 tempest-VolumesCloneTest-1984154689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90de7bf9-ca99-4390-a4d9-1bc61b22c3a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:55 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a708228b-2e93-4101-b81b-373cf7e9fea4 tempest-VolumesCloneTest-1984154689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90de7bf9-ca99-4390-a4d9-1bc61b22c3a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:55 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a708228b-2e93-4101-b81b-373cf7e9fea4 tempest-VolumesCloneTest-1984154689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1e3e12a-a1f0-4d4a-a648-57897eef2a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:55 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-a708228b-2e93-4101-b81b-373cf7e9fea4 tempest-VolumesCloneTest-1984154689 None] Volume 9ca4bd5a-fe88-44ef-a294-0327935327c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ca4bd5a-fe88-44ef-a294-0327935327c5', 'volume_size': 1}
Feb 27 01:25:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-a708228b-2e93-4101-b81b-373cf7e9fea4 tempest-VolumesCloneTest-1984154689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-a708228b-2e93-4101-b81b-373cf7e9fea4 tempest-VolumesCloneTest-1984154689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:55 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-a708228b-2e93-4101-b81b-373cf7e9fea4 tempest-VolumesCloneTest-1984154689 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:25:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1367978899',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ca4bd5a-fe88-44ef-a294-0327935327c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='099a92715b7c47f38b7f424123a52051',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:25:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:25:55Z,use_quota=True,user_id='69e66537561a4b74a77897244fa1251e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:25:55 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-a708228b-2e93-4101-b81b-373cf7e9fea4 tempest-VolumesCloneTest-1984154689 None] Creating volume 9ca4bd5a-fe88-44ef-a294-0327935327c5 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:25:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-a708228b-2e93-4101-b81b-373cf7e9fea4 tempest-VolumesCloneTest-1984154689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-a708228b-2e93-4101-b81b-373cf7e9fea4 tempest-VolumesCloneTest-1984154689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:55 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-a708228b-2e93-4101-b81b-373cf7e9fea4 tempest-VolumesCloneTest-1984154689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:25:55 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-a708228b-2e93-4101-b81b-373cf7e9fea4 tempest-VolumesCloneTest-1984154689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:25:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-a708228b-2e93-4101-b81b-373cf7e9fea4 tempest-VolumesCloneTest-1984154689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:55 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-a708228b-2e93-4101-b81b-373cf7e9fea4 tempest-VolumesCloneTest-1984154689 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:25:55 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-a708228b-2e93-4101-b81b-373cf7e9fea4 tempest-VolumesCloneTest-1984154689 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:25:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a708228b-2e93-4101-b81b-373cf7e9fea4 tempest-VolumesCloneTest-1984154689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9ca4bd5a-fe88-44ef-a294-0327935327c5 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:55 devstack sudo[87595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9ca4bd5a-fe88-44ef-a294-0327935327c5 1073741824
Feb 27 01:25:55 devstack sudo[87595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:55 devstack sudo[87595]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a708228b-2e93-4101-b81b-373cf7e9fea4 tempest-VolumesCloneTest-1984154689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9ca4bd5a-fe88-44ef-a294-0327935327c5 1073741824" returned: 0 in 0.619s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a708228b-2e93-4101-b81b-373cf7e9fea4 tempest-VolumesCloneTest-1984154689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9ca4bd5a-fe88-44ef-a294-0327935327c5 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:55 devstack sudo[87600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9ca4bd5a-fe88-44ef-a294-0327935327c5
Feb 27 01:25:55 devstack sudo[87600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:56 devstack sudo[87600]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a708228b-2e93-4101-b81b-373cf7e9fea4 tempest-VolumesCloneTest-1984154689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9ca4bd5a-fe88-44ef-a294-0327935327c5" returned: 0 in 0.592s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:56 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-a708228b-2e93-4101-b81b-373cf7e9fea4 tempest-VolumesCloneTest-1984154689 None] <== create_volume: return (1255ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:25:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-a708228b-2e93-4101-b81b-373cf7e9fea4 tempest-VolumesCloneTest-1984154689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.258s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:56 devstack cinder-volume[83106]: DEBUG dbcounter [-] [83106] Writing DB stats cinder:SELECT=207,cinder:INSERT=55,cinder:UPDATE=225,cinder:DELETE=15 {{(pid=83106) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 01:25:56 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a708228b-2e93-4101-b81b-373cf7e9fea4 tempest-VolumesCloneTest-1984154689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1e3e12a-a1f0-4d4a-a648-57897eef2a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ca4bd5a-fe88-44ef-a294-0327935327c5', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:56 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a708228b-2e93-4101-b81b-373cf7e9fea4 tempest-VolumesCloneTest-1984154689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52e2e07e-6225-4ae1-9d5a-f1bd8d8eb999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:56 devstack cinder-volume[83106]: DEBUG dbcounter [-] [83106] Writing DB stats cinder:SELECT=205,cinder:UPDATE=233,cinder:INSERT=61,cinder:DELETE=14 {{(pid=83106) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 01:25:56 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-a708228b-2e93-4101-b81b-373cf7e9fea4 tempest-VolumesCloneTest-1984154689 None] Volume volume-9ca4bd5a-fe88-44ef-a294-0327935327c5 (9ca4bd5a-fe88-44ef-a294-0327935327c5): created successfully
Feb 27 01:25:56 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a708228b-2e93-4101-b81b-373cf7e9fea4 tempest-VolumesCloneTest-1984154689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52e2e07e-6225-4ae1-9d5a-f1bd8d8eb999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:56 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a708228b-2e93-4101-b81b-373cf7e9fea4 tempest-VolumesCloneTest-1984154689 None] Flow 'volume_create_manager' (3e214dcb-7efa-4bd1-a481-20849b4636fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:25:56 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-a708228b-2e93-4101-b81b-373cf7e9fea4 tempest-VolumesCloneTest-1984154689 None] Created volume successfully.
Feb 27 01:25:56 devstack cinder-volume[83106]: DEBUG oslo_service.periodic_task [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83106) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Feb 27 01:25:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:56 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:25:56 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:25:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:56 devstack sudo[87603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:25:56 devstack sudo[87603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:57 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c5f154a-7a6b-476a-940b-9d2c57d49354 tempest-VolumeRetypeWithoutMigrationTest-1473672064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:25:57 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-3c5f154a-7a6b-476a-940b-9d2c57d49354 tempest-VolumeRetypeWithoutMigrationTest-1473672064 None] Flow 'volume_create_manager' (de753ccc-26d1-44df-a501-9cf15e583795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:25:57 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-3c5f154a-7a6b-476a-940b-9d2c57d49354 tempest-VolumeRetypeWithoutMigrationTest-1473672064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5d311be-f890-4e64-8f5a-61a54bb4c2ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:57 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-3c5f154a-7a6b-476a-940b-9d2c57d49354 tempest-VolumeRetypeWithoutMigrationTest-1473672064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5d311be-f890-4e64-8f5a-61a54bb4c2ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:25:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-622505827',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5cb805b-443a-4f47-bf6c-4ff12fe77af9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7a39ba0d7df40059cfaf3d313ed6fcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:25:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:25:57Z,use_quota=True,user_id='5675ce49b0db47bd901fb05b4f36df34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(389a4151-f7b4-4ac6-a199-639f9e325279),volume_type_id=389a4151-f7b4-4ac6-a199-639f9e325279)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:57 devstack sudo[87603]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:57 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-3c5f154a-7a6b-476a-940b-9d2c57d49354 tempest-VolumeRetypeWithoutMigrationTest-1473672064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (352eddcb-4fdb-46f6-be67-a415e052108b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:57 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-3c5f154a-7a6b-476a-940b-9d2c57d49354 tempest-VolumeRetypeWithoutMigrationTest-1473672064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (352eddcb-4fdb-46f6-be67-a415e052108b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:57 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-3c5f154a-7a6b-476a-940b-9d2c57d49354 tempest-VolumeRetypeWithoutMigrationTest-1473672064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3b8b5f3-8fb1-4650-829c-9d80357c16cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:57 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-3c5f154a-7a6b-476a-940b-9d2c57d49354 tempest-VolumeRetypeWithoutMigrationTest-1473672064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3b8b5f3-8fb1-4650-829c-9d80357c16cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5cb805b-443a-4f47-bf6c-4ff12fe77af9', 'volume_name': 'volume-b5cb805b-443a-4f47-bf6c-4ff12fe77af9', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:57 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-3c5f154a-7a6b-476a-940b-9d2c57d49354 tempest-VolumeRetypeWithoutMigrationTest-1473672064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33c69024-4184-4ecc-b9ab-7c22e1a35aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:57 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-3c5f154a-7a6b-476a-940b-9d2c57d49354 tempest-VolumeRetypeWithoutMigrationTest-1473672064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33c69024-4184-4ecc-b9ab-7c22e1a35aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:57 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-3c5f154a-7a6b-476a-940b-9d2c57d49354 tempest-VolumeRetypeWithoutMigrationTest-1473672064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16f9653d-3221-4b85-80d7-f57b9dc6d04e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:57 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-3c5f154a-7a6b-476a-940b-9d2c57d49354 tempest-VolumeRetypeWithoutMigrationTest-1473672064 None] Volume b5cb805b-443a-4f47-bf6c-4ff12fe77af9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5cb805b-443a-4f47-bf6c-4ff12fe77af9', 'volume_size': 1}
Feb 27 01:25:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-3c5f154a-7a6b-476a-940b-9d2c57d49354 tempest-VolumeRetypeWithoutMigrationTest-1473672064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-3c5f154a-7a6b-476a-940b-9d2c57d49354 tempest-VolumeRetypeWithoutMigrationTest-1473672064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:57 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-3c5f154a-7a6b-476a-940b-9d2c57d49354 tempest-VolumeRetypeWithoutMigrationTest-1473672064 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:25:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-622505827',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5cb805b-443a-4f47-bf6c-4ff12fe77af9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7a39ba0d7df40059cfaf3d313ed6fcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:25:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:25:57Z,use_quota=True,user_id='5675ce49b0db47bd901fb05b4f36df34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(389a4151-f7b4-4ac6-a199-639f9e325279),volume_type_id=389a4151-f7b4-4ac6-a199-639f9e325279)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:25:57 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-3c5f154a-7a6b-476a-940b-9d2c57d49354 tempest-VolumeRetypeWithoutMigrationTest-1473672064 None] Creating volume b5cb805b-443a-4f47-bf6c-4ff12fe77af9 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:25:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-3c5f154a-7a6b-476a-940b-9d2c57d49354 tempest-VolumeRetypeWithoutMigrationTest-1473672064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-3c5f154a-7a6b-476a-940b-9d2c57d49354 tempest-VolumeRetypeWithoutMigrationTest-1473672064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:57 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-3c5f154a-7a6b-476a-940b-9d2c57d49354 tempest-VolumeRetypeWithoutMigrationTest-1473672064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:25:57 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-3c5f154a-7a6b-476a-940b-9d2c57d49354 tempest-VolumeRetypeWithoutMigrationTest-1473672064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:25:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-3c5f154a-7a6b-476a-940b-9d2c57d49354 tempest-VolumeRetypeWithoutMigrationTest-1473672064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:57 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-3c5f154a-7a6b-476a-940b-9d2c57d49354 tempest-VolumeRetypeWithoutMigrationTest-1473672064 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:25:57 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-3c5f154a-7a6b-476a-940b-9d2c57d49354 tempest-VolumeRetypeWithoutMigrationTest-1473672064 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:25:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-3c5f154a-7a6b-476a-940b-9d2c57d49354 tempest-VolumeRetypeWithoutMigrationTest-1473672064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b5cb805b-443a-4f47-bf6c-4ff12fe77af9 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.723s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:57 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:25:57 devstack sudo[87606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b5cb805b-443a-4f47-bf6c-4ff12fe77af9 1073741824
Feb 27 01:25:57 devstack sudo[87606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:57 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:25:57 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] Flow 'volume_create_manager' (fe708bdb-217f-4451-aa0d-afe03fd27781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:25:57 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b137de4-46b4-4a3e-a0a5-2d33ca54a02d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:57 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b137de4-46b4-4a3e-a0a5-2d33ca54a02d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:25:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-13478597',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9afdf490-833c-456d-a56f-a700fedf396a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='099a92715b7c47f38b7f424123a52051',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:25:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=9ca4bd5a-fe88-44ef-a294-0327935327c5,status='creating',terminated_at=None,updated_at=2026-02-27T00:25:58Z,use_quota=True,user_id='69e66537561a4b74a77897244fa1251e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:57 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26a2efe0-b688-460f-9680-9b1e26143a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:57 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26a2efe0-b688-460f-9680-9b1e26143a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:57 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f10417e-63e2-4b20-9481-ec8aa8a265f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:57 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f10417e-63e2-4b20-9481-ec8aa8a265f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '9afdf490-833c-456d-a56f-a700fedf396a', 'volume_name': 'volume-9afdf490-833c-456d-a56f-a700fedf396a', 'volume_size': 2, 'source_volid': '9ca4bd5a-fe88-44ef-a294-0327935327c5', 'source_volstatus': 'available'}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:57 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dc9709a-7684-40ac-850a-eda5ed41b6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:57 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dc9709a-7684-40ac-850a-eda5ed41b6b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:57 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18f75d46-7e2f-4522-b666-3a6590619f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:57 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] Volume 9afdf490-833c-456d-a56f-a700fedf396a: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-9afdf490-833c-456d-a56f-a700fedf396a', 'volume_size': 2, 'source_volid': '9ca4bd5a-fe88-44ef-a294-0327935327c5', 'source_volstatus': 'available'}
Feb 27 01:25:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:58 devstack sudo[87606]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:58 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-3c5f154a-7a6b-476a-940b-9d2c57d49354 tempest-VolumeRetypeWithoutMigrationTest-1473672064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b5cb805b-443a-4f47-bf6c-4ff12fe77af9 1073741824" returned: 0 in 0.655s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:58 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-3c5f154a-7a6b-476a-940b-9d2c57d49354 tempest-VolumeRetypeWithoutMigrationTest-1473672064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b5cb805b-443a-4f47-bf6c-4ff12fe77af9 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:58 devstack sudo[87611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b5cb805b-443a-4f47-bf6c-4ff12fe77af9
Feb 27 01:25:58 devstack sudo[87611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:58 devstack sudo[87611]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:58 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-3c5f154a-7a6b-476a-940b-9d2c57d49354 tempest-VolumeRetypeWithoutMigrationTest-1473672064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b5cb805b-443a-4f47-bf6c-4ff12fe77af9" returned: 0 in 0.507s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:58 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-3c5f154a-7a6b-476a-940b-9d2c57d49354 tempest-VolumeRetypeWithoutMigrationTest-1473672064 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:25:58 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-3c5f154a-7a6b-476a-940b-9d2c57d49354 tempest-VolumeRetypeWithoutMigrationTest-1473672064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.206s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:58 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.879s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:58 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] Cloning volume 9ca4bd5a-fe88-44ef-a294-0327935327c5 to volume 9afdf490-833c-456d-a56f-a700fedf396a
Feb 27 01:25:58 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-3c5f154a-7a6b-476a-940b-9d2c57d49354 tempest-VolumeRetypeWithoutMigrationTest-1473672064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16f9653d-3221-4b85-80d7-f57b9dc6d04e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5cb805b-443a-4f47-bf6c-4ff12fe77af9', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:58 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-3c5f154a-7a6b-476a-940b-9d2c57d49354 tempest-VolumeRetypeWithoutMigrationTest-1473672064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c094824-7e09-427c-a5e5-f9d09902dda3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:25:58 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-3c5f154a-7a6b-476a-940b-9d2c57d49354 tempest-VolumeRetypeWithoutMigrationTest-1473672064 None] Volume volume-b5cb805b-443a-4f47-bf6c-4ff12fe77af9 (b5cb805b-443a-4f47-bf6c-4ff12fe77af9): created successfully
Feb 27 01:25:58 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-3c5f154a-7a6b-476a-940b-9d2c57d49354 tempest-VolumeRetypeWithoutMigrationTest-1473672064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c094824-7e09-427c-a5e5-f9d09902dda3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:25:58 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-3c5f154a-7a6b-476a-940b-9d2c57d49354 tempest-VolumeRetypeWithoutMigrationTest-1473672064 None] Flow 'volume_create_manager' (de753ccc-26d1-44df-a501-9cf15e583795) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:25:58 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-3c5f154a-7a6b-476a-940b-9d2c57d49354 tempest-VolumeRetypeWithoutMigrationTest-1473672064 None] Created volume successfully.
Feb 27 01:25:58 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] Creating offline snapshot 0f77da66-8792-45d3-aff5-aa2169f84564 of volume 9ca4bd5a-fe88-44ef-a294-0327935327c5 {{(pid=83106) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:25:58 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[54bd3ef0-3ffc-4dbf-a198-7ffdc91accc0]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:25:58 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9ca4bd5a-fe88-44ef-a294-0327935327c5 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:58 devstack sudo[87614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9ca4bd5a-fe88-44ef-a294-0327935327c5
Feb 27 01:25:58 devstack sudo[87614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:59 devstack sudo[87614]: pam_unix(sudo:session): session closed for user root
Feb 27 01:25:59 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9ca4bd5a-fe88-44ef-a294-0327935327c5" returned: 0 in 0.667s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:25:59 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9ca4bd5a-fe88-44ef-a294-0327935327c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9ca4bd5a-fe88-44ef-a294-0327935327c5.0f77da66-8792-45d3-aff5-aa2169f84564 1G {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:25:59 devstack sudo[87619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9ca4bd5a-fe88-44ef-a294-0327935327c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9ca4bd5a-fe88-44ef-a294-0327935327c5.0f77da66-8792-45d3-aff5-aa2169f84564 1G
Feb 27 01:25:59 devstack sudo[87619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:25:59 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-94f3f2c2-3fc3-412e-bd3e-e1907824d61f tempest-VolumeRetypeWithoutMigrationTest-1473672064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:25:59 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-94f3f2c2-3fc3-412e-bd3e-e1907824d61f tempest-VolumeRetypeWithoutMigrationTest-1473672064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:25:59 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-94f3f2c2-3fc3-412e-bd3e-e1907824d61f tempest-VolumeRetypeWithoutMigrationTest-1473672064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:25:59 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-94f3f2c2-3fc3-412e-bd3e-e1907824d61f tempest-VolumeRetypeWithoutMigrationTest-1473672064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:25:59 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-94f3f2c2-3fc3-412e-bd3e-e1907824d61f tempest-VolumeRetypeWithoutMigrationTest-1473672064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:25:59 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-94f3f2c2-3fc3-412e-bd3e-e1907824d61f tempest-VolumeRetypeWithoutMigrationTest-1473672064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:00 devstack sudo[87654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:26:00 devstack sudo[87654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:00 devstack sudo[87619]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:00 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9ca4bd5a-fe88-44ef-a294-0327935327c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9ca4bd5a-fe88-44ef-a294-0327935327c5.0f77da66-8792-45d3-aff5-aa2169f84564 1G" returned: 0 in 0.851s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:00 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ca4bd5a-fe88-44ef-a294-0327935327c5 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9ca4bd5a-fe88-44ef-a294-0327935327c5.0f77da66-8792-45d3-aff5-aa2169f84564 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:00 devstack sudo[87666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ca4bd5a-fe88-44ef-a294-0327935327c5 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9ca4bd5a-fe88-44ef-a294-0327935327c5.0f77da66-8792-45d3-aff5-aa2169f84564
Feb 27 01:26:00 devstack sudo[87666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:00 devstack sudo[87654]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:00 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-94f3f2c2-3fc3-412e-bd3e-e1907824d61f tempest-VolumeRetypeWithoutMigrationTest-1473672064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.588s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:00 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-94f3f2c2-3fc3-412e-bd3e-e1907824d61f tempest-VolumeRetypeWithoutMigrationTest-1473672064 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:26:00 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-94f3f2c2-3fc3-412e-bd3e-e1907824d61f tempest-VolumeRetypeWithoutMigrationTest-1473672064 None] Retype volume completed successfully.
Feb 27 01:26:00 devstack sudo[87666]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:00 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ca4bd5a-fe88-44ef-a294-0327935327c5 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9ca4bd5a-fe88-44ef-a294-0327935327c5.0f77da66-8792-45d3-aff5-aa2169f84564" returned: 0 in 0.581s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:00 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9ca4bd5a-fe88-44ef-a294-0327935327c5.0f77da66-8792-45d3-aff5-aa2169f84564 is being set with open permissions: ugo+rw
Feb 27 01:26:00 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9ca4bd5a-fe88-44ef-a294-0327935327c5.0f77da66-8792-45d3-aff5-aa2169f84564 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:00 devstack sudo[87673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9ca4bd5a-fe88-44ef-a294-0327935327c5.0f77da66-8792-45d3-aff5-aa2169f84564
Feb 27 01:26:00 devstack sudo[87673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:01 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-a8fc1b93-3429-42c7-b850-a2a5660bde4a tempest-VolumeRetypeWithoutMigrationTest-1473672064 None] Acquiring lock "cinder-b5cb805b-443a-4f47-bf6c-4ff12fe77af9-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:01 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-a8fc1b93-3429-42c7-b850-a2a5660bde4a tempest-VolumeRetypeWithoutMigrationTest-1473672064 None] Lock "cinder-b5cb805b-443a-4f47-bf6c-4ff12fe77af9-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:01 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-a8fc1b93-3429-42c7-b850-a2a5660bde4a tempest-VolumeRetypeWithoutMigrationTest-1473672064 None] Acquiring lock "cinder-quobyte-b5cb805b-443a-4f47-bf6c-4ff12fe77af9" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:01 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-a8fc1b93-3429-42c7-b850-a2a5660bde4a tempest-VolumeRetypeWithoutMigrationTest-1473672064 None] Lock "cinder-quobyte-b5cb805b-443a-4f47-bf6c-4ff12fe77af9" acquired by "delete_volume" :: waited 0.009s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:01 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[914ab8af-3a39-4dff-b6a5-086e75d8e3d7]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:26:01 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a8fc1b93-3429-42c7-b850-a2a5660bde4a tempest-VolumeRetypeWithoutMigrationTest-1473672064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b5cb805b-443a-4f47-bf6c-4ff12fe77af9 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:01 devstack sudo[87675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b5cb805b-443a-4f47-bf6c-4ff12fe77af9
Feb 27 01:26:01 devstack sudo[87675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:01 devstack sudo[87673]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:01 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9ca4bd5a-fe88-44ef-a294-0327935327c5.0f77da66-8792-45d3-aff5-aa2169f84564" returned: 0 in 0.690s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:01 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9ca4bd5a-fe88-44ef-a294-0327935327c5.info {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:01 devstack sudo[87678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9ca4bd5a-fe88-44ef-a294-0327935327c5.info
Feb 27 01:26:01 devstack sudo[87678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:02 devstack sudo[87675]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:02 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a8fc1b93-3429-42c7-b850-a2a5660bde4a tempest-VolumeRetypeWithoutMigrationTest-1473672064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b5cb805b-443a-4f47-bf6c-4ff12fe77af9" returned: 0 in 0.683s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:02 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a8fc1b93-3429-42c7-b850-a2a5660bde4a tempest-VolumeRetypeWithoutMigrationTest-1473672064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b5cb805b-443a-4f47-bf6c-4ff12fe77af9 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:02 devstack sudo[87683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b5cb805b-443a-4f47-bf6c-4ff12fe77af9
Feb 27 01:26:02 devstack sudo[87683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:02 devstack sudo[87678]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:02 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9ca4bd5a-fe88-44ef-a294-0327935327c5.info" returned: 0 in 0.649s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:02 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9ca4bd5a-fe88-44ef-a294-0327935327c5.info is being set with open permissions: ugo+rw
Feb 27 01:26:02 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9ca4bd5a-fe88-44ef-a294-0327935327c5.info {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:02 devstack sudo[87686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9ca4bd5a-fe88-44ef-a294-0327935327c5.info
Feb 27 01:26:02 devstack sudo[87686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:02 devstack sudo[87683]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:02 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a8fc1b93-3429-42c7-b850-a2a5660bde4a tempest-VolumeRetypeWithoutMigrationTest-1473672064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b5cb805b-443a-4f47-bf6c-4ff12fe77af9" returned: 0 in 0.686s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:02 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-a8fc1b93-3429-42c7-b850-a2a5660bde4a tempest-VolumeRetypeWithoutMigrationTest-1473672064 None] Lock "cinder-quobyte-b5cb805b-443a-4f47-bf6c-4ff12fe77af9" released by "delete_volume" :: held 1.404s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:02 devstack cinder-volume[83106]: WARNING cinder.quota [None req-a8fc1b93-3429-42c7-b850-a2a5660bde4a tempest-VolumeRetypeWithoutMigrationTest-1473672064 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Feb 27 01:26:02 devstack cinder-volume[83106]: WARNING cinder.quota [None req-a8fc1b93-3429-42c7-b850-a2a5660bde4a tempest-VolumeRetypeWithoutMigrationTest-1473672064 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Feb 27 01:26:02 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-a8fc1b93-3429-42c7-b850-a2a5660bde4a tempest-VolumeRetypeWithoutMigrationTest-1473672064 None] Created reservations ['6bbd9f01-e5a3-4ee9-93c6-e7bcbbc32f19', '7376cdff-df8d-491a-bf9f-b0a3f4f6959c', 'eb9aeee4-f5c6-41ec-938b-0da67ec4b1ba', '426d0647-e8a3-41e6-91e6-f75f23eda09b'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:26:02 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-a8fc1b93-3429-42c7-b850-a2a5660bde4a tempest-VolumeRetypeWithoutMigrationTest-1473672064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:02 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-a8fc1b93-3429-42c7-b850-a2a5660bde4a tempest-VolumeRetypeWithoutMigrationTest-1473672064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:02 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-a8fc1b93-3429-42c7-b850-a2a5660bde4a tempest-VolumeRetypeWithoutMigrationTest-1473672064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:26:02 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-a8fc1b93-3429-42c7-b850-a2a5660bde4a tempest-VolumeRetypeWithoutMigrationTest-1473672064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:26:02 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-a8fc1b93-3429-42c7-b850-a2a5660bde4a tempest-VolumeRetypeWithoutMigrationTest-1473672064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:02 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a8fc1b93-3429-42c7-b850-a2a5660bde4a tempest-VolumeRetypeWithoutMigrationTest-1473672064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:02 devstack sudo[87691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:26:02 devstack sudo[87691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:02 devstack sudo[87686]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:02 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9ca4bd5a-fe88-44ef-a294-0327935327c5.info" returned: 0 in 0.585s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:02 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] Acquiring lock "cinder-quobyte-9afdf490-833c-456d-a56f-a700fedf396a" by "_copy_volume_from_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:02 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] Lock "cinder-quobyte-9afdf490-833c-456d-a56f-a700fedf396a" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:02 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] snapshot: 0f77da66-8792-45d3-aff5-aa2169f84564, volume: 9afdf490-833c-456d-a56f-a700fedf396a,  {{(pid=83106) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Feb 27 01:26:02 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:02 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:02 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:26:02 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:26:02 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:02 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f7f5b2b-2fa9-4e27-a8c5-8591fb406d03]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:26:02 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9ca4bd5a-fe88-44ef-a294-0327935327c5.0f77da66-8792-45d3-aff5-aa2169f84564 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:03 devstack sudo[87693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9ca4bd5a-fe88-44ef-a294-0327935327c5.0f77da66-8792-45d3-aff5-aa2169f84564
Feb 27 01:26:03 devstack sudo[87693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:03 devstack sudo[87691]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:03 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a8fc1b93-3429-42c7-b850-a2a5660bde4a tempest-VolumeRetypeWithoutMigrationTest-1473672064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.683s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:03 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-a8fc1b93-3429-42c7-b850-a2a5660bde4a tempest-VolumeRetypeWithoutMigrationTest-1473672064 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:26:03 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-a8fc1b93-3429-42c7-b850-a2a5660bde4a tempest-VolumeRetypeWithoutMigrationTest-1473672064 None] Deleted volume successfully.
Feb 27 01:26:03 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-a8fc1b93-3429-42c7-b850-a2a5660bde4a tempest-VolumeRetypeWithoutMigrationTest-1473672064 None] Lock "cinder-b5cb805b-443a-4f47-bf6c-4ff12fe77af9-delete_volume" released by "delete_volume" :: held 2.318s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:03 devstack sudo[87693]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:03 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9ca4bd5a-fe88-44ef-a294-0327935327c5.0f77da66-8792-45d3-aff5-aa2169f84564" returned: 0 in 0.735s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:03 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ca4bd5a-fe88-44ef-a294-0327935327c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83106) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:26:03 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9ca4bd5a-fe88-44ef-a294-0327935327c5 {{(pid=83106) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Feb 27 01:26:03 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] Creating direct copy from snapshot {{(pid=83106) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Feb 27 01:26:03 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[761863f4-f52f-479a-b024-bc90235eeb25]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:26:03 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9ca4bd5a-fe88-44ef-a294-0327935327c5 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:03 devstack sudo[87699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9ca4bd5a-fe88-44ef-a294-0327935327c5
Feb 27 01:26:03 devstack sudo[87699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:04 devstack sudo[87699]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:04 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9ca4bd5a-fe88-44ef-a294-0327935327c5" returned: 0 in 0.680s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:04 devstack cinder-volume[83106]: DEBUG cinder.utils [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] Path /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9afdf490-833c-456d-a56f-a700fedf396a not found in is_blk_device check {{(pid=83106) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Feb 27 01:26:04 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9ca4bd5a-fe88-44ef-a294-0327935327c5 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9afdf490-833c-456d-a56f-a700fedf396a {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:04 devstack sudo[87704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9ca4bd5a-fe88-44ef-a294-0327935327c5 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9afdf490-833c-456d-a56f-a700fedf396a
Feb 27 01:26:04 devstack sudo[87704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:07 devstack sudo[87704]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:07 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9ca4bd5a-fe88-44ef-a294-0327935327c5 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9afdf490-833c-456d-a56f-a700fedf396a" returned: 0 in 3.342s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:07 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5572bed-48b4-45e4-941d-f51190e50a3a]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:26:07 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9ca4bd5a-fe88-44ef-a294-0327935327c5 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:07 devstack sudo[87717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9ca4bd5a-fe88-44ef-a294-0327935327c5
Feb 27 01:26:07 devstack sudo[87717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:08 devstack sudo[87717]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:08 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9ca4bd5a-fe88-44ef-a294-0327935327c5" returned: 0 in 0.995s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:08 devstack cinder-volume[83106]: DEBUG cinder.image.image_utils [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] Image conversion details: src /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9ca4bd5a-fe88-44ef-a294-0327935327c5, size 1024.00 MB, duration 3.34 sec, destination /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9afdf490-833c-456d-a56f-a700fedf396a {{(pid=83106) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 27 01:26:08 devstack cinder-volume[83106]: INFO cinder.image.image_utils [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] Converted 1024.00 MB image at 306.26 MB/s
Feb 27 01:26:08 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9afdf490-833c-456d-a56f-a700fedf396a is being set with open permissions: ugo+rw
Feb 27 01:26:08 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9afdf490-833c-456d-a56f-a700fedf396a {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:08 devstack sudo[87722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9afdf490-833c-456d-a56f-a700fedf396a
Feb 27 01:26:08 devstack sudo[87722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:09 devstack sudo[87722]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:09 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9afdf490-833c-456d-a56f-a700fedf396a" returned: 0 in 0.682s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:09 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] Lock "cinder-quobyte-9afdf490-833c-456d-a56f-a700fedf396a" released by "_copy_volume_from_snapshot" :: held 6.520s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:09 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] Acquiring lock "cinder-quobyte-0f77da66-8792-45d3-aff5-aa2169f84564" by "_delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:09 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] Lock "cinder-quobyte-0f77da66-8792-45d3-aff5-aa2169f84564" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:09 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] Deleting offline snapshot 0f77da66-8792-45d3-aff5-aa2169f84564 of volume 9ca4bd5a-fe88-44ef-a294-0327935327c5 {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:26:09 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] snapshot_file for this snap is: volume-9ca4bd5a-fe88-44ef-a294-0327935327c5.0f77da66-8792-45d3-aff5-aa2169f84564 {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:26:09 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[aefd4840-c9d6-4d02-b03d-d96644438757]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:26:09 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9ca4bd5a-fe88-44ef-a294-0327935327c5.0f77da66-8792-45d3-aff5-aa2169f84564 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:09 devstack sudo[87725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9ca4bd5a-fe88-44ef-a294-0327935327c5.0f77da66-8792-45d3-aff5-aa2169f84564
Feb 27 01:26:09 devstack sudo[87725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:10 devstack sudo[87725]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:10 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9ca4bd5a-fe88-44ef-a294-0327935327c5.0f77da66-8792-45d3-aff5-aa2169f84564" returned: 0 in 0.728s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:10 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ca4bd5a-fe88-44ef-a294-0327935327c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83106) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:26:10 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b32b3da-fed0-4e59-9fbc-49997c920a95]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:26:10 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9ca4bd5a-fe88-44ef-a294-0327935327c5 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:10 devstack sudo[87730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9ca4bd5a-fe88-44ef-a294-0327935327c5
Feb 27 01:26:10 devstack sudo[87730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:10 devstack sudo[87730]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:10 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9ca4bd5a-fe88-44ef-a294-0327935327c5" returned: 0 in 0.704s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:10 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9ca4bd5a-fe88-44ef-a294-0327935327c5.0f77da66-8792-45d3-aff5-aa2169f84564 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:11 devstack sudo[87735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9ca4bd5a-fe88-44ef-a294-0327935327c5.0f77da66-8792-45d3-aff5-aa2169f84564
Feb 27 01:26:11 devstack sudo[87735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:11 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-c13a57e6-4203-45eb-b338-6df7d8b00839 tempest-VolumesImageMetadata-1564607973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:26:11 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c13a57e6-4203-45eb-b338-6df7d8b00839 tempest-VolumesImageMetadata-1564607973 None] Flow 'volume_create_manager' (bc156ded-5b3c-4030-a1f3-b5072b2fd8f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:26:11 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c13a57e6-4203-45eb-b338-6df7d8b00839 tempest-VolumesImageMetadata-1564607973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00afae84-6083-4176-a3b9-ef14b7f48c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:11 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c13a57e6-4203-45eb-b338-6df7d8b00839 tempest-VolumesImageMetadata-1564607973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00afae84-6083-4176-a3b9-ef14b7f48c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:26:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-293241114',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57441403-ffb7-48f6-b0b7-a1d0b5179872,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='692f550580684f7e99a02aeafbe18a01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:26:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:26:11Z,use_quota=True,user_id='32e8ab3fe7b7473992c4a61c245657c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:11 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c13a57e6-4203-45eb-b338-6df7d8b00839 tempest-VolumesImageMetadata-1564607973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da3ab185-239d-41ef-969d-d0c3a9caae1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:11 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c13a57e6-4203-45eb-b338-6df7d8b00839 tempest-VolumesImageMetadata-1564607973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da3ab185-239d-41ef-969d-d0c3a9caae1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:11 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c13a57e6-4203-45eb-b338-6df7d8b00839 tempest-VolumesImageMetadata-1564607973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f2daedc-f10a-464d-8206-40b651cd481c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:11 devstack cinder-volume[83106]: DEBUG cinder.image.glance [None req-c13a57e6-4203-45eb-b338-6df7d8b00839 tempest-VolumesImageMetadata-1564607973 None] Creating Keystone auth plugin from conf {{(pid=83106) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Feb 27 01:26:11 devstack sudo[87735]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:11 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9ca4bd5a-fe88-44ef-a294-0327935327c5.0f77da66-8792-45d3-aff5-aa2169f84564" returned: 0 in 0.743s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:11 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9ca4bd5a-fe88-44ef-a294-0327935327c5.0f77da66-8792-45d3-aff5-aa2169f84564 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:11 devstack sudo[87740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9ca4bd5a-fe88-44ef-a294-0327935327c5.0f77da66-8792-45d3-aff5-aa2169f84564
Feb 27 01:26:11 devstack sudo[87740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:11 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c13a57e6-4203-45eb-b338-6df7d8b00839 tempest-VolumesImageMetadata-1564607973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f2daedc-f10a-464d-8206-40b651cd481c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '57441403-ffb7-48f6-b0b7-a1d0b5179872', 'volume_name': 'volume-57441403-ffb7-48f6-b0b7-a1d0b5179872', 'volume_size': 1, 'image_id': '4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd105600f18404a29b5061e7b75a5bfe1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca', 'created_at': datetime.datetime(2026, 2, 27, 0, 17, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 17, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f07e8b3ef20>}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:11 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c13a57e6-4203-45eb-b338-6df7d8b00839 tempest-VolumesImageMetadata-1564607973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9c3b739-2a56-4b3d-920c-f626b47690f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:11 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c13a57e6-4203-45eb-b338-6df7d8b00839 tempest-VolumesImageMetadata-1564607973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9c3b739-2a56-4b3d-920c-f626b47690f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:11 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c13a57e6-4203-45eb-b338-6df7d8b00839 tempest-VolumesImageMetadata-1564607973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09a67b91-174d-4695-b765-fb2314ee7a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:11 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-c13a57e6-4203-45eb-b338-6df7d8b00839 tempest-VolumesImageMetadata-1564607973 None] Volume 57441403-ffb7-48f6-b0b7-a1d0b5179872: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-57441403-ffb7-48f6-b0b7-a1d0b5179872', 'volume_size': 1, 'image_id': '4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd105600f18404a29b5061e7b75a5bfe1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca', 'created_at': datetime.datetime(2026, 2, 27, 0, 17, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 17, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f07e8b3ef20>}
Feb 27 01:26:11 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-c13a57e6-4203-45eb-b338-6df7d8b00839 tempest-VolumesImageMetadata-1564607973 None] Trying to clone 57441403-ffb7-48f6-b0b7-a1d0b5179872 from image 4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca at location (None, [{'url': 'file:///opt/stack/data/glance/images/4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca', 'metadata': {}}]). {{(pid=83106) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Feb 27 01:26:12 devstack cinder-volume[83106]: DEBUG cinder.image.image_utils [None req-c13a57e6-4203-45eb-b338-6df7d8b00839 tempest-VolumesImageMetadata-1564607973 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_e_g8lcuddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83106) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Feb 27 01:26:12 devstack cinder-volume[83106]: INFO cinder.image.image_utils [None req-c13a57e6-4203-45eb-b338-6df7d8b00839 tempest-VolumesImageMetadata-1564607973 None] Image download 20.69 MB at 20.69 MB/s
Feb 27 01:26:12 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd9be9c-c962-453d-9a04-d49c5742d5bf]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:26:12 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c13a57e6-4203-45eb-b338-6df7d8b00839 tempest-VolumesImageMetadata-1564607973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_e_g8lcuddevstack@QuobyteHD {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:12 devstack sudo[87743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_e_g8lcuddevstack@QuobyteHD
Feb 27 01:26:12 devstack sudo[87743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:12 devstack sudo[87740]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:12 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9ca4bd5a-fe88-44ef-a294-0327935327c5.0f77da66-8792-45d3-aff5-aa2169f84564" returned: 0 in 0.640s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:12 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] Lock "cinder-quobyte-0f77da66-8792-45d3-aff5-aa2169f84564" released by "_delete_snapshot" :: held 2.902s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:12 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.678s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:12 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18f75d46-7e2f-4522-b666-3a6590619f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9afdf490-833c-456d-a56f-a700fedf396a', 'volume_size': 2, 'source_volid': '9ca4bd5a-fe88-44ef-a294-0327935327c5', 'source_volstatus': 'available'}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:12 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94a92e4c-3af4-4c30-adb8-6e67cb88154e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:12 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] Volume volume-9afdf490-833c-456d-a56f-a700fedf396a (9afdf490-833c-456d-a56f-a700fedf396a): created successfully
Feb 27 01:26:12 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94a92e4c-3af4-4c30-adb8-6e67cb88154e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:12 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] Flow 'volume_create_manager' (fe708bdb-217f-4451-aa0d-afe03fd27781) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:26:12 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-57ad635d-0742-426e-bef2-e73bd0eb5911 tempest-VolumesCloneTest-1984154689 None] Created volume successfully.
Feb 27 01:26:12 devstack sudo[87743]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:12 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c13a57e6-4203-45eb-b338-6df7d8b00839 tempest-VolumesImageMetadata-1564607973 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_e_g8lcuddevstack@QuobyteHD" returned: 0 in 0.815s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:12 devstack cinder-volume[83106]: DEBUG cinder.image.image_utils [None req-c13a57e6-4203-45eb-b338-6df7d8b00839 tempest-VolumesImageMetadata-1564607973 None] Temporary image 4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca is fetched for user 32e8ab3fe7b7473992c4a61c245657c3. {{(pid=83106) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Feb 27 01:26:12 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeaad849-9d6a-46cf-b446-fb94b1d258bb]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:26:12 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c13a57e6-4203-45eb-b338-6df7d8b00839 tempest-VolumesImageMetadata-1564607973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_e_g8lcuddevstack@QuobyteHD {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:13 devstack sudo[87750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_e_g8lcuddevstack@QuobyteHD
Feb 27 01:26:13 devstack sudo[87750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:13 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-2abeb87e-075f-488d-9624-11e9d2ad77e1 tempest-VolumesCloneTest-1984154689 None] Acquiring lock "cinder-9afdf490-833c-456d-a56f-a700fedf396a-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:13 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-2abeb87e-075f-488d-9624-11e9d2ad77e1 tempest-VolumesCloneTest-1984154689 None] Lock "cinder-9afdf490-833c-456d-a56f-a700fedf396a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:13 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-2abeb87e-075f-488d-9624-11e9d2ad77e1 tempest-VolumesCloneTest-1984154689 None] Acquiring lock "cinder-quobyte-9afdf490-833c-456d-a56f-a700fedf396a" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:13 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-2abeb87e-075f-488d-9624-11e9d2ad77e1 tempest-VolumesCloneTest-1984154689 None] Lock "cinder-quobyte-9afdf490-833c-456d-a56f-a700fedf396a" acquired by "delete_volume" :: waited 0.014s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:13 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[31980edb-7d35-48a8-8f86-4a28cda7178a]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:26:13 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-2abeb87e-075f-488d-9624-11e9d2ad77e1 tempest-VolumesCloneTest-1984154689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9afdf490-833c-456d-a56f-a700fedf396a {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:13 devstack sudo[87755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9afdf490-833c-456d-a56f-a700fedf396a
Feb 27 01:26:13 devstack sudo[87755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:13 devstack sudo[87750]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:13 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c13a57e6-4203-45eb-b338-6df7d8b00839 tempest-VolumesImageMetadata-1564607973 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_e_g8lcuddevstack@QuobyteHD" returned: 0 in 0.894s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:13 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-c13a57e6-4203-45eb-b338-6df7d8b00839 tempest-VolumesImageMetadata-1564607973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:13 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-c13a57e6-4203-45eb-b338-6df7d8b00839 tempest-VolumesImageMetadata-1564607973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:13 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-c13a57e6-4203-45eb-b338-6df7d8b00839 tempest-VolumesImageMetadata-1564607973 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:26:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-293241114',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57441403-ffb7-48f6-b0b7-a1d0b5179872,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='692f550580684f7e99a02aeafbe18a01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:26:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:26:11Z,use_quota=True,user_id='32e8ab3fe7b7473992c4a61c245657c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:26:13 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-c13a57e6-4203-45eb-b338-6df7d8b00839 tempest-VolumesImageMetadata-1564607973 None] Creating volume 57441403-ffb7-48f6-b0b7-a1d0b5179872 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:26:13 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-c13a57e6-4203-45eb-b338-6df7d8b00839 tempest-VolumesImageMetadata-1564607973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:13 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-c13a57e6-4203-45eb-b338-6df7d8b00839 tempest-VolumesImageMetadata-1564607973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:13 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-c13a57e6-4203-45eb-b338-6df7d8b00839 tempest-VolumesImageMetadata-1564607973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:26:13 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-c13a57e6-4203-45eb-b338-6df7d8b00839 tempest-VolumesImageMetadata-1564607973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:26:13 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-c13a57e6-4203-45eb-b338-6df7d8b00839 tempest-VolumesImageMetadata-1564607973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:13 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-c13a57e6-4203-45eb-b338-6df7d8b00839 tempest-VolumesImageMetadata-1564607973 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:26:13 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-c13a57e6-4203-45eb-b338-6df7d8b00839 tempest-VolumesImageMetadata-1564607973 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:26:13 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c13a57e6-4203-45eb-b338-6df7d8b00839 tempest-VolumesImageMetadata-1564607973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-57441403-ffb7-48f6-b0b7-a1d0b5179872 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:13 devstack sudo[87757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-57441403-ffb7-48f6-b0b7-a1d0b5179872 1073741824
Feb 27 01:26:13 devstack sudo[87757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:14 devstack sudo[87755]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:14 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-2abeb87e-075f-488d-9624-11e9d2ad77e1 tempest-VolumesCloneTest-1984154689 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9afdf490-833c-456d-a56f-a700fedf396a" returned: 0 in 0.874s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:14 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-2abeb87e-075f-488d-9624-11e9d2ad77e1 tempest-VolumesCloneTest-1984154689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9afdf490-833c-456d-a56f-a700fedf396a {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:14 devstack sudo[87765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9afdf490-833c-456d-a56f-a700fedf396a
Feb 27 01:26:14 devstack sudo[87765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:14 devstack sudo[87757]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:14 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c13a57e6-4203-45eb-b338-6df7d8b00839 tempest-VolumesImageMetadata-1564607973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-57441403-ffb7-48f6-b0b7-a1d0b5179872 1073741824" returned: 0 in 0.761s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:14 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c13a57e6-4203-45eb-b338-6df7d8b00839 tempest-VolumesImageMetadata-1564607973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-57441403-ffb7-48f6-b0b7-a1d0b5179872 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:14 devstack sudo[87767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-57441403-ffb7-48f6-b0b7-a1d0b5179872
Feb 27 01:26:14 devstack sudo[87767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:15 devstack sudo[87767]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:15 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c13a57e6-4203-45eb-b338-6df7d8b00839 tempest-VolumesImageMetadata-1564607973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-57441403-ffb7-48f6-b0b7-a1d0b5179872" returned: 0 in 0.600s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:15 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-c13a57e6-4203-45eb-b338-6df7d8b00839 tempest-VolumesImageMetadata-1564607973 None] <== create_volume: return (1399ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:26:15 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-c13a57e6-4203-45eb-b338-6df7d8b00839 tempest-VolumesImageMetadata-1564607973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.403s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:15 devstack cinder-volume[83106]: DEBUG cinder.volume.volume_utils [None req-c13a57e6-4203-45eb-b338-6df7d8b00839 tempest-VolumesImageMetadata-1564607973 None] Attempting download of 4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca ((None, [{'url': 'file:///opt/stack/data/glance/images/4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca', 'metadata': {}}])) to volume 57441403-ffb7-48f6-b0b7-a1d0b5179872. {{(pid=83106) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Feb 27 01:26:15 devstack sudo[87765]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:15 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-2abeb87e-075f-488d-9624-11e9d2ad77e1 tempest-VolumesCloneTest-1984154689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9afdf490-833c-456d-a56f-a700fedf396a" returned: 0 in 0.743s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:15 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-2abeb87e-075f-488d-9624-11e9d2ad77e1 tempest-VolumesCloneTest-1984154689 None] Lock "cinder-quobyte-9afdf490-833c-456d-a56f-a700fedf396a" released by "delete_volume" :: held 1.658s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:15 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[844cf1f6-5cdb-4e8f-8ec8-258314077b5a]: (4, 'raw') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:26:15 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c13a57e6-4203-45eb-b338-6df7d8b00839 tempest-VolumesImageMetadata-1564607973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_89ohwocd {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:15 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-2abeb87e-075f-488d-9624-11e9d2ad77e1 tempest-VolumesCloneTest-1984154689 None] Created reservations ['02482e9d-ba1c-4ad5-b386-c224bdf0ef51', '62dfb5ee-b00d-4341-9e6b-705ac86dafa0', 'da0033b9-d77c-4a0e-8ca0-3b716e458193', '851b261b-302a-44e4-9d83-94acd871a57a'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:26:15 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-2abeb87e-075f-488d-9624-11e9d2ad77e1 tempest-VolumesCloneTest-1984154689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:15 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-2abeb87e-075f-488d-9624-11e9d2ad77e1 tempest-VolumesCloneTest-1984154689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:15 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-2abeb87e-075f-488d-9624-11e9d2ad77e1 tempest-VolumesCloneTest-1984154689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:26:15 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-2abeb87e-075f-488d-9624-11e9d2ad77e1 tempest-VolumesCloneTest-1984154689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:26:15 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-2abeb87e-075f-488d-9624-11e9d2ad77e1 tempest-VolumesCloneTest-1984154689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:15 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-2abeb87e-075f-488d-9624-11e9d2ad77e1 tempest-VolumesCloneTest-1984154689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:15 devstack sudo[87772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:26:15 devstack sudo[87772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:15 devstack sudo[87771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_89ohwocd
Feb 27 01:26:15 devstack sudo[87771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:15 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-16c3c8ff-a171-4c63-ba56-0340f02d4e09 tempest-VolumesCloneTest-1984154689 None] Acquiring lock "cinder-9ca4bd5a-fe88-44ef-a294-0327935327c5-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:15 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-16c3c8ff-a171-4c63-ba56-0340f02d4e09 tempest-VolumesCloneTest-1984154689 None] Lock "cinder-9ca4bd5a-fe88-44ef-a294-0327935327c5-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:16 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-16c3c8ff-a171-4c63-ba56-0340f02d4e09 tempest-VolumesCloneTest-1984154689 None] Acquiring lock "cinder-quobyte-9ca4bd5a-fe88-44ef-a294-0327935327c5" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:16 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-16c3c8ff-a171-4c63-ba56-0340f02d4e09 tempest-VolumesCloneTest-1984154689 None] Lock "cinder-quobyte-9ca4bd5a-fe88-44ef-a294-0327935327c5" acquired by "delete_volume" :: waited 0.019s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:16 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[da40aa5e-6335-4085-a6bf-477970c70818]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:26:16 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-16c3c8ff-a171-4c63-ba56-0340f02d4e09 tempest-VolumesCloneTest-1984154689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9ca4bd5a-fe88-44ef-a294-0327935327c5 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:16 devstack sudo[87771]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:16 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c13a57e6-4203-45eb-b338-6df7d8b00839 tempest-VolumesImageMetadata-1564607973 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_89ohwocd" returned: 0 in 0.776s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:16 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c13a57e6-4203-45eb-b338-6df7d8b00839 tempest-VolumesImageMetadata-1564607973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_89ohwocd {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:16 devstack sudo[87778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9ca4bd5a-fe88-44ef-a294-0327935327c5
Feb 27 01:26:16 devstack sudo[87778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:16 devstack sudo[87772]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:16 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-2abeb87e-075f-488d-9624-11e9d2ad77e1 tempest-VolumesCloneTest-1984154689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.766s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:16 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-2abeb87e-075f-488d-9624-11e9d2ad77e1 tempest-VolumesCloneTest-1984154689 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:26:16 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-2abeb87e-075f-488d-9624-11e9d2ad77e1 tempest-VolumesCloneTest-1984154689 None] Deleted volume successfully.
Feb 27 01:26:16 devstack sudo[87779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_89ohwocd
Feb 27 01:26:16 devstack sudo[87779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:16 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-2abeb87e-075f-488d-9624-11e9d2ad77e1 tempest-VolumesCloneTest-1984154689 None] Lock "cinder-9afdf490-833c-456d-a56f-a700fedf396a-delete_volume" released by "delete_volume" :: held 2.685s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:16 devstack sudo[87779]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:16 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c13a57e6-4203-45eb-b338-6df7d8b00839 tempest-VolumesImageMetadata-1564607973 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_89ohwocd" returned: 1 in 0.785s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:16 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c13a57e6-4203-45eb-b338-6df7d8b00839 tempest-VolumesImageMetadata-1564607973 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_89ohwocd' failed. Not Retrying. {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 27 01:26:16 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a34637-f61a-45ab-9e0b-599fb37f2862]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:26:16 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c13a57e6-4203-45eb-b338-6df7d8b00839 tempest-VolumesImageMetadata-1564607973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_e_g8lcuddevstack@QuobyteHD {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:16 devstack sudo[87778]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:16 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-16c3c8ff-a171-4c63-ba56-0340f02d4e09 tempest-VolumesCloneTest-1984154689 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9ca4bd5a-fe88-44ef-a294-0327935327c5" returned: 0 in 0.909s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:16 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-16c3c8ff-a171-4c63-ba56-0340f02d4e09 tempest-VolumesCloneTest-1984154689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9ca4bd5a-fe88-44ef-a294-0327935327c5 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:17 devstack sudo[87789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9ca4bd5a-fe88-44ef-a294-0327935327c5
Feb 27 01:26:17 devstack sudo[87789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:17 devstack sudo[87788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_e_g8lcuddevstack@QuobyteHD
Feb 27 01:26:17 devstack sudo[87788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:17 devstack sudo[87789]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:17 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-16c3c8ff-a171-4c63-ba56-0340f02d4e09 tempest-VolumesCloneTest-1984154689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9ca4bd5a-fe88-44ef-a294-0327935327c5" returned: 0 in 0.662s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:17 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-16c3c8ff-a171-4c63-ba56-0340f02d4e09 tempest-VolumesCloneTest-1984154689 None] Lock "cinder-quobyte-9ca4bd5a-fe88-44ef-a294-0327935327c5" released by "delete_volume" :: held 1.640s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:17 devstack sudo[87788]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:17 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c13a57e6-4203-45eb-b338-6df7d8b00839 tempest-VolumesImageMetadata-1564607973 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_e_g8lcuddevstack@QuobyteHD" returned: 0 in 0.784s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:17 devstack cinder-volume[83106]: DEBUG cinder.image.image_utils [None req-c13a57e6-4203-45eb-b338-6df7d8b00839 tempest-VolumesImageMetadata-1564607973 None] 4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca was qcow2, converting to raw {{(pid=83106) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Feb 27 01:26:17 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c13a57e6-4203-45eb-b338-6df7d8b00839 tempest-VolumesImageMetadata-1564607973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_e_g8lcuddevstack@QuobyteHD /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-57441403-ffb7-48f6-b0b7-a1d0b5179872 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:17 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-16c3c8ff-a171-4c63-ba56-0340f02d4e09 tempest-VolumesCloneTest-1984154689 None] Created reservations ['bae0e07a-bbc6-4d32-b8cc-17431f34d0d9', 'cd903a4d-f87b-4c6e-b1ed-67c84ba17b50', '5507298a-3abb-413d-81c5-df65f324261d', 'e6b9b97a-0015-4214-99d0-9ff11d4e1b86'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:26:17 devstack sudo[87796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_e_g8lcuddevstack@QuobyteHD /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-57441403-ffb7-48f6-b0b7-a1d0b5179872
Feb 27 01:26:17 devstack sudo[87796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:17 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-16c3c8ff-a171-4c63-ba56-0340f02d4e09 tempest-VolumesCloneTest-1984154689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:17 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-16c3c8ff-a171-4c63-ba56-0340f02d4e09 tempest-VolumesCloneTest-1984154689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:17 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-16c3c8ff-a171-4c63-ba56-0340f02d4e09 tempest-VolumesCloneTest-1984154689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:26:17 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-16c3c8ff-a171-4c63-ba56-0340f02d4e09 tempest-VolumesCloneTest-1984154689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:26:17 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-16c3c8ff-a171-4c63-ba56-0340f02d4e09 tempest-VolumesCloneTest-1984154689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:17 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-16c3c8ff-a171-4c63-ba56-0340f02d4e09 tempest-VolumesCloneTest-1984154689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:17 devstack sudo[87798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:26:17 devstack sudo[87798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:18 devstack sudo[87798]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:18 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-16c3c8ff-a171-4c63-ba56-0340f02d4e09 tempest-VolumesCloneTest-1984154689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.843s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:18 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-16c3c8ff-a171-4c63-ba56-0340f02d4e09 tempest-VolumesCloneTest-1984154689 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:26:18 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-16c3c8ff-a171-4c63-ba56-0340f02d4e09 tempest-VolumesCloneTest-1984154689 None] Deleted volume successfully.
Feb 27 01:26:18 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-16c3c8ff-a171-4c63-ba56-0340f02d4e09 tempest-VolumesCloneTest-1984154689 None] Lock "cinder-9ca4bd5a-fe88-44ef-a294-0327935327c5-delete_volume" released by "delete_volume" :: held 2.759s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:19 devstack sudo[87796]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:19 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c13a57e6-4203-45eb-b338-6df7d8b00839 tempest-VolumesImageMetadata-1564607973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_e_g8lcuddevstack@QuobyteHD /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-57441403-ffb7-48f6-b0b7-a1d0b5179872" returned: 0 in 1.544s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:19 devstack cinder-volume[83106]: DEBUG cinder.image.image_utils [None req-c13a57e6-4203-45eb-b338-6df7d8b00839 tempest-VolumesImageMetadata-1564607973 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_e_g8lcuddevstack@QuobyteHD, size 112.00 MB, duration 1.54 sec, destination /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-57441403-ffb7-48f6-b0b7-a1d0b5179872 {{(pid=83106) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 27 01:26:19 devstack cinder-volume[83106]: INFO cinder.image.image_utils [None req-c13a57e6-4203-45eb-b338-6df7d8b00839 tempest-VolumesImageMetadata-1564607973 None] Converted 112.00 MB image at 72.50 MB/s
Feb 27 01:26:19 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c13a57e6-4203-45eb-b338-6df7d8b00839 tempest-VolumesImageMetadata-1564607973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-57441403-ffb7-48f6-b0b7-a1d0b5179872 1G {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:19 devstack sudo[87809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-57441403-ffb7-48f6-b0b7-a1d0b5179872 1G
Feb 27 01:26:19 devstack sudo[87809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:19 devstack sudo[87809]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:19 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c13a57e6-4203-45eb-b338-6df7d8b00839 tempest-VolumesImageMetadata-1564607973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-57441403-ffb7-48f6-b0b7-a1d0b5179872 1G" returned: 0 in 0.734s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:20 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[f921ee13-ea1a-4fbc-8413-dc1b19c0ba49]: (4, 'raw') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:26:20 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c13a57e6-4203-45eb-b338-6df7d8b00839 tempest-VolumesImageMetadata-1564607973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-57441403-ffb7-48f6-b0b7-a1d0b5179872 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:20 devstack sudo[87814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-57441403-ffb7-48f6-b0b7-a1d0b5179872
Feb 27 01:26:20 devstack sudo[87814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:20 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa617f1b-e312-4773-aceb-eaf6d0293b76 tempest-VolumesTransfersV355Test-1733276514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:26:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-fa617f1b-e312-4773-aceb-eaf6d0293b76 tempest-VolumesTransfersV355Test-1733276514 None] Flow 'volume_create_manager' (483123ef-0d7d-4dae-8397-c7233a47d229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:26:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-fa617f1b-e312-4773-aceb-eaf6d0293b76 tempest-VolumesTransfersV355Test-1733276514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67d64764-0e49-4be3-aec3-bb1acf65b6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-fa617f1b-e312-4773-aceb-eaf6d0293b76 tempest-VolumesTransfersV355Test-1733276514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67d64764-0e49-4be3-aec3-bb1acf65b6fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:26:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-824965010',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efd3cc16-659a-4c89-860b-cf733e8377c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85fc33ccd5514491a57a3e7a2edc3693',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:26:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:26:21Z,use_quota=True,user_id='ff61e8386dc84828a2a1f55ed2b50367',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-fa617f1b-e312-4773-aceb-eaf6d0293b76 tempest-VolumesTransfersV355Test-1733276514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3f1bd21-4653-4603-98ef-f486cc3dac16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-fa617f1b-e312-4773-aceb-eaf6d0293b76 tempest-VolumesTransfersV355Test-1733276514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3f1bd21-4653-4603-98ef-f486cc3dac16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-fa617f1b-e312-4773-aceb-eaf6d0293b76 tempest-VolumesTransfersV355Test-1733276514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8161d76-f7e1-4898-a95a-7e60494cb511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-fa617f1b-e312-4773-aceb-eaf6d0293b76 tempest-VolumesTransfersV355Test-1733276514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8161d76-f7e1-4898-a95a-7e60494cb511) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efd3cc16-659a-4c89-860b-cf733e8377c9', 'volume_name': 'volume-efd3cc16-659a-4c89-860b-cf733e8377c9', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-fa617f1b-e312-4773-aceb-eaf6d0293b76 tempest-VolumesTransfersV355Test-1733276514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79fb3fc8-6b97-4d69-82cd-61d64d40dbb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-fa617f1b-e312-4773-aceb-eaf6d0293b76 tempest-VolumesTransfersV355Test-1733276514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79fb3fc8-6b97-4d69-82cd-61d64d40dbb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-fa617f1b-e312-4773-aceb-eaf6d0293b76 tempest-VolumesTransfersV355Test-1733276514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36a4d1ce-004f-4e31-8320-b38e51a3645a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:20 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-fa617f1b-e312-4773-aceb-eaf6d0293b76 tempest-VolumesTransfersV355Test-1733276514 None] Volume efd3cc16-659a-4c89-860b-cf733e8377c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efd3cc16-659a-4c89-860b-cf733e8377c9', 'volume_size': 1}
Feb 27 01:26:20 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-fa617f1b-e312-4773-aceb-eaf6d0293b76 tempest-VolumesTransfersV355Test-1733276514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:20 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-fa617f1b-e312-4773-aceb-eaf6d0293b76 tempest-VolumesTransfersV355Test-1733276514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:20 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-fa617f1b-e312-4773-aceb-eaf6d0293b76 tempest-VolumesTransfersV355Test-1733276514 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:26:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-824965010',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efd3cc16-659a-4c89-860b-cf733e8377c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85fc33ccd5514491a57a3e7a2edc3693',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:26:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:26:21Z,use_quota=True,user_id='ff61e8386dc84828a2a1f55ed2b50367',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:26:20 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-fa617f1b-e312-4773-aceb-eaf6d0293b76 tempest-VolumesTransfersV355Test-1733276514 None] Creating volume efd3cc16-659a-4c89-860b-cf733e8377c9 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:26:20 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-fa617f1b-e312-4773-aceb-eaf6d0293b76 tempest-VolumesTransfersV355Test-1733276514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:20 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-fa617f1b-e312-4773-aceb-eaf6d0293b76 tempest-VolumesTransfersV355Test-1733276514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:20 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-fa617f1b-e312-4773-aceb-eaf6d0293b76 tempest-VolumesTransfersV355Test-1733276514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:26:20 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-fa617f1b-e312-4773-aceb-eaf6d0293b76 tempest-VolumesTransfersV355Test-1733276514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:26:20 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-fa617f1b-e312-4773-aceb-eaf6d0293b76 tempest-VolumesTransfersV355Test-1733276514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:20 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-fa617f1b-e312-4773-aceb-eaf6d0293b76 tempest-VolumesTransfersV355Test-1733276514 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:26:20 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-fa617f1b-e312-4773-aceb-eaf6d0293b76 tempest-VolumesTransfersV355Test-1733276514 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:26:20 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-fa617f1b-e312-4773-aceb-eaf6d0293b76 tempest-VolumesTransfersV355Test-1733276514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-efd3cc16-659a-4c89-860b-cf733e8377c9 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:20 devstack sudo[87816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-efd3cc16-659a-4c89-860b-cf733e8377c9 1073741824
Feb 27 01:26:20 devstack sudo[87816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:20 devstack sudo[87814]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:20 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c13a57e6-4203-45eb-b338-6df7d8b00839 tempest-VolumesImageMetadata-1564607973 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-57441403-ffb7-48f6-b0b7-a1d0b5179872" returned: 0 in 0.972s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:20 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c13a57e6-4203-45eb-b338-6df7d8b00839 tempest-VolumesImageMetadata-1564607973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-57441403-ffb7-48f6-b0b7-a1d0b5179872 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:21 devstack sudo[87820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-57441403-ffb7-48f6-b0b7-a1d0b5179872
Feb 27 01:26:21 devstack sudo[87820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:21 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-fa617f1b-e312-4773-aceb-eaf6d0293b76 tempest-VolumesTransfersV355Test-1733276514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-efd3cc16-659a-4c89-860b-cf733e8377c9 1073741824" returned: 0 in 1.108s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:21 devstack sudo[87816]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:21 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-fa617f1b-e312-4773-aceb-eaf6d0293b76 tempest-VolumesTransfersV355Test-1733276514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-efd3cc16-659a-4c89-860b-cf733e8377c9 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:21 devstack sudo[87828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-efd3cc16-659a-4c89-860b-cf733e8377c9
Feb 27 01:26:21 devstack sudo[87828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:21 devstack sudo[87820]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:21 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c13a57e6-4203-45eb-b338-6df7d8b00839 tempest-VolumesImageMetadata-1564607973 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-57441403-ffb7-48f6-b0b7-a1d0b5179872" returned: 1 in 0.955s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:21 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c13a57e6-4203-45eb-b338-6df7d8b00839 tempest-VolumesImageMetadata-1564607973 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-57441403-ffb7-48f6-b0b7-a1d0b5179872' failed. Not Retrying. {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 27 01:26:21 devstack cinder-volume[83106]: DEBUG cinder.volume.volume_utils [None req-c13a57e6-4203-45eb-b338-6df7d8b00839 tempest-VolumesImageMetadata-1564607973 None] Downloaded image 4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca ((None, [{'url': 'file:///opt/stack/data/glance/images/4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca', 'metadata': {}}])) to volume 57441403-ffb7-48f6-b0b7-a1d0b5179872 successfully. {{(pid=83106) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Feb 27 01:26:21 devstack cinder-volume[83106]: DEBUG cinder.image.image_utils [None req-c13a57e6-4203-45eb-b338-6df7d8b00839 tempest-VolumesImageMetadata-1564607973 None] Temporary image 4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca for user 32e8ab3fe7b7473992c4a61c245657c3 is deleted. {{(pid=83106) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Feb 27 01:26:21 devstack cinder-volume[83106]: DEBUG cinder.volume.volume_utils [None req-c13a57e6-4203-45eb-b338-6df7d8b00839 tempest-VolumesImageMetadata-1564607973 None] Marking volume 57441403-ffb7-48f6-b0b7-a1d0b5179872 as bootable. {{(pid=83106) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Feb 27 01:26:21 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-c13a57e6-4203-45eb-b338-6df7d8b00839 tempest-VolumesImageMetadata-1564607973 None] Copying metadata from image 4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca to 57441403-ffb7-48f6-b0b7-a1d0b5179872. {{(pid=83106) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Feb 27 01:26:21 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-c13a57e6-4203-45eb-b338-6df7d8b00839 tempest-VolumesImageMetadata-1564607973 None] Creating volume glance metadata for volume 57441403-ffb7-48f6-b0b7-a1d0b5179872 backed by image 4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83106) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Feb 27 01:26:22 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c13a57e6-4203-45eb-b338-6df7d8b00839 tempest-VolumesImageMetadata-1564607973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09a67b91-174d-4695-b765-fb2314ee7a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57441403-ffb7-48f6-b0b7-a1d0b5179872', 'volume_size': 1, 'image_id': '4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd105600f18404a29b5061e7b75a5bfe1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca', 'created_at': datetime.datetime(2026, 2, 27, 0, 17, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 17, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f07e8b3ef20>}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:22 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c13a57e6-4203-45eb-b338-6df7d8b00839 tempest-VolumesImageMetadata-1564607973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16489838-220f-4599-8058-bd4a0ea5c377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:22 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-c13a57e6-4203-45eb-b338-6df7d8b00839 tempest-VolumesImageMetadata-1564607973 None] Volume volume-57441403-ffb7-48f6-b0b7-a1d0b5179872 (57441403-ffb7-48f6-b0b7-a1d0b5179872): created successfully
Feb 27 01:26:22 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c13a57e6-4203-45eb-b338-6df7d8b00839 tempest-VolumesImageMetadata-1564607973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16489838-220f-4599-8058-bd4a0ea5c377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:22 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c13a57e6-4203-45eb-b338-6df7d8b00839 tempest-VolumesImageMetadata-1564607973 None] Flow 'volume_create_manager' (bc156ded-5b3c-4030-a1f3-b5072b2fd8f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:26:22 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-c13a57e6-4203-45eb-b338-6df7d8b00839 tempest-VolumesImageMetadata-1564607973 None] Created volume successfully.
Feb 27 01:26:22 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac175b65-9b33-4cf3-94b5-b3e4f98458ec tempest-VolumesListTestJSON-1934545439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:26:22 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-ac175b65-9b33-4cf3-94b5-b3e4f98458ec tempest-VolumesListTestJSON-1934545439 None] Flow 'volume_create_manager' (96cdab95-00fb-4282-9818-cf3a95f68be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:26:22 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-ac175b65-9b33-4cf3-94b5-b3e4f98458ec tempest-VolumesListTestJSON-1934545439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb627d7d-89c6-4df9-bd57-6230a5401473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:22 devstack sudo[87828]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:22 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-ac175b65-9b33-4cf3-94b5-b3e4f98458ec tempest-VolumesListTestJSON-1934545439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb627d7d-89c6-4df9-bd57-6230a5401473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:26:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-670356',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ca7850f-4680-45fe-ad13-eaa7681bae29,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9319da2384af417a86d3bacbf481e674',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:26:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:26:22Z,use_quota=True,user_id='0a5c2ef0816d4368b75a78fa4f59f880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:22 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-ac175b65-9b33-4cf3-94b5-b3e4f98458ec tempest-VolumesListTestJSON-1934545439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04ae85a6-9746-4dce-8ef6-79a7bccd26da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:22 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-ac175b65-9b33-4cf3-94b5-b3e4f98458ec tempest-VolumesListTestJSON-1934545439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04ae85a6-9746-4dce-8ef6-79a7bccd26da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:22 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-ac175b65-9b33-4cf3-94b5-b3e4f98458ec tempest-VolumesListTestJSON-1934545439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5c4351f-6ab3-41e2-ab89-21f2ca44f481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:22 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-ac175b65-9b33-4cf3-94b5-b3e4f98458ec tempest-VolumesListTestJSON-1934545439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5c4351f-6ab3-41e2-ab89-21f2ca44f481) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ca7850f-4680-45fe-ad13-eaa7681bae29', 'volume_name': 'volume-6ca7850f-4680-45fe-ad13-eaa7681bae29', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:22 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-ac175b65-9b33-4cf3-94b5-b3e4f98458ec tempest-VolumesListTestJSON-1934545439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25ed0567-a8aa-4ac2-b26e-b07f51d1c86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:22 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-ac175b65-9b33-4cf3-94b5-b3e4f98458ec tempest-VolumesListTestJSON-1934545439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25ed0567-a8aa-4ac2-b26e-b07f51d1c86d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:22 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-ac175b65-9b33-4cf3-94b5-b3e4f98458ec tempest-VolumesListTestJSON-1934545439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e651d08c-c6bb-42fa-b4db-8df0969363fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:22 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-ac175b65-9b33-4cf3-94b5-b3e4f98458ec tempest-VolumesListTestJSON-1934545439 None] Volume 6ca7850f-4680-45fe-ad13-eaa7681bae29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ca7850f-4680-45fe-ad13-eaa7681bae29', 'volume_size': 1}
Feb 27 01:26:22 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-ac175b65-9b33-4cf3-94b5-b3e4f98458ec tempest-VolumesListTestJSON-1934545439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:22 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-fa617f1b-e312-4773-aceb-eaf6d0293b76 tempest-VolumesTransfersV355Test-1733276514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-efd3cc16-659a-4c89-860b-cf733e8377c9" returned: 0 in 0.698s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:22 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-fa617f1b-e312-4773-aceb-eaf6d0293b76 tempest-VolumesTransfersV355Test-1733276514 None] <== create_volume: return (1859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:26:22 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-fa617f1b-e312-4773-aceb-eaf6d0293b76 tempest-VolumesTransfersV355Test-1733276514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.863s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:22 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-ac175b65-9b33-4cf3-94b5-b3e4f98458ec tempest-VolumesListTestJSON-1934545439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:22 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-ac175b65-9b33-4cf3-94b5-b3e4f98458ec tempest-VolumesListTestJSON-1934545439 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:26:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-670356',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ca7850f-4680-45fe-ad13-eaa7681bae29,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9319da2384af417a86d3bacbf481e674',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:26:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:26:22Z,use_quota=True,user_id='0a5c2ef0816d4368b75a78fa4f59f880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:26:22 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-ac175b65-9b33-4cf3-94b5-b3e4f98458ec tempest-VolumesListTestJSON-1934545439 None] Creating volume 6ca7850f-4680-45fe-ad13-eaa7681bae29 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:26:22 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-ac175b65-9b33-4cf3-94b5-b3e4f98458ec tempest-VolumesListTestJSON-1934545439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:22 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-ac175b65-9b33-4cf3-94b5-b3e4f98458ec tempest-VolumesListTestJSON-1934545439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:22 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-ac175b65-9b33-4cf3-94b5-b3e4f98458ec tempest-VolumesListTestJSON-1934545439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:26:22 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-ac175b65-9b33-4cf3-94b5-b3e4f98458ec tempest-VolumesListTestJSON-1934545439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:26:22 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-ac175b65-9b33-4cf3-94b5-b3e4f98458ec tempest-VolumesListTestJSON-1934545439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:22 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-ac175b65-9b33-4cf3-94b5-b3e4f98458ec tempest-VolumesListTestJSON-1934545439 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:26:22 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-ac175b65-9b33-4cf3-94b5-b3e4f98458ec tempest-VolumesListTestJSON-1934545439 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:26:22 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ac175b65-9b33-4cf3-94b5-b3e4f98458ec tempest-VolumesListTestJSON-1934545439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-6ca7850f-4680-45fe-ad13-eaa7681bae29 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:22 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-fa617f1b-e312-4773-aceb-eaf6d0293b76 tempest-VolumesTransfersV355Test-1733276514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36a4d1ce-004f-4e31-8320-b38e51a3645a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efd3cc16-659a-4c89-860b-cf733e8377c9', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:22 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-fa617f1b-e312-4773-aceb-eaf6d0293b76 tempest-VolumesTransfersV355Test-1733276514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e57ddfe-d2ac-4e1b-9c27-e145a527aabc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:22 devstack sudo[87831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-6ca7850f-4680-45fe-ad13-eaa7681bae29 1073741824
Feb 27 01:26:22 devstack sudo[87831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:22 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-fa617f1b-e312-4773-aceb-eaf6d0293b76 tempest-VolumesTransfersV355Test-1733276514 None] Volume volume-efd3cc16-659a-4c89-860b-cf733e8377c9 (efd3cc16-659a-4c89-860b-cf733e8377c9): created successfully
Feb 27 01:26:22 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-fa617f1b-e312-4773-aceb-eaf6d0293b76 tempest-VolumesTransfersV355Test-1733276514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e57ddfe-d2ac-4e1b-9c27-e145a527aabc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:22 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-fa617f1b-e312-4773-aceb-eaf6d0293b76 tempest-VolumesTransfersV355Test-1733276514 None] Flow 'volume_create_manager' (483123ef-0d7d-4dae-8397-c7233a47d229) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:26:22 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-fa617f1b-e312-4773-aceb-eaf6d0293b76 tempest-VolumesTransfersV355Test-1733276514 None] Created volume successfully.
Feb 27 01:26:23 devstack sudo[87831]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:23 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ac175b65-9b33-4cf3-94b5-b3e4f98458ec tempest-VolumesListTestJSON-1934545439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-6ca7850f-4680-45fe-ad13-eaa7681bae29 1073741824" returned: 0 in 0.934s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:23 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ac175b65-9b33-4cf3-94b5-b3e4f98458ec tempest-VolumesListTestJSON-1934545439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-6ca7850f-4680-45fe-ad13-eaa7681bae29 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:23 devstack sudo[87837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-6ca7850f-4680-45fe-ad13-eaa7681bae29
Feb 27 01:26:23 devstack sudo[87837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:23 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-113bc96f-7ec8-4ec4-84ac-7d6a8644fa99 tempest-VolumesTransfersV355Test-2077859926 None] Transfer volume completed successfully.
Feb 27 01:26:23 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-ff490bdb-ff5c-4e37-9847-fa1c100a44c1 tempest-VolumesImageMetadata-1564607973 None] Acquiring lock "cinder-57441403-ffb7-48f6-b0b7-a1d0b5179872-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:23 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-ff490bdb-ff5c-4e37-9847-fa1c100a44c1 tempest-VolumesImageMetadata-1564607973 None] Lock "cinder-57441403-ffb7-48f6-b0b7-a1d0b5179872-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:23 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-ff490bdb-ff5c-4e37-9847-fa1c100a44c1 tempest-VolumesImageMetadata-1564607973 None] Acquiring lock "cinder-quobyte-57441403-ffb7-48f6-b0b7-a1d0b5179872" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:23 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-ff490bdb-ff5c-4e37-9847-fa1c100a44c1 tempest-VolumesImageMetadata-1564607973 None] Lock "cinder-quobyte-57441403-ffb7-48f6-b0b7-a1d0b5179872" acquired by "delete_volume" :: waited 0.010s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:23 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[434a152e-445b-4da3-9137-66ce5ff3189a]: (4, 'raw') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:26:23 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ff490bdb-ff5c-4e37-9847-fa1c100a44c1 tempest-VolumesImageMetadata-1564607973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-57441403-ffb7-48f6-b0b7-a1d0b5179872 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:23 devstack sudo[87841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-57441403-ffb7-48f6-b0b7-a1d0b5179872
Feb 27 01:26:23 devstack sudo[87841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:24 devstack sudo[87837]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:24 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ac175b65-9b33-4cf3-94b5-b3e4f98458ec tempest-VolumesListTestJSON-1934545439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-6ca7850f-4680-45fe-ad13-eaa7681bae29" returned: 0 in 0.562s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:24 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-ac175b65-9b33-4cf3-94b5-b3e4f98458ec tempest-VolumesListTestJSON-1934545439 None] <== create_volume: return (1530ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:26:24 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-ac175b65-9b33-4cf3-94b5-b3e4f98458ec tempest-VolumesListTestJSON-1934545439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.533s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:24 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-ac175b65-9b33-4cf3-94b5-b3e4f98458ec tempest-VolumesListTestJSON-1934545439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e651d08c-c6bb-42fa-b4db-8df0969363fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ca7850f-4680-45fe-ad13-eaa7681bae29', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:24 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-ac175b65-9b33-4cf3-94b5-b3e4f98458ec tempest-VolumesListTestJSON-1934545439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (142fb283-2d55-437b-b022-f7c709615357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:24 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-ac175b65-9b33-4cf3-94b5-b3e4f98458ec tempest-VolumesListTestJSON-1934545439 None] Volume volume-6ca7850f-4680-45fe-ad13-eaa7681bae29 (6ca7850f-4680-45fe-ad13-eaa7681bae29): created successfully
Feb 27 01:26:24 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-ac175b65-9b33-4cf3-94b5-b3e4f98458ec tempest-VolumesListTestJSON-1934545439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (142fb283-2d55-437b-b022-f7c709615357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:24 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-ac175b65-9b33-4cf3-94b5-b3e4f98458ec tempest-VolumesListTestJSON-1934545439 None] Flow 'volume_create_manager' (96cdab95-00fb-4282-9818-cf3a95f68be3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:26:24 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-ac175b65-9b33-4cf3-94b5-b3e4f98458ec tempest-VolumesListTestJSON-1934545439 None] Created volume successfully.
Feb 27 01:26:24 devstack sudo[87841]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:24 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ff490bdb-ff5c-4e37-9847-fa1c100a44c1 tempest-VolumesImageMetadata-1564607973 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-57441403-ffb7-48f6-b0b7-a1d0b5179872" returned: 0 in 0.686s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:24 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ff490bdb-ff5c-4e37-9847-fa1c100a44c1 tempest-VolumesImageMetadata-1564607973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-57441403-ffb7-48f6-b0b7-a1d0b5179872 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:24 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5581b908-f594-450e-a09b-3ea8ae1660de tempest-VolumesTransfersV355Test-759829355 None] Acquiring lock "cinder-efd3cc16-659a-4c89-860b-cf733e8377c9-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:24 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5581b908-f594-450e-a09b-3ea8ae1660de tempest-VolumesTransfersV355Test-759829355 None] Lock "cinder-efd3cc16-659a-4c89-860b-cf733e8377c9-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:24 devstack sudo[87846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-57441403-ffb7-48f6-b0b7-a1d0b5179872
Feb 27 01:26:24 devstack sudo[87846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:24 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5581b908-f594-450e-a09b-3ea8ae1660de tempest-VolumesTransfersV355Test-759829355 None] Acquiring lock "cinder-quobyte-efd3cc16-659a-4c89-860b-cf733e8377c9" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:24 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5581b908-f594-450e-a09b-3ea8ae1660de tempest-VolumesTransfersV355Test-759829355 None] Lock "cinder-quobyte-efd3cc16-659a-4c89-860b-cf733e8377c9" acquired by "delete_volume" :: waited 0.010s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:24 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26492a1-d2cf-4795-a300-e7ec2c37f4d9]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:26:24 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5581b908-f594-450e-a09b-3ea8ae1660de tempest-VolumesTransfersV355Test-759829355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-efd3cc16-659a-4c89-860b-cf733e8377c9 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:24 devstack sudo[87848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-efd3cc16-659a-4c89-860b-cf733e8377c9
Feb 27 01:26:24 devstack sudo[87848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:25 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9f97ecf-eea0-4a9c-81ae-893bfa5f0ba8 tempest-VolumesListTestJSON-1934545439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:26:25 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-f9f97ecf-eea0-4a9c-81ae-893bfa5f0ba8 tempest-VolumesListTestJSON-1934545439 None] Flow 'volume_create_manager' (abee464d-e0fe-4080-bcd4-9c8f0296ee40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:26:25 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-f9f97ecf-eea0-4a9c-81ae-893bfa5f0ba8 tempest-VolumesListTestJSON-1934545439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (515edb4c-0b09-4c0d-ae55-24c5340acdb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:25 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-f9f97ecf-eea0-4a9c-81ae-893bfa5f0ba8 tempest-VolumesListTestJSON-1934545439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (515edb4c-0b09-4c0d-ae55-24c5340acdb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:26:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-896613730',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46465a05-65dd-4b06-8dfc-5a67488d5635,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9319da2384af417a86d3bacbf481e674',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:26:25Z,use_quota=True,user_id='0a5c2ef0816d4368b75a78fa4f59f880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:25 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-f9f97ecf-eea0-4a9c-81ae-893bfa5f0ba8 tempest-VolumesListTestJSON-1934545439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31df422b-01d9-40cd-8cb4-a5caa42ac0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:25 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-f9f97ecf-eea0-4a9c-81ae-893bfa5f0ba8 tempest-VolumesListTestJSON-1934545439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31df422b-01d9-40cd-8cb4-a5caa42ac0da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:25 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-f9f97ecf-eea0-4a9c-81ae-893bfa5f0ba8 tempest-VolumesListTestJSON-1934545439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f62e1a39-5457-427e-91a5-f6ef081dde71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:25 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-f9f97ecf-eea0-4a9c-81ae-893bfa5f0ba8 tempest-VolumesListTestJSON-1934545439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f62e1a39-5457-427e-91a5-f6ef081dde71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46465a05-65dd-4b06-8dfc-5a67488d5635', 'volume_name': 'volume-46465a05-65dd-4b06-8dfc-5a67488d5635', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:25 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-f9f97ecf-eea0-4a9c-81ae-893bfa5f0ba8 tempest-VolumesListTestJSON-1934545439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (693d27c5-ce43-47a1-8497-609d0db9d23d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:25 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-f9f97ecf-eea0-4a9c-81ae-893bfa5f0ba8 tempest-VolumesListTestJSON-1934545439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (693d27c5-ce43-47a1-8497-609d0db9d23d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:25 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-f9f97ecf-eea0-4a9c-81ae-893bfa5f0ba8 tempest-VolumesListTestJSON-1934545439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (445a3591-d0e6-4c3d-9fac-2442a23694f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:25 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-f9f97ecf-eea0-4a9c-81ae-893bfa5f0ba8 tempest-VolumesListTestJSON-1934545439 None] Volume 46465a05-65dd-4b06-8dfc-5a67488d5635: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46465a05-65dd-4b06-8dfc-5a67488d5635', 'volume_size': 1}
Feb 27 01:26:25 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-f9f97ecf-eea0-4a9c-81ae-893bfa5f0ba8 tempest-VolumesListTestJSON-1934545439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:25 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-f9f97ecf-eea0-4a9c-81ae-893bfa5f0ba8 tempest-VolumesListTestJSON-1934545439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:25 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-f9f97ecf-eea0-4a9c-81ae-893bfa5f0ba8 tempest-VolumesListTestJSON-1934545439 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:26:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-896613730',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46465a05-65dd-4b06-8dfc-5a67488d5635,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9319da2384af417a86d3bacbf481e674',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:26:25Z,use_quota=True,user_id='0a5c2ef0816d4368b75a78fa4f59f880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:26:25 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-f9f97ecf-eea0-4a9c-81ae-893bfa5f0ba8 tempest-VolumesListTestJSON-1934545439 None] Creating volume 46465a05-65dd-4b06-8dfc-5a67488d5635 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:26:25 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-f9f97ecf-eea0-4a9c-81ae-893bfa5f0ba8 tempest-VolumesListTestJSON-1934545439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:25 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-f9f97ecf-eea0-4a9c-81ae-893bfa5f0ba8 tempest-VolumesListTestJSON-1934545439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:25 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-f9f97ecf-eea0-4a9c-81ae-893bfa5f0ba8 tempest-VolumesListTestJSON-1934545439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:26:25 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-f9f97ecf-eea0-4a9c-81ae-893bfa5f0ba8 tempest-VolumesListTestJSON-1934545439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:26:25 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-f9f97ecf-eea0-4a9c-81ae-893bfa5f0ba8 tempest-VolumesListTestJSON-1934545439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:25 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-f9f97ecf-eea0-4a9c-81ae-893bfa5f0ba8 tempest-VolumesListTestJSON-1934545439 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:26:25 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-f9f97ecf-eea0-4a9c-81ae-893bfa5f0ba8 tempest-VolumesListTestJSON-1934545439 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:26:25 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-f9f97ecf-eea0-4a9c-81ae-893bfa5f0ba8 tempest-VolumesListTestJSON-1934545439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-46465a05-65dd-4b06-8dfc-5a67488d5635 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:25 devstack sudo[87853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-46465a05-65dd-4b06-8dfc-5a67488d5635 1073741824
Feb 27 01:26:25 devstack sudo[87853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:25 devstack sudo[87846]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:25 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ff490bdb-ff5c-4e37-9847-fa1c100a44c1 tempest-VolumesImageMetadata-1564607973 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-57441403-ffb7-48f6-b0b7-a1d0b5179872" returned: 1 in 0.705s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:25 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ff490bdb-ff5c-4e37-9847-fa1c100a44c1 tempest-VolumesImageMetadata-1564607973 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-57441403-ffb7-48f6-b0b7-a1d0b5179872' failed. Not Retrying. {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 27 01:26:25 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ff490bdb-ff5c-4e37-9847-fa1c100a44c1 tempest-VolumesImageMetadata-1564607973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-57441403-ffb7-48f6-b0b7-a1d0b5179872 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:25 devstack sudo[87858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-57441403-ffb7-48f6-b0b7-a1d0b5179872
Feb 27 01:26:25 devstack sudo[87858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:25 devstack sudo[87848]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:25 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5581b908-f594-450e-a09b-3ea8ae1660de tempest-VolumesTransfersV355Test-759829355 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-efd3cc16-659a-4c89-860b-cf733e8377c9" returned: 0 in 0.654s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:25 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5581b908-f594-450e-a09b-3ea8ae1660de tempest-VolumesTransfersV355Test-759829355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-efd3cc16-659a-4c89-860b-cf733e8377c9 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:25 devstack sudo[87860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-efd3cc16-659a-4c89-860b-cf733e8377c9
Feb 27 01:26:25 devstack sudo[87860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:25 devstack sudo[87858]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:25 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ff490bdb-ff5c-4e37-9847-fa1c100a44c1 tempest-VolumesImageMetadata-1564607973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-57441403-ffb7-48f6-b0b7-a1d0b5179872" returned: 0 in 0.480s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:25 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-ff490bdb-ff5c-4e37-9847-fa1c100a44c1 tempest-VolumesImageMetadata-1564607973 None] Lock "cinder-quobyte-57441403-ffb7-48f6-b0b7-a1d0b5179872" released by "delete_volume" :: held 1.929s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:25 devstack sudo[87853]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:25 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-ff490bdb-ff5c-4e37-9847-fa1c100a44c1 tempest-VolumesImageMetadata-1564607973 None] Created reservations ['3acbbb34-31e5-41a7-8a0d-7fc9a1383d56', '2e7abffc-645c-45c4-994e-621fd6619c5a', 'ebeee36d-1add-427a-b389-bca250996929', '65907d41-0cfc-4f98-8247-dee74db30036'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:26:25 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-f9f97ecf-eea0-4a9c-81ae-893bfa5f0ba8 tempest-VolumesListTestJSON-1934545439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-46465a05-65dd-4b06-8dfc-5a67488d5635 1073741824" returned: 0 in 0.662s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:25 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-ff490bdb-ff5c-4e37-9847-fa1c100a44c1 tempest-VolumesImageMetadata-1564607973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:25 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-ff490bdb-ff5c-4e37-9847-fa1c100a44c1 tempest-VolumesImageMetadata-1564607973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:25 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-ff490bdb-ff5c-4e37-9847-fa1c100a44c1 tempest-VolumesImageMetadata-1564607973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:26:25 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-ff490bdb-ff5c-4e37-9847-fa1c100a44c1 tempest-VolumesImageMetadata-1564607973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:26:25 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-ff490bdb-ff5c-4e37-9847-fa1c100a44c1 tempest-VolumesImageMetadata-1564607973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:25 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ff490bdb-ff5c-4e37-9847-fa1c100a44c1 tempest-VolumesImageMetadata-1564607973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:25 devstack sudo[87860]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:25 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5581b908-f594-450e-a09b-3ea8ae1660de tempest-VolumesTransfersV355Test-759829355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-efd3cc16-659a-4c89-860b-cf733e8377c9" returned: 0 in 0.501s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:25 devstack sudo[87867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:26:25 devstack sudo[87867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:25 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-f9f97ecf-eea0-4a9c-81ae-893bfa5f0ba8 tempest-VolumesListTestJSON-1934545439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-46465a05-65dd-4b06-8dfc-5a67488d5635 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:25 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5581b908-f594-450e-a09b-3ea8ae1660de tempest-VolumesTransfersV355Test-759829355 None] Lock "cinder-quobyte-efd3cc16-659a-4c89-860b-cf733e8377c9" released by "delete_volume" :: held 1.195s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:25 devstack sudo[87869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-46465a05-65dd-4b06-8dfc-5a67488d5635
Feb 27 01:26:25 devstack sudo[87869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:25 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-5581b908-f594-450e-a09b-3ea8ae1660de tempest-VolumesTransfersV355Test-759829355 None] Created reservations ['8ee4e8bd-3f24-4bbd-ae02-3b7d0e856995', '2812cf51-affc-4680-b1dc-30d96d686f25', 'f9aa25c1-5303-423f-bf4b-59631e0eb180', '786d3c2e-75b4-4888-bfad-df878c96e555'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:26:25 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-5581b908-f594-450e-a09b-3ea8ae1660de tempest-VolumesTransfersV355Test-759829355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:25 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-5581b908-f594-450e-a09b-3ea8ae1660de tempest-VolumesTransfersV355Test-759829355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:25 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-5581b908-f594-450e-a09b-3ea8ae1660de tempest-VolumesTransfersV355Test-759829355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:26:25 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-5581b908-f594-450e-a09b-3ea8ae1660de tempest-VolumesTransfersV355Test-759829355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:26:25 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-5581b908-f594-450e-a09b-3ea8ae1660de tempest-VolumesTransfersV355Test-759829355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:25 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5581b908-f594-450e-a09b-3ea8ae1660de tempest-VolumesTransfersV355Test-759829355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:25 devstack sudo[87871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:26:25 devstack sudo[87871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:26 devstack sudo[87867]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:26 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ff490bdb-ff5c-4e37-9847-fa1c100a44c1 tempest-VolumesImageMetadata-1564607973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.618s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:26 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-ff490bdb-ff5c-4e37-9847-fa1c100a44c1 tempest-VolumesImageMetadata-1564607973 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:26:26 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-ff490bdb-ff5c-4e37-9847-fa1c100a44c1 tempest-VolumesImageMetadata-1564607973 None] Deleted volume successfully.
Feb 27 01:26:26 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-ff490bdb-ff5c-4e37-9847-fa1c100a44c1 tempest-VolumesImageMetadata-1564607973 None] Lock "cinder-57441403-ffb7-48f6-b0b7-a1d0b5179872-delete_volume" released by "delete_volume" :: held 2.706s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:26 devstack sudo[87869]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:26 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-f9f97ecf-eea0-4a9c-81ae-893bfa5f0ba8 tempest-VolumesListTestJSON-1934545439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-46465a05-65dd-4b06-8dfc-5a67488d5635" returned: 0 in 0.665s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:26 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-f9f97ecf-eea0-4a9c-81ae-893bfa5f0ba8 tempest-VolumesListTestJSON-1934545439 None] <== create_volume: return (1403ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:26:26 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-f9f97ecf-eea0-4a9c-81ae-893bfa5f0ba8 tempest-VolumesListTestJSON-1934545439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.405s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:26 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-f9f97ecf-eea0-4a9c-81ae-893bfa5f0ba8 tempest-VolumesListTestJSON-1934545439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (445a3591-d0e6-4c3d-9fac-2442a23694f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46465a05-65dd-4b06-8dfc-5a67488d5635', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:26 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-f9f97ecf-eea0-4a9c-81ae-893bfa5f0ba8 tempest-VolumesListTestJSON-1934545439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc7f6947-1807-49af-bfd8-e25170ee5efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:26 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-f9f97ecf-eea0-4a9c-81ae-893bfa5f0ba8 tempest-VolumesListTestJSON-1934545439 None] Volume volume-46465a05-65dd-4b06-8dfc-5a67488d5635 (46465a05-65dd-4b06-8dfc-5a67488d5635): created successfully
Feb 27 01:26:26 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-f9f97ecf-eea0-4a9c-81ae-893bfa5f0ba8 tempest-VolumesListTestJSON-1934545439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc7f6947-1807-49af-bfd8-e25170ee5efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:26 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-f9f97ecf-eea0-4a9c-81ae-893bfa5f0ba8 tempest-VolumesListTestJSON-1934545439 None] Flow 'volume_create_manager' (abee464d-e0fe-4080-bcd4-9c8f0296ee40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:26:26 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-f9f97ecf-eea0-4a9c-81ae-893bfa5f0ba8 tempest-VolumesListTestJSON-1934545439 None] Created volume successfully.
Feb 27 01:26:26 devstack sudo[87871]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:26 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5581b908-f594-450e-a09b-3ea8ae1660de tempest-VolumesTransfersV355Test-759829355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.652s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:26 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-5581b908-f594-450e-a09b-3ea8ae1660de tempest-VolumesTransfersV355Test-759829355 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:26:26 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-5581b908-f594-450e-a09b-3ea8ae1660de tempest-VolumesTransfersV355Test-759829355 None] Deleted volume successfully.
Feb 27 01:26:26 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5581b908-f594-450e-a09b-3ea8ae1660de tempest-VolumesTransfersV355Test-759829355 None] Lock "cinder-efd3cc16-659a-4c89-860b-cf733e8377c9-delete_volume" released by "delete_volume" :: held 2.029s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:27 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-03a4a439-7dfe-44b8-b716-8cf10f34861e tempest-VolumesTransfersV355Test-1733276514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:26:27 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-03a4a439-7dfe-44b8-b716-8cf10f34861e tempest-VolumesTransfersV355Test-1733276514 None] Flow 'volume_create_manager' (8020ccbb-c086-4919-b811-7e8d7c37d58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:26:27 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-03a4a439-7dfe-44b8-b716-8cf10f34861e tempest-VolumesTransfersV355Test-1733276514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cf2e89c-e07d-4ba3-9c98-398ef808f8f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:27 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-03a4a439-7dfe-44b8-b716-8cf10f34861e tempest-VolumesTransfersV355Test-1733276514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cf2e89c-e07d-4ba3-9c98-398ef808f8f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-405372656',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e95c1c38-b434-41eb-9273-8ff2a358a577,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85fc33ccd5514491a57a3e7a2edc3693',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:26:27Z,use_quota=True,user_id='ff61e8386dc84828a2a1f55ed2b50367',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:27 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-03a4a439-7dfe-44b8-b716-8cf10f34861e tempest-VolumesTransfersV355Test-1733276514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dd8d03c-b89f-45d4-8de8-a572b4c7724c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:27 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-03a4a439-7dfe-44b8-b716-8cf10f34861e tempest-VolumesTransfersV355Test-1733276514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dd8d03c-b89f-45d4-8de8-a572b4c7724c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:27 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-03a4a439-7dfe-44b8-b716-8cf10f34861e tempest-VolumesTransfersV355Test-1733276514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c918dde9-6f2e-4b79-8dce-1e91acffefb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:27 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-03a4a439-7dfe-44b8-b716-8cf10f34861e tempest-VolumesTransfersV355Test-1733276514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c918dde9-6f2e-4b79-8dce-1e91acffefb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e95c1c38-b434-41eb-9273-8ff2a358a577', 'volume_name': 'volume-e95c1c38-b434-41eb-9273-8ff2a358a577', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:27 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-03a4a439-7dfe-44b8-b716-8cf10f34861e tempest-VolumesTransfersV355Test-1733276514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01312593-c30d-468e-9a91-1a70c84b4308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:27 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-03a4a439-7dfe-44b8-b716-8cf10f34861e tempest-VolumesTransfersV355Test-1733276514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01312593-c30d-468e-9a91-1a70c84b4308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:27 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-03a4a439-7dfe-44b8-b716-8cf10f34861e tempest-VolumesTransfersV355Test-1733276514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e346d09-44a1-4fe7-b1b7-6ffe8f9acea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:27 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-03a4a439-7dfe-44b8-b716-8cf10f34861e tempest-VolumesTransfersV355Test-1733276514 None] Volume e95c1c38-b434-41eb-9273-8ff2a358a577: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e95c1c38-b434-41eb-9273-8ff2a358a577', 'volume_size': 1}
Feb 27 01:26:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-03a4a439-7dfe-44b8-b716-8cf10f34861e tempest-VolumesTransfersV355Test-1733276514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-03a4a439-7dfe-44b8-b716-8cf10f34861e tempest-VolumesTransfersV355Test-1733276514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:27 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-03a4a439-7dfe-44b8-b716-8cf10f34861e tempest-VolumesTransfersV355Test-1733276514 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-405372656',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e95c1c38-b434-41eb-9273-8ff2a358a577,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85fc33ccd5514491a57a3e7a2edc3693',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:26:27Z,use_quota=True,user_id='ff61e8386dc84828a2a1f55ed2b50367',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:26:27 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-03a4a439-7dfe-44b8-b716-8cf10f34861e tempest-VolumesTransfersV355Test-1733276514 None] Creating volume e95c1c38-b434-41eb-9273-8ff2a358a577 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:26:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-03a4a439-7dfe-44b8-b716-8cf10f34861e tempest-VolumesTransfersV355Test-1733276514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-03a4a439-7dfe-44b8-b716-8cf10f34861e tempest-VolumesTransfersV355Test-1733276514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:27 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-03a4a439-7dfe-44b8-b716-8cf10f34861e tempest-VolumesTransfersV355Test-1733276514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:26:27 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-03a4a439-7dfe-44b8-b716-8cf10f34861e tempest-VolumesTransfersV355Test-1733276514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:26:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-03a4a439-7dfe-44b8-b716-8cf10f34861e tempest-VolumesTransfersV355Test-1733276514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:27 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-03a4a439-7dfe-44b8-b716-8cf10f34861e tempest-VolumesTransfersV355Test-1733276514 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:26:27 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-03a4a439-7dfe-44b8-b716-8cf10f34861e tempest-VolumesTransfersV355Test-1733276514 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:26:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-03a4a439-7dfe-44b8-b716-8cf10f34861e tempest-VolumesTransfersV355Test-1733276514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e95c1c38-b434-41eb-9273-8ff2a358a577 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:27 devstack sudo[87877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e95c1c38-b434-41eb-9273-8ff2a358a577 1073741824
Feb 27 01:26:27 devstack sudo[87877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:27 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-f32a1e09-3c22-4023-95c1-40d397aa304c tempest-VolumesListTestJSON-1934545439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:26:27 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-f32a1e09-3c22-4023-95c1-40d397aa304c tempest-VolumesListTestJSON-1934545439 None] Flow 'volume_create_manager' (f569088d-3c34-4e51-bb2f-1b9a785c8268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:26:27 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-f32a1e09-3c22-4023-95c1-40d397aa304c tempest-VolumesListTestJSON-1934545439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e69ad00-1408-440a-b600-4fd90712eb7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:27 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-f32a1e09-3c22-4023-95c1-40d397aa304c tempest-VolumesListTestJSON-1934545439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e69ad00-1408-440a-b600-4fd90712eb7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-987922552',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=383386a8-159f-4796-88c9-e90866709264,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9319da2384af417a86d3bacbf481e674',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:26:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:26:28Z,use_quota=True,user_id='0a5c2ef0816d4368b75a78fa4f59f880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:27 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-f32a1e09-3c22-4023-95c1-40d397aa304c tempest-VolumesListTestJSON-1934545439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7543fbd6-9287-443a-9f49-f27348028d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:27 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-f32a1e09-3c22-4023-95c1-40d397aa304c tempest-VolumesListTestJSON-1934545439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7543fbd6-9287-443a-9f49-f27348028d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:27 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-f32a1e09-3c22-4023-95c1-40d397aa304c tempest-VolumesListTestJSON-1934545439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0a04261-3dc6-4049-86ce-e960ec738b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:27 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-f32a1e09-3c22-4023-95c1-40d397aa304c tempest-VolumesListTestJSON-1934545439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0a04261-3dc6-4049-86ce-e960ec738b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '383386a8-159f-4796-88c9-e90866709264', 'volume_name': 'volume-383386a8-159f-4796-88c9-e90866709264', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:27 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-f32a1e09-3c22-4023-95c1-40d397aa304c tempest-VolumesListTestJSON-1934545439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b73e4d9-f9e3-43c9-bfb4-a9add181dfd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:27 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-f32a1e09-3c22-4023-95c1-40d397aa304c tempest-VolumesListTestJSON-1934545439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b73e4d9-f9e3-43c9-bfb4-a9add181dfd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:27 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-f32a1e09-3c22-4023-95c1-40d397aa304c tempest-VolumesListTestJSON-1934545439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (211d459f-a57e-4113-a7f5-f38c9a4a21f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:27 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-f32a1e09-3c22-4023-95c1-40d397aa304c tempest-VolumesListTestJSON-1934545439 None] Volume 383386a8-159f-4796-88c9-e90866709264: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-383386a8-159f-4796-88c9-e90866709264', 'volume_size': 1}
Feb 27 01:26:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-f32a1e09-3c22-4023-95c1-40d397aa304c tempest-VolumesListTestJSON-1934545439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:28 devstack sudo[87877]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:28 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-03a4a439-7dfe-44b8-b716-8cf10f34861e tempest-VolumesTransfersV355Test-1733276514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e95c1c38-b434-41eb-9273-8ff2a358a577 1073741824" returned: 0 in 0.835s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:28 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-03a4a439-7dfe-44b8-b716-8cf10f34861e tempest-VolumesTransfersV355Test-1733276514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e95c1c38-b434-41eb-9273-8ff2a358a577 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:28 devstack sudo[87882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e95c1c38-b434-41eb-9273-8ff2a358a577
Feb 27 01:26:28 devstack sudo[87882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:28 devstack sudo[87882]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:28 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-03a4a439-7dfe-44b8-b716-8cf10f34861e tempest-VolumesTransfersV355Test-1733276514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e95c1c38-b434-41eb-9273-8ff2a358a577" returned: 0 in 0.536s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:28 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-03a4a439-7dfe-44b8-b716-8cf10f34861e tempest-VolumesTransfersV355Test-1733276514 None] <== create_volume: return (1408ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:26:28 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-03a4a439-7dfe-44b8-b716-8cf10f34861e tempest-VolumesTransfersV355Test-1733276514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.410s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:28 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-f32a1e09-3c22-4023-95c1-40d397aa304c tempest-VolumesListTestJSON-1934545439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.751s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:28 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-f32a1e09-3c22-4023-95c1-40d397aa304c tempest-VolumesListTestJSON-1934545439 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-987922552',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=383386a8-159f-4796-88c9-e90866709264,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9319da2384af417a86d3bacbf481e674',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:26:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:26:28Z,use_quota=True,user_id='0a5c2ef0816d4368b75a78fa4f59f880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:26:28 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-f32a1e09-3c22-4023-95c1-40d397aa304c tempest-VolumesListTestJSON-1934545439 None] Creating volume 383386a8-159f-4796-88c9-e90866709264 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:26:28 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-f32a1e09-3c22-4023-95c1-40d397aa304c tempest-VolumesListTestJSON-1934545439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:28 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-f32a1e09-3c22-4023-95c1-40d397aa304c tempest-VolumesListTestJSON-1934545439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:28 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-f32a1e09-3c22-4023-95c1-40d397aa304c tempest-VolumesListTestJSON-1934545439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:26:28 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-f32a1e09-3c22-4023-95c1-40d397aa304c tempest-VolumesListTestJSON-1934545439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:26:28 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-f32a1e09-3c22-4023-95c1-40d397aa304c tempest-VolumesListTestJSON-1934545439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:28 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-f32a1e09-3c22-4023-95c1-40d397aa304c tempest-VolumesListTestJSON-1934545439 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:26:28 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-f32a1e09-3c22-4023-95c1-40d397aa304c tempest-VolumesListTestJSON-1934545439 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:26:28 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-f32a1e09-3c22-4023-95c1-40d397aa304c tempest-VolumesListTestJSON-1934545439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-383386a8-159f-4796-88c9-e90866709264 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:28 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-03a4a439-7dfe-44b8-b716-8cf10f34861e tempest-VolumesTransfersV355Test-1733276514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e346d09-44a1-4fe7-b1b7-6ffe8f9acea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e95c1c38-b434-41eb-9273-8ff2a358a577', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:28 devstack sudo[87885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-383386a8-159f-4796-88c9-e90866709264 1073741824
Feb 27 01:26:28 devstack sudo[87885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:28 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-03a4a439-7dfe-44b8-b716-8cf10f34861e tempest-VolumesTransfersV355Test-1733276514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (017eaba3-9646-4a90-a55d-b821ba319ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:28 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-03a4a439-7dfe-44b8-b716-8cf10f34861e tempest-VolumesTransfersV355Test-1733276514 None] Volume volume-e95c1c38-b434-41eb-9273-8ff2a358a577 (e95c1c38-b434-41eb-9273-8ff2a358a577): created successfully
Feb 27 01:26:28 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-03a4a439-7dfe-44b8-b716-8cf10f34861e tempest-VolumesTransfersV355Test-1733276514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (017eaba3-9646-4a90-a55d-b821ba319ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:28 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-03a4a439-7dfe-44b8-b716-8cf10f34861e tempest-VolumesTransfersV355Test-1733276514 None] Flow 'volume_create_manager' (8020ccbb-c086-4919-b811-7e8d7c37d58d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:26:28 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-03a4a439-7dfe-44b8-b716-8cf10f34861e tempest-VolumesTransfersV355Test-1733276514 None] Created volume successfully.
Feb 27 01:26:28 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b7d1582-2462-4c6a-a4a6-e2cd1e4def1b tempest-VolumesMetadataTest-1035870966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:26:28 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-6b7d1582-2462-4c6a-a4a6-e2cd1e4def1b tempest-VolumesMetadataTest-1035870966 None] Flow 'volume_create_manager' (3c847cc3-8989-46a7-86a5-7ccf6b79553a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:26:28 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-6b7d1582-2462-4c6a-a4a6-e2cd1e4def1b tempest-VolumesMetadataTest-1035870966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39ae4365-5701-4c8c-a9d4-f1edc799ea34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:28 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-6b7d1582-2462-4c6a-a4a6-e2cd1e4def1b tempest-VolumesMetadataTest-1035870966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39ae4365-5701-4c8c-a9d4-f1edc799ea34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:26:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-645734142',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5724561b-9fa6-4c59-811d-7991b8aa4ab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29d3d1094d1a4e54b2b04893ef15160e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:26:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:26:29Z,use_quota=True,user_id='be7b902951034b40ac55d0f4e5ec659e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:28 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-6b7d1582-2462-4c6a-a4a6-e2cd1e4def1b tempest-VolumesMetadataTest-1035870966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa316739-597b-4f46-a9f0-390b4eab0406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:28 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-6b7d1582-2462-4c6a-a4a6-e2cd1e4def1b tempest-VolumesMetadataTest-1035870966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa316739-597b-4f46-a9f0-390b4eab0406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:28 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-6b7d1582-2462-4c6a-a4a6-e2cd1e4def1b tempest-VolumesMetadataTest-1035870966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aa39d92-4055-48ce-b91c-de2e1458960d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:28 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-6b7d1582-2462-4c6a-a4a6-e2cd1e4def1b tempest-VolumesMetadataTest-1035870966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aa39d92-4055-48ce-b91c-de2e1458960d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5724561b-9fa6-4c59-811d-7991b8aa4ab5', 'volume_name': 'volume-5724561b-9fa6-4c59-811d-7991b8aa4ab5', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:28 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-6b7d1582-2462-4c6a-a4a6-e2cd1e4def1b tempest-VolumesMetadataTest-1035870966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f48cbdee-74fd-4097-911d-0a40f1336ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:28 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-6b7d1582-2462-4c6a-a4a6-e2cd1e4def1b tempest-VolumesMetadataTest-1035870966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f48cbdee-74fd-4097-911d-0a40f1336ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:28 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-6b7d1582-2462-4c6a-a4a6-e2cd1e4def1b tempest-VolumesMetadataTest-1035870966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc5d434c-2946-4c23-bd7d-80fc6f108c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:28 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-6b7d1582-2462-4c6a-a4a6-e2cd1e4def1b tempest-VolumesMetadataTest-1035870966 None] Volume 5724561b-9fa6-4c59-811d-7991b8aa4ab5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5724561b-9fa6-4c59-811d-7991b8aa4ab5', 'volume_size': 1}
Feb 27 01:26:28 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-6b7d1582-2462-4c6a-a4a6-e2cd1e4def1b tempest-VolumesMetadataTest-1035870966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:29 devstack sudo[87885]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:29 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-f32a1e09-3c22-4023-95c1-40d397aa304c tempest-VolumesListTestJSON-1934545439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-383386a8-159f-4796-88c9-e90866709264 1073741824" returned: 0 in 0.718s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:29 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-f32a1e09-3c22-4023-95c1-40d397aa304c tempest-VolumesListTestJSON-1934545439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-383386a8-159f-4796-88c9-e90866709264 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:29 devstack sudo[87890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-383386a8-159f-4796-88c9-e90866709264
Feb 27 01:26:29 devstack sudo[87890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:29 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-600afa8a-8ffa-4106-b420-6ac94c245af6 tempest-VolumesTransfersV355Test-759829355 None] Acquiring lock "cinder-e95c1c38-b434-41eb-9273-8ff2a358a577-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:29 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-600afa8a-8ffa-4106-b420-6ac94c245af6 tempest-VolumesTransfersV355Test-759829355 None] Lock "cinder-e95c1c38-b434-41eb-9273-8ff2a358a577-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:29 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-600afa8a-8ffa-4106-b420-6ac94c245af6 tempest-VolumesTransfersV355Test-759829355 None] Acquiring lock "cinder-quobyte-e95c1c38-b434-41eb-9273-8ff2a358a577" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:29 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-600afa8a-8ffa-4106-b420-6ac94c245af6 tempest-VolumesTransfersV355Test-759829355 None] Lock "cinder-quobyte-e95c1c38-b434-41eb-9273-8ff2a358a577" acquired by "delete_volume" :: waited 0.010s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:29 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb859c2-b460-4382-be7b-63e543bfd6e5]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:26:29 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-600afa8a-8ffa-4106-b420-6ac94c245af6 tempest-VolumesTransfersV355Test-759829355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e95c1c38-b434-41eb-9273-8ff2a358a577 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:29 devstack sudo[87892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e95c1c38-b434-41eb-9273-8ff2a358a577
Feb 27 01:26:29 devstack sudo[87892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:30 devstack sudo[87890]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:30 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-f32a1e09-3c22-4023-95c1-40d397aa304c tempest-VolumesListTestJSON-1934545439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-383386a8-159f-4796-88c9-e90866709264" returned: 0 in 0.608s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:30 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-f32a1e09-3c22-4023-95c1-40d397aa304c tempest-VolumesListTestJSON-1934545439 None] <== create_volume: return (1373ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:26:30 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-f32a1e09-3c22-4023-95c1-40d397aa304c tempest-VolumesListTestJSON-1934545439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.376s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:30 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-6b7d1582-2462-4c6a-a4a6-e2cd1e4def1b tempest-VolumesMetadataTest-1035870966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.074s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:30 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-6b7d1582-2462-4c6a-a4a6-e2cd1e4def1b tempest-VolumesMetadataTest-1035870966 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:26:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-645734142',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5724561b-9fa6-4c59-811d-7991b8aa4ab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29d3d1094d1a4e54b2b04893ef15160e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:26:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:26:29Z,use_quota=True,user_id='be7b902951034b40ac55d0f4e5ec659e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:26:30 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-6b7d1582-2462-4c6a-a4a6-e2cd1e4def1b tempest-VolumesMetadataTest-1035870966 None] Creating volume 5724561b-9fa6-4c59-811d-7991b8aa4ab5 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:26:30 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-6b7d1582-2462-4c6a-a4a6-e2cd1e4def1b tempest-VolumesMetadataTest-1035870966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:30 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-6b7d1582-2462-4c6a-a4a6-e2cd1e4def1b tempest-VolumesMetadataTest-1035870966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:30 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-6b7d1582-2462-4c6a-a4a6-e2cd1e4def1b tempest-VolumesMetadataTest-1035870966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:26:30 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-6b7d1582-2462-4c6a-a4a6-e2cd1e4def1b tempest-VolumesMetadataTest-1035870966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:26:30 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-6b7d1582-2462-4c6a-a4a6-e2cd1e4def1b tempest-VolumesMetadataTest-1035870966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:30 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-6b7d1582-2462-4c6a-a4a6-e2cd1e4def1b tempest-VolumesMetadataTest-1035870966 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:26:30 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-6b7d1582-2462-4c6a-a4a6-e2cd1e4def1b tempest-VolumesMetadataTest-1035870966 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:26:30 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-6b7d1582-2462-4c6a-a4a6-e2cd1e4def1b tempest-VolumesMetadataTest-1035870966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5724561b-9fa6-4c59-811d-7991b8aa4ab5 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:30 devstack sudo[87895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5724561b-9fa6-4c59-811d-7991b8aa4ab5 1073741824
Feb 27 01:26:30 devstack sudo[87895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:30 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-f32a1e09-3c22-4023-95c1-40d397aa304c tempest-VolumesListTestJSON-1934545439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (211d459f-a57e-4113-a7f5-f38c9a4a21f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-383386a8-159f-4796-88c9-e90866709264', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:30 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-f32a1e09-3c22-4023-95c1-40d397aa304c tempest-VolumesListTestJSON-1934545439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad1df606-fe99-4c4a-a1e2-73200efc005e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:30 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-f32a1e09-3c22-4023-95c1-40d397aa304c tempest-VolumesListTestJSON-1934545439 None] Volume volume-383386a8-159f-4796-88c9-e90866709264 (383386a8-159f-4796-88c9-e90866709264): created successfully
Feb 27 01:26:30 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-f32a1e09-3c22-4023-95c1-40d397aa304c tempest-VolumesListTestJSON-1934545439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad1df606-fe99-4c4a-a1e2-73200efc005e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:30 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-f32a1e09-3c22-4023-95c1-40d397aa304c tempest-VolumesListTestJSON-1934545439 None] Flow 'volume_create_manager' (f569088d-3c34-4e51-bb2f-1b9a785c8268) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:26:30 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-f32a1e09-3c22-4023-95c1-40d397aa304c tempest-VolumesListTestJSON-1934545439 None] Created volume successfully.
Feb 27 01:26:30 devstack sudo[87892]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:30 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-600afa8a-8ffa-4106-b420-6ac94c245af6 tempest-VolumesTransfersV355Test-759829355 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e95c1c38-b434-41eb-9273-8ff2a358a577" returned: 0 in 0.681s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:30 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-600afa8a-8ffa-4106-b420-6ac94c245af6 tempest-VolumesTransfersV355Test-759829355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e95c1c38-b434-41eb-9273-8ff2a358a577 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:30 devstack sudo[87900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e95c1c38-b434-41eb-9273-8ff2a358a577
Feb 27 01:26:30 devstack sudo[87900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:30 devstack sudo[87895]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:30 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-6b7d1582-2462-4c6a-a4a6-e2cd1e4def1b tempest-VolumesMetadataTest-1035870966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5724561b-9fa6-4c59-811d-7991b8aa4ab5 1073741824" returned: 0 in 0.639s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:30 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-6b7d1582-2462-4c6a-a4a6-e2cd1e4def1b tempest-VolumesMetadataTest-1035870966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5724561b-9fa6-4c59-811d-7991b8aa4ab5 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:30 devstack sudo[87905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5724561b-9fa6-4c59-811d-7991b8aa4ab5
Feb 27 01:26:30 devstack sudo[87905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:31 devstack sudo[87900]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:31 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-600afa8a-8ffa-4106-b420-6ac94c245af6 tempest-VolumesTransfersV355Test-759829355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e95c1c38-b434-41eb-9273-8ff2a358a577" returned: 0 in 0.611s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:31 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-600afa8a-8ffa-4106-b420-6ac94c245af6 tempest-VolumesTransfersV355Test-759829355 None] Lock "cinder-quobyte-e95c1c38-b434-41eb-9273-8ff2a358a577" released by "delete_volume" :: held 1.328s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:31 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-600afa8a-8ffa-4106-b420-6ac94c245af6 tempest-VolumesTransfersV355Test-759829355 None] Created reservations ['77781ce7-b7c1-4d50-9352-7c8f53be3a34', '0ec72416-899f-486f-90e7-423ad936dee0', '1c9555ab-a8a4-46b1-aa8e-92ed5541c425', '2a710343-adb6-4d44-8ca2-c25cc155968f'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:26:31 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-600afa8a-8ffa-4106-b420-6ac94c245af6 tempest-VolumesTransfersV355Test-759829355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:31 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-600afa8a-8ffa-4106-b420-6ac94c245af6 tempest-VolumesTransfersV355Test-759829355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:31 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-600afa8a-8ffa-4106-b420-6ac94c245af6 tempest-VolumesTransfersV355Test-759829355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:26:31 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-600afa8a-8ffa-4106-b420-6ac94c245af6 tempest-VolumesTransfersV355Test-759829355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:26:31 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-600afa8a-8ffa-4106-b420-6ac94c245af6 tempest-VolumesTransfersV355Test-759829355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:31 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-600afa8a-8ffa-4106-b420-6ac94c245af6 tempest-VolumesTransfersV355Test-759829355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:31 devstack sudo[87909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:26:31 devstack sudo[87909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:31 devstack sudo[87905]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:31 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-6b7d1582-2462-4c6a-a4a6-e2cd1e4def1b tempest-VolumesMetadataTest-1035870966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5724561b-9fa6-4c59-811d-7991b8aa4ab5" returned: 0 in 0.505s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:31 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-6b7d1582-2462-4c6a-a4a6-e2cd1e4def1b tempest-VolumesMetadataTest-1035870966 None] <== create_volume: return (1197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:26:31 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-6b7d1582-2462-4c6a-a4a6-e2cd1e4def1b tempest-VolumesMetadataTest-1035870966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.202s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:31 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-6b7d1582-2462-4c6a-a4a6-e2cd1e4def1b tempest-VolumesMetadataTest-1035870966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc5d434c-2946-4c23-bd7d-80fc6f108c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5724561b-9fa6-4c59-811d-7991b8aa4ab5', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:31 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-6b7d1582-2462-4c6a-a4a6-e2cd1e4def1b tempest-VolumesMetadataTest-1035870966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0042d37f-837c-4fed-9b50-dc79b2d5575d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:31 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-6b7d1582-2462-4c6a-a4a6-e2cd1e4def1b tempest-VolumesMetadataTest-1035870966 None] Volume volume-5724561b-9fa6-4c59-811d-7991b8aa4ab5 (5724561b-9fa6-4c59-811d-7991b8aa4ab5): created successfully
Feb 27 01:26:31 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-6b7d1582-2462-4c6a-a4a6-e2cd1e4def1b tempest-VolumesMetadataTest-1035870966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0042d37f-837c-4fed-9b50-dc79b2d5575d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:31 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-6b7d1582-2462-4c6a-a4a6-e2cd1e4def1b tempest-VolumesMetadataTest-1035870966 None] Flow 'volume_create_manager' (3c847cc3-8989-46a7-86a5-7ccf6b79553a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:26:31 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-6b7d1582-2462-4c6a-a4a6-e2cd1e4def1b tempest-VolumesMetadataTest-1035870966 None] Created volume successfully.
Feb 27 01:26:31 devstack sudo[87909]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:31 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-600afa8a-8ffa-4106-b420-6ac94c245af6 tempest-VolumesTransfersV355Test-759829355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.518s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:31 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-600afa8a-8ffa-4106-b420-6ac94c245af6 tempest-VolumesTransfersV355Test-759829355 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:26:31 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-600afa8a-8ffa-4106-b420-6ac94c245af6 tempest-VolumesTransfersV355Test-759829355 None] Deleted volume successfully.
Feb 27 01:26:31 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-600afa8a-8ffa-4106-b420-6ac94c245af6 tempest-VolumesTransfersV355Test-759829355 None] Lock "cinder-e95c1c38-b434-41eb-9273-8ff2a358a577-delete_volume" released by "delete_volume" :: held 2.088s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:32 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-7ad075b7-43a1-4ab1-95d7-6a1358ac3876 tempest-VolumesMetadataTest-1035870966 None] Acquiring lock "cinder-5724561b-9fa6-4c59-811d-7991b8aa4ab5-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:32 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-7ad075b7-43a1-4ab1-95d7-6a1358ac3876 tempest-VolumesMetadataTest-1035870966 None] Lock "cinder-5724561b-9fa6-4c59-811d-7991b8aa4ab5-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:32 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-7ad075b7-43a1-4ab1-95d7-6a1358ac3876 tempest-VolumesMetadataTest-1035870966 None] Acquiring lock "cinder-quobyte-5724561b-9fa6-4c59-811d-7991b8aa4ab5" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:32 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-7ad075b7-43a1-4ab1-95d7-6a1358ac3876 tempest-VolumesMetadataTest-1035870966 None] Lock "cinder-quobyte-5724561b-9fa6-4c59-811d-7991b8aa4ab5" acquired by "delete_volume" :: waited 0.016s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:32 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5f21cd-adcb-4592-910f-3704c838127d]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:26:32 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7ad075b7-43a1-4ab1-95d7-6a1358ac3876 tempest-VolumesMetadataTest-1035870966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5724561b-9fa6-4c59-811d-7991b8aa4ab5 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:33 devstack sudo[87913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5724561b-9fa6-4c59-811d-7991b8aa4ab5
Feb 27 01:26:33 devstack sudo[87913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:33 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-a5d999d1-0019-4fac-99e9-812c7a991006 tempest-VolumesListTestJSON-1934545439 None] Acquiring lock "cinder-383386a8-159f-4796-88c9-e90866709264-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:33 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-a5d999d1-0019-4fac-99e9-812c7a991006 tempest-VolumesListTestJSON-1934545439 None] Lock "cinder-383386a8-159f-4796-88c9-e90866709264-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:33 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-a5d999d1-0019-4fac-99e9-812c7a991006 tempest-VolumesListTestJSON-1934545439 None] Acquiring lock "cinder-quobyte-383386a8-159f-4796-88c9-e90866709264" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:33 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-a5d999d1-0019-4fac-99e9-812c7a991006 tempest-VolumesListTestJSON-1934545439 None] Lock "cinder-quobyte-383386a8-159f-4796-88c9-e90866709264" acquired by "delete_volume" :: waited 0.012s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:33 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[23bfbcb4-9ba3-49cc-b489-53258afa8373]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:26:33 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a5d999d1-0019-4fac-99e9-812c7a991006 tempest-VolumesListTestJSON-1934545439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-383386a8-159f-4796-88c9-e90866709264 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:33 devstack sudo[87915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-383386a8-159f-4796-88c9-e90866709264
Feb 27 01:26:33 devstack sudo[87915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:33 devstack sudo[87913]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:33 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7ad075b7-43a1-4ab1-95d7-6a1358ac3876 tempest-VolumesMetadataTest-1035870966 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5724561b-9fa6-4c59-811d-7991b8aa4ab5" returned: 0 in 0.779s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:33 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7ad075b7-43a1-4ab1-95d7-6a1358ac3876 tempest-VolumesMetadataTest-1035870966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5724561b-9fa6-4c59-811d-7991b8aa4ab5 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:33 devstack sudo[87920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5724561b-9fa6-4c59-811d-7991b8aa4ab5
Feb 27 01:26:33 devstack sudo[87920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:34 devstack sudo[87915]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:34 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a5d999d1-0019-4fac-99e9-812c7a991006 tempest-VolumesListTestJSON-1934545439 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-383386a8-159f-4796-88c9-e90866709264" returned: 0 in 0.697s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:34 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a5d999d1-0019-4fac-99e9-812c7a991006 tempest-VolumesListTestJSON-1934545439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-383386a8-159f-4796-88c9-e90866709264 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:34 devstack sudo[87925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-383386a8-159f-4796-88c9-e90866709264
Feb 27 01:26:34 devstack sudo[87925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:34 devstack sudo[87920]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:34 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7ad075b7-43a1-4ab1-95d7-6a1358ac3876 tempest-VolumesMetadataTest-1035870966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5724561b-9fa6-4c59-811d-7991b8aa4ab5" returned: 0 in 0.571s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:34 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-7ad075b7-43a1-4ab1-95d7-6a1358ac3876 tempest-VolumesMetadataTest-1035870966 None] Lock "cinder-quobyte-5724561b-9fa6-4c59-811d-7991b8aa4ab5" released by "delete_volume" :: held 1.408s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:34 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-7ad075b7-43a1-4ab1-95d7-6a1358ac3876 tempest-VolumesMetadataTest-1035870966 None] Created reservations ['e31a2109-7918-4159-b103-7a0ac1e3de90', 'c8ccb0a5-1b25-4d6b-bde2-4a214fd3079e', '3d2c49be-885d-40d8-ad82-e14038f9a338', '0f4fa05b-f464-461c-ab0a-8486ed464531'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:26:34 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-7ad075b7-43a1-4ab1-95d7-6a1358ac3876 tempest-VolumesMetadataTest-1035870966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:34 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-7ad075b7-43a1-4ab1-95d7-6a1358ac3876 tempest-VolumesMetadataTest-1035870966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:34 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-7ad075b7-43a1-4ab1-95d7-6a1358ac3876 tempest-VolumesMetadataTest-1035870966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:26:34 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-7ad075b7-43a1-4ab1-95d7-6a1358ac3876 tempest-VolumesMetadataTest-1035870966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:26:34 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-7ad075b7-43a1-4ab1-95d7-6a1358ac3876 tempest-VolumesMetadataTest-1035870966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:34 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7ad075b7-43a1-4ab1-95d7-6a1358ac3876 tempest-VolumesMetadataTest-1035870966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:34 devstack sudo[87928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:26:34 devstack sudo[87928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:34 devstack sudo[87925]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:34 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a5d999d1-0019-4fac-99e9-812c7a991006 tempest-VolumesListTestJSON-1934545439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-383386a8-159f-4796-88c9-e90866709264" returned: 0 in 0.583s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:34 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-a5d999d1-0019-4fac-99e9-812c7a991006 tempest-VolumesListTestJSON-1934545439 None] Lock "cinder-quobyte-383386a8-159f-4796-88c9-e90866709264" released by "delete_volume" :: held 1.314s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:34 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-a5d999d1-0019-4fac-99e9-812c7a991006 tempest-VolumesListTestJSON-1934545439 None] Created reservations ['48334376-b9d7-46f1-956b-8eac9c5d32ae', '193195c9-0517-497c-9faa-ffb47afc5374', '869c1e01-4aa5-41d9-beb4-97988284e74a', 'f114a7d1-dee7-4a42-a16e-9b919e3f4eb1'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:26:34 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-a5d999d1-0019-4fac-99e9-812c7a991006 tempest-VolumesListTestJSON-1934545439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:34 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-a5d999d1-0019-4fac-99e9-812c7a991006 tempest-VolumesListTestJSON-1934545439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:34 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-a5d999d1-0019-4fac-99e9-812c7a991006 tempest-VolumesListTestJSON-1934545439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:26:34 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-a5d999d1-0019-4fac-99e9-812c7a991006 tempest-VolumesListTestJSON-1934545439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:26:34 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-a5d999d1-0019-4fac-99e9-812c7a991006 tempest-VolumesListTestJSON-1934545439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:34 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a5d999d1-0019-4fac-99e9-812c7a991006 tempest-VolumesListTestJSON-1934545439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:34 devstack sudo[87931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:26:34 devstack sudo[87931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:35 devstack sudo[87928]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:35 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7ad075b7-43a1-4ab1-95d7-6a1358ac3876 tempest-VolumesMetadataTest-1035870966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.610s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:35 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-7ad075b7-43a1-4ab1-95d7-6a1358ac3876 tempest-VolumesMetadataTest-1035870966 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:26:35 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-7ad075b7-43a1-4ab1-95d7-6a1358ac3876 tempest-VolumesMetadataTest-1035870966 None] Deleted volume successfully.
Feb 27 01:26:35 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-7ad075b7-43a1-4ab1-95d7-6a1358ac3876 tempest-VolumesMetadataTest-1035870966 None] Lock "cinder-5724561b-9fa6-4c59-811d-7991b8aa4ab5-delete_volume" released by "delete_volume" :: held 2.219s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:35 devstack sudo[87931]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:35 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a5d999d1-0019-4fac-99e9-812c7a991006 tempest-VolumesListTestJSON-1934545439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.605s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:35 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-a5d999d1-0019-4fac-99e9-812c7a991006 tempest-VolumesListTestJSON-1934545439 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:26:35 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-a5d999d1-0019-4fac-99e9-812c7a991006 tempest-VolumesListTestJSON-1934545439 None] Deleted volume successfully.
Feb 27 01:26:35 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-a5d999d1-0019-4fac-99e9-812c7a991006 tempest-VolumesListTestJSON-1934545439 None] Lock "cinder-383386a8-159f-4796-88c9-e90866709264-delete_volume" released by "delete_volume" :: held 2.162s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:35 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-c30fffc7-c268-49dd-9b86-9d817a3d7035 tempest-VolumesListTestJSON-1934545439 None] Acquiring lock "cinder-46465a05-65dd-4b06-8dfc-5a67488d5635-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:35 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-c30fffc7-c268-49dd-9b86-9d817a3d7035 tempest-VolumesListTestJSON-1934545439 None] Lock "cinder-46465a05-65dd-4b06-8dfc-5a67488d5635-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:35 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-c30fffc7-c268-49dd-9b86-9d817a3d7035 tempest-VolumesListTestJSON-1934545439 None] Acquiring lock "cinder-quobyte-46465a05-65dd-4b06-8dfc-5a67488d5635" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:35 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-c30fffc7-c268-49dd-9b86-9d817a3d7035 tempest-VolumesListTestJSON-1934545439 None] Lock "cinder-quobyte-46465a05-65dd-4b06-8dfc-5a67488d5635" acquired by "delete_volume" :: waited 0.016s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:35 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[26647782-132b-4c41-89cb-36dcf5660bd0]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:26:35 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c30fffc7-c268-49dd-9b86-9d817a3d7035 tempest-VolumesListTestJSON-1934545439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-46465a05-65dd-4b06-8dfc-5a67488d5635 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:35 devstack sudo[87937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-46465a05-65dd-4b06-8dfc-5a67488d5635
Feb 27 01:26:35 devstack sudo[87937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:36 devstack sudo[87937]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:36 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c30fffc7-c268-49dd-9b86-9d817a3d7035 tempest-VolumesListTestJSON-1934545439 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-46465a05-65dd-4b06-8dfc-5a67488d5635" returned: 0 in 0.717s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:36 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c30fffc7-c268-49dd-9b86-9d817a3d7035 tempest-VolumesListTestJSON-1934545439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-46465a05-65dd-4b06-8dfc-5a67488d5635 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:36 devstack sudo[87942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-46465a05-65dd-4b06-8dfc-5a67488d5635
Feb 27 01:26:36 devstack sudo[87942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:36 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-5365d868-d21b-4c77-a7ee-da29f3af54bb tempest-VolumesCloneNegativeTest-2044011280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:26:36 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-5365d868-d21b-4c77-a7ee-da29f3af54bb tempest-VolumesCloneNegativeTest-2044011280 None] Flow 'volume_create_manager' (b665a2c6-eb2c-4d96-9010-3541ff90aee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:26:36 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-5365d868-d21b-4c77-a7ee-da29f3af54bb tempest-VolumesCloneNegativeTest-2044011280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (463c33a8-7852-4576-9258-c2318a3f5b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:36 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-5365d868-d21b-4c77-a7ee-da29f3af54bb tempest-VolumesCloneNegativeTest-2044011280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (463c33a8-7852-4576-9258-c2318a3f5b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1052444334',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=885d6c16-d44a-4861-8a31-9fd3335c0cac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5743a2577ff4acf97717cbac9d98fd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:26:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:26:37Z,use_quota=True,user_id='1c384651784b4126b60bef2a5f322be1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:36 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-5365d868-d21b-4c77-a7ee-da29f3af54bb tempest-VolumesCloneNegativeTest-2044011280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5d36637-747d-4c55-b446-6510fdded5e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:36 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-5365d868-d21b-4c77-a7ee-da29f3af54bb tempest-VolumesCloneNegativeTest-2044011280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5d36637-747d-4c55-b446-6510fdded5e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:36 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-5365d868-d21b-4c77-a7ee-da29f3af54bb tempest-VolumesCloneNegativeTest-2044011280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ad7879a-2414-4bf4-a1e0-5bdbc67727e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:36 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-5365d868-d21b-4c77-a7ee-da29f3af54bb tempest-VolumesCloneNegativeTest-2044011280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ad7879a-2414-4bf4-a1e0-5bdbc67727e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '885d6c16-d44a-4861-8a31-9fd3335c0cac', 'volume_name': 'volume-885d6c16-d44a-4861-8a31-9fd3335c0cac', 'volume_size': 2}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:36 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-5365d868-d21b-4c77-a7ee-da29f3af54bb tempest-VolumesCloneNegativeTest-2044011280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e61aa118-ac22-4abe-a1bc-7dfa0a558669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:36 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-5365d868-d21b-4c77-a7ee-da29f3af54bb tempest-VolumesCloneNegativeTest-2044011280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e61aa118-ac22-4abe-a1bc-7dfa0a558669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:36 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-5365d868-d21b-4c77-a7ee-da29f3af54bb tempest-VolumesCloneNegativeTest-2044011280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3728805b-1708-45a4-a6be-c9d574ce864b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:36 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-5365d868-d21b-4c77-a7ee-da29f3af54bb tempest-VolumesCloneNegativeTest-2044011280 None] Volume 885d6c16-d44a-4861-8a31-9fd3335c0cac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-885d6c16-d44a-4861-8a31-9fd3335c0cac', 'volume_size': 2}
Feb 27 01:26:36 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-5365d868-d21b-4c77-a7ee-da29f3af54bb tempest-VolumesCloneNegativeTest-2044011280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:36 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-5365d868-d21b-4c77-a7ee-da29f3af54bb tempest-VolumesCloneNegativeTest-2044011280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:36 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-5365d868-d21b-4c77-a7ee-da29f3af54bb tempest-VolumesCloneNegativeTest-2044011280 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1052444334',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=885d6c16-d44a-4861-8a31-9fd3335c0cac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5743a2577ff4acf97717cbac9d98fd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:26:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:26:37Z,use_quota=True,user_id='1c384651784b4126b60bef2a5f322be1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:26:36 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-5365d868-d21b-4c77-a7ee-da29f3af54bb tempest-VolumesCloneNegativeTest-2044011280 None] Creating volume 885d6c16-d44a-4861-8a31-9fd3335c0cac {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:26:36 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-5365d868-d21b-4c77-a7ee-da29f3af54bb tempest-VolumesCloneNegativeTest-2044011280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:36 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-5365d868-d21b-4c77-a7ee-da29f3af54bb tempest-VolumesCloneNegativeTest-2044011280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:36 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-5365d868-d21b-4c77-a7ee-da29f3af54bb tempest-VolumesCloneNegativeTest-2044011280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:26:36 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-5365d868-d21b-4c77-a7ee-da29f3af54bb tempest-VolumesCloneNegativeTest-2044011280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:26:36 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-5365d868-d21b-4c77-a7ee-da29f3af54bb tempest-VolumesCloneNegativeTest-2044011280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:36 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-5365d868-d21b-4c77-a7ee-da29f3af54bb tempest-VolumesCloneNegativeTest-2044011280 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:26:36 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-5365d868-d21b-4c77-a7ee-da29f3af54bb tempest-VolumesCloneNegativeTest-2044011280 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:26:36 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5365d868-d21b-4c77-a7ee-da29f3af54bb tempest-VolumesCloneNegativeTest-2044011280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-885d6c16-d44a-4861-8a31-9fd3335c0cac 2147483648 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:37 devstack sudo[87944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-885d6c16-d44a-4861-8a31-9fd3335c0cac 2147483648
Feb 27 01:26:37 devstack sudo[87944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:37 devstack sudo[87942]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c30fffc7-c268-49dd-9b86-9d817a3d7035 tempest-VolumesListTestJSON-1934545439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-46465a05-65dd-4b06-8dfc-5a67488d5635" returned: 0 in 0.585s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:37 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-c30fffc7-c268-49dd-9b86-9d817a3d7035 tempest-VolumesListTestJSON-1934545439 None] Lock "cinder-quobyte-46465a05-65dd-4b06-8dfc-5a67488d5635" released by "delete_volume" :: held 1.333s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:37 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-c30fffc7-c268-49dd-9b86-9d817a3d7035 tempest-VolumesListTestJSON-1934545439 None] Created reservations ['4ece6211-acad-49c7-9463-ade5a028f011', 'f76c9ff0-6839-4cc1-8328-4f545f8cb1de', 'f9a648f5-9549-4464-abbb-a27334ea42cf', '7f4cb916-405c-481e-9169-a391231cb13c'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:26:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-c30fffc7-c268-49dd-9b86-9d817a3d7035 tempest-VolumesListTestJSON-1934545439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-c30fffc7-c268-49dd-9b86-9d817a3d7035 tempest-VolumesListTestJSON-1934545439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:37 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-c30fffc7-c268-49dd-9b86-9d817a3d7035 tempest-VolumesListTestJSON-1934545439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:26:37 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-c30fffc7-c268-49dd-9b86-9d817a3d7035 tempest-VolumesListTestJSON-1934545439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:26:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-c30fffc7-c268-49dd-9b86-9d817a3d7035 tempest-VolumesListTestJSON-1934545439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c30fffc7-c268-49dd-9b86-9d817a3d7035 tempest-VolumesListTestJSON-1934545439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:37 devstack sudo[87947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:26:37 devstack sudo[87947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:37 devstack sudo[87944]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5365d868-d21b-4c77-a7ee-da29f3af54bb tempest-VolumesCloneNegativeTest-2044011280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-885d6c16-d44a-4861-8a31-9fd3335c0cac 2147483648" returned: 0 in 0.624s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5365d868-d21b-4c77-a7ee-da29f3af54bb tempest-VolumesCloneNegativeTest-2044011280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-885d6c16-d44a-4861-8a31-9fd3335c0cac {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:37 devstack sudo[87952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-885d6c16-d44a-4861-8a31-9fd3335c0cac
Feb 27 01:26:37 devstack sudo[87952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:37 devstack sudo[87947]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c30fffc7-c268-49dd-9b86-9d817a3d7035 tempest-VolumesListTestJSON-1934545439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.461s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:37 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-c30fffc7-c268-49dd-9b86-9d817a3d7035 tempest-VolumesListTestJSON-1934545439 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:26:37 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-c30fffc7-c268-49dd-9b86-9d817a3d7035 tempest-VolumesListTestJSON-1934545439 None] Deleted volume successfully.
Feb 27 01:26:37 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-c30fffc7-c268-49dd-9b86-9d817a3d7035 tempest-VolumesListTestJSON-1934545439 None] Lock "cinder-46465a05-65dd-4b06-8dfc-5a67488d5635-delete_volume" released by "delete_volume" :: held 2.035s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:38 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-86edb944-0e10-4971-aa61-8e0669693e03 tempest-VolumesListTestJSON-1934545439 None] Acquiring lock "cinder-6ca7850f-4680-45fe-ad13-eaa7681bae29-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:38 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-86edb944-0e10-4971-aa61-8e0669693e03 tempest-VolumesListTestJSON-1934545439 None] Lock "cinder-6ca7850f-4680-45fe-ad13-eaa7681bae29-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:38 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-86edb944-0e10-4971-aa61-8e0669693e03 tempest-VolumesListTestJSON-1934545439 None] Acquiring lock "cinder-quobyte-6ca7850f-4680-45fe-ad13-eaa7681bae29" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:38 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-86edb944-0e10-4971-aa61-8e0669693e03 tempest-VolumesListTestJSON-1934545439 None] Lock "cinder-quobyte-6ca7850f-4680-45fe-ad13-eaa7681bae29" acquired by "delete_volume" :: waited 0.023s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:38 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[4044468d-b152-4fed-8ffb-900d721c1c3c]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:26:38 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-86edb944-0e10-4971-aa61-8e0669693e03 tempest-VolumesListTestJSON-1934545439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-6ca7850f-4680-45fe-ad13-eaa7681bae29 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:38 devstack sudo[87952]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:38 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5365d868-d21b-4c77-a7ee-da29f3af54bb tempest-VolumesCloneNegativeTest-2044011280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-885d6c16-d44a-4861-8a31-9fd3335c0cac" returned: 0 in 0.557s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:38 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-5365d868-d21b-4c77-a7ee-da29f3af54bb tempest-VolumesCloneNegativeTest-2044011280 None] <== create_volume: return (1213ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:26:38 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-5365d868-d21b-4c77-a7ee-da29f3af54bb tempest-VolumesCloneNegativeTest-2044011280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.224s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:38 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-5365d868-d21b-4c77-a7ee-da29f3af54bb tempest-VolumesCloneNegativeTest-2044011280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3728805b-1708-45a4-a6be-c9d574ce864b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-885d6c16-d44a-4861-8a31-9fd3335c0cac', 'volume_size': 2}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:38 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-5365d868-d21b-4c77-a7ee-da29f3af54bb tempest-VolumesCloneNegativeTest-2044011280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d081c302-25de-4c93-8eb1-d85b978c7ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:38 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-5365d868-d21b-4c77-a7ee-da29f3af54bb tempest-VolumesCloneNegativeTest-2044011280 None] Volume volume-885d6c16-d44a-4861-8a31-9fd3335c0cac (885d6c16-d44a-4861-8a31-9fd3335c0cac): created successfully
Feb 27 01:26:38 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-5365d868-d21b-4c77-a7ee-da29f3af54bb tempest-VolumesCloneNegativeTest-2044011280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d081c302-25de-4c93-8eb1-d85b978c7ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:38 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-5365d868-d21b-4c77-a7ee-da29f3af54bb tempest-VolumesCloneNegativeTest-2044011280 None] Flow 'volume_create_manager' (b665a2c6-eb2c-4d96-9010-3541ff90aee1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:26:38 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-5365d868-d21b-4c77-a7ee-da29f3af54bb tempest-VolumesCloneNegativeTest-2044011280 None] Created volume successfully.
Feb 27 01:26:38 devstack sudo[87956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-6ca7850f-4680-45fe-ad13-eaa7681bae29
Feb 27 01:26:38 devstack sudo[87956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:38 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-5eca190c-53a5-4679-b4d9-3d88524fac36 tempest-VolumesTransfersTest-1010555345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:26:38 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-5eca190c-53a5-4679-b4d9-3d88524fac36 tempest-VolumesTransfersTest-1010555345 None] Flow 'volume_create_manager' (3b9c227a-db9e-454f-a0af-958c004ee8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:26:38 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-5eca190c-53a5-4679-b4d9-3d88524fac36 tempest-VolumesTransfersTest-1010555345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ca0e42c-0bb6-45dd-89ba-864075df1d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:38 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-5eca190c-53a5-4679-b4d9-3d88524fac36 tempest-VolumesTransfersTest-1010555345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ca0e42c-0bb6-45dd-89ba-864075df1d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:26:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1376527927',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccb47a55-18d9-47bf-a86c-22632a543913,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='832a7f0862f14162ac13c2c19061a374',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:26:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:26:38Z,use_quota=True,user_id='454d35b8703a49f6878cdd82608ede0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:38 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-5eca190c-53a5-4679-b4d9-3d88524fac36 tempest-VolumesTransfersTest-1010555345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4e13019-07e0-4e01-8b31-310f267be96a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:38 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-5eca190c-53a5-4679-b4d9-3d88524fac36 tempest-VolumesTransfersTest-1010555345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4e13019-07e0-4e01-8b31-310f267be96a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:38 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-5eca190c-53a5-4679-b4d9-3d88524fac36 tempest-VolumesTransfersTest-1010555345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb110686-c809-469c-8494-2c58204a8d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:38 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-5eca190c-53a5-4679-b4d9-3d88524fac36 tempest-VolumesTransfersTest-1010555345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb110686-c809-469c-8494-2c58204a8d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccb47a55-18d9-47bf-a86c-22632a543913', 'volume_name': 'volume-ccb47a55-18d9-47bf-a86c-22632a543913', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:38 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-5eca190c-53a5-4679-b4d9-3d88524fac36 tempest-VolumesTransfersTest-1010555345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dab6c174-5615-497e-a06d-0620f88c3475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:38 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-5eca190c-53a5-4679-b4d9-3d88524fac36 tempest-VolumesTransfersTest-1010555345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dab6c174-5615-497e-a06d-0620f88c3475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:38 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-5eca190c-53a5-4679-b4d9-3d88524fac36 tempest-VolumesTransfersTest-1010555345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6be134fd-cd14-4d49-942c-553fa4708a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:38 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-5eca190c-53a5-4679-b4d9-3d88524fac36 tempest-VolumesTransfersTest-1010555345 None] Volume ccb47a55-18d9-47bf-a86c-22632a543913: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccb47a55-18d9-47bf-a86c-22632a543913', 'volume_size': 1}
Feb 27 01:26:38 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-5eca190c-53a5-4679-b4d9-3d88524fac36 tempest-VolumesTransfersTest-1010555345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:38 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-5eca190c-53a5-4679-b4d9-3d88524fac36 tempest-VolumesTransfersTest-1010555345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:38 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-5eca190c-53a5-4679-b4d9-3d88524fac36 tempest-VolumesTransfersTest-1010555345 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:26:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1376527927',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccb47a55-18d9-47bf-a86c-22632a543913,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='832a7f0862f14162ac13c2c19061a374',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:26:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:26:38Z,use_quota=True,user_id='454d35b8703a49f6878cdd82608ede0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:26:38 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-5eca190c-53a5-4679-b4d9-3d88524fac36 tempest-VolumesTransfersTest-1010555345 None] Creating volume ccb47a55-18d9-47bf-a86c-22632a543913 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:26:38 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-5eca190c-53a5-4679-b4d9-3d88524fac36 tempest-VolumesTransfersTest-1010555345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:38 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-5eca190c-53a5-4679-b4d9-3d88524fac36 tempest-VolumesTransfersTest-1010555345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:38 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-5eca190c-53a5-4679-b4d9-3d88524fac36 tempest-VolumesTransfersTest-1010555345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:26:38 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-5eca190c-53a5-4679-b4d9-3d88524fac36 tempest-VolumesTransfersTest-1010555345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:26:38 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-5eca190c-53a5-4679-b4d9-3d88524fac36 tempest-VolumesTransfersTest-1010555345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:38 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-5eca190c-53a5-4679-b4d9-3d88524fac36 tempest-VolumesTransfersTest-1010555345 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:26:38 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-5eca190c-53a5-4679-b4d9-3d88524fac36 tempest-VolumesTransfersTest-1010555345 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:26:38 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5eca190c-53a5-4679-b4d9-3d88524fac36 tempest-VolumesTransfersTest-1010555345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ccb47a55-18d9-47bf-a86c-22632a543913 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:38 devstack sudo[87958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ccb47a55-18d9-47bf-a86c-22632a543913 1073741824
Feb 27 01:26:38 devstack sudo[87958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:38 devstack sudo[87956]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:38 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-86edb944-0e10-4971-aa61-8e0669693e03 tempest-VolumesListTestJSON-1934545439 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-6ca7850f-4680-45fe-ad13-eaa7681bae29" returned: 0 in 0.515s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:38 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-86edb944-0e10-4971-aa61-8e0669693e03 tempest-VolumesListTestJSON-1934545439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-6ca7850f-4680-45fe-ad13-eaa7681bae29 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:38 devstack sudo[87963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-6ca7850f-4680-45fe-ad13-eaa7681bae29
Feb 27 01:26:38 devstack sudo[87963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:39 devstack sudo[87958]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5eca190c-53a5-4679-b4d9-3d88524fac36 tempest-VolumesTransfersTest-1010555345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ccb47a55-18d9-47bf-a86c-22632a543913 1073741824" returned: 0 in 0.580s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5eca190c-53a5-4679-b4d9-3d88524fac36 tempest-VolumesTransfersTest-1010555345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ccb47a55-18d9-47bf-a86c-22632a543913 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:39 devstack sudo[87963]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-86edb944-0e10-4971-aa61-8e0669693e03 tempest-VolumesListTestJSON-1934545439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-6ca7850f-4680-45fe-ad13-eaa7681bae29" returned: 0 in 0.504s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:39 devstack sudo[87969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ccb47a55-18d9-47bf-a86c-22632a543913
Feb 27 01:26:39 devstack sudo[87969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:39 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-86edb944-0e10-4971-aa61-8e0669693e03 tempest-VolumesListTestJSON-1934545439 None] Lock "cinder-quobyte-6ca7850f-4680-45fe-ad13-eaa7681bae29" released by "delete_volume" :: held 1.117s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:39 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-c856a3ce-26b3-4ab5-b5e4-5fb5438afb67 tempest-VolumesCloneNegativeTest-2044011280 None] Acquiring lock "cinder-885d6c16-d44a-4861-8a31-9fd3335c0cac-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:39 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-c856a3ce-26b3-4ab5-b5e4-5fb5438afb67 tempest-VolumesCloneNegativeTest-2044011280 None] Lock "cinder-885d6c16-d44a-4861-8a31-9fd3335c0cac-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:39 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-86edb944-0e10-4971-aa61-8e0669693e03 tempest-VolumesListTestJSON-1934545439 None] Created reservations ['d14e0c09-1a91-4569-bc99-5f32cdfbd67e', 'a97f06f2-9ed7-4fda-8adc-ed2eb17b71fe', '5f992ed7-72ee-49dc-9e92-3d9f3606266b', 'cb7f847a-9e52-47b2-b830-5585c4ebb502'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:26:39 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-c856a3ce-26b3-4ab5-b5e4-5fb5438afb67 tempest-VolumesCloneNegativeTest-2044011280 None] Acquiring lock "cinder-quobyte-885d6c16-d44a-4861-8a31-9fd3335c0cac" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:39 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-c856a3ce-26b3-4ab5-b5e4-5fb5438afb67 tempest-VolumesCloneNegativeTest-2044011280 None] Lock "cinder-quobyte-885d6c16-d44a-4861-8a31-9fd3335c0cac" acquired by "delete_volume" :: waited 0.034s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:39 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0611fb1-525e-4ef5-8196-8a60545db6c8]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:26:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c856a3ce-26b3-4ab5-b5e4-5fb5438afb67 tempest-VolumesCloneNegativeTest-2044011280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-885d6c16-d44a-4861-8a31-9fd3335c0cac {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-86edb944-0e10-4971-aa61-8e0669693e03 tempest-VolumesListTestJSON-1934545439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-86edb944-0e10-4971-aa61-8e0669693e03 tempest-VolumesListTestJSON-1934545439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:39 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-86edb944-0e10-4971-aa61-8e0669693e03 tempest-VolumesListTestJSON-1934545439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:26:39 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-86edb944-0e10-4971-aa61-8e0669693e03 tempest-VolumesListTestJSON-1934545439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:26:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-86edb944-0e10-4971-aa61-8e0669693e03 tempest-VolumesListTestJSON-1934545439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-86edb944-0e10-4971-aa61-8e0669693e03 tempest-VolumesListTestJSON-1934545439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:39 devstack sudo[87972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:26:39 devstack sudo[87972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:39 devstack sudo[87971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-885d6c16-d44a-4861-8a31-9fd3335c0cac
Feb 27 01:26:39 devstack sudo[87971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:39 devstack sudo[87969]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5eca190c-53a5-4679-b4d9-3d88524fac36 tempest-VolumesTransfersTest-1010555345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ccb47a55-18d9-47bf-a86c-22632a543913" returned: 0 in 0.573s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:39 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-5eca190c-53a5-4679-b4d9-3d88524fac36 tempest-VolumesTransfersTest-1010555345 None] <== create_volume: return (1198ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:26:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-5eca190c-53a5-4679-b4d9-3d88524fac36 tempest-VolumesTransfersTest-1010555345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.201s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:39 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-5eca190c-53a5-4679-b4d9-3d88524fac36 tempest-VolumesTransfersTest-1010555345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6be134fd-cd14-4d49-942c-553fa4708a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccb47a55-18d9-47bf-a86c-22632a543913', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:39 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-5eca190c-53a5-4679-b4d9-3d88524fac36 tempest-VolumesTransfersTest-1010555345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (561fe65b-916f-4bf0-b52d-7a4c9156d4be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:39 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-5eca190c-53a5-4679-b4d9-3d88524fac36 tempest-VolumesTransfersTest-1010555345 None] Volume volume-ccb47a55-18d9-47bf-a86c-22632a543913 (ccb47a55-18d9-47bf-a86c-22632a543913): created successfully
Feb 27 01:26:39 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-5eca190c-53a5-4679-b4d9-3d88524fac36 tempest-VolumesTransfersTest-1010555345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (561fe65b-916f-4bf0-b52d-7a4c9156d4be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:39 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-5eca190c-53a5-4679-b4d9-3d88524fac36 tempest-VolumesTransfersTest-1010555345 None] Flow 'volume_create_manager' (3b9c227a-db9e-454f-a0af-958c004ee8c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:26:39 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-5eca190c-53a5-4679-b4d9-3d88524fac36 tempest-VolumesTransfersTest-1010555345 None] Created volume successfully.
Feb 27 01:26:39 devstack sudo[87972]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-86edb944-0e10-4971-aa61-8e0669693e03 tempest-VolumesListTestJSON-1934545439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.508s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:40 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-86edb944-0e10-4971-aa61-8e0669693e03 tempest-VolumesListTestJSON-1934545439 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:26:40 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-86edb944-0e10-4971-aa61-8e0669693e03 tempest-VolumesListTestJSON-1934545439 None] Deleted volume successfully.
Feb 27 01:26:40 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-86edb944-0e10-4971-aa61-8e0669693e03 tempest-VolumesListTestJSON-1934545439 None] Lock "cinder-6ca7850f-4680-45fe-ad13-eaa7681bae29-delete_volume" released by "delete_volume" :: held 2.000s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:40 devstack sudo[87971]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:40 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c856a3ce-26b3-4ab5-b5e4-5fb5438afb67 tempest-VolumesCloneNegativeTest-2044011280 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-885d6c16-d44a-4861-8a31-9fd3335c0cac" returned: 0 in 0.598s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:40 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c856a3ce-26b3-4ab5-b5e4-5fb5438afb67 tempest-VolumesCloneNegativeTest-2044011280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-885d6c16-d44a-4861-8a31-9fd3335c0cac {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:40 devstack sudo[87980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-885d6c16-d44a-4861-8a31-9fd3335c0cac
Feb 27 01:26:40 devstack sudo[87980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:40 devstack sudo[87980]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:40 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c856a3ce-26b3-4ab5-b5e4-5fb5438afb67 tempest-VolumesCloneNegativeTest-2044011280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-885d6c16-d44a-4861-8a31-9fd3335c0cac" returned: 0 in 0.477s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:40 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-c856a3ce-26b3-4ab5-b5e4-5fb5438afb67 tempest-VolumesCloneNegativeTest-2044011280 None] Lock "cinder-quobyte-885d6c16-d44a-4861-8a31-9fd3335c0cac" released by "delete_volume" :: held 1.108s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:40 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-c856a3ce-26b3-4ab5-b5e4-5fb5438afb67 tempest-VolumesCloneNegativeTest-2044011280 None] Created reservations ['0f524bd4-a5d7-4ea1-bc29-411a9ed9607b', 'a9e4d8c6-8178-46f5-891d-980b3a7d286e', '979a5378-efa9-4d56-b588-15672ac7c8a6', 'a7cd8135-9e3f-45e1-9305-f928a76c757a'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:26:40 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-c856a3ce-26b3-4ab5-b5e4-5fb5438afb67 tempest-VolumesCloneNegativeTest-2044011280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:40 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-c856a3ce-26b3-4ab5-b5e4-5fb5438afb67 tempest-VolumesCloneNegativeTest-2044011280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:40 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-c856a3ce-26b3-4ab5-b5e4-5fb5438afb67 tempest-VolumesCloneNegativeTest-2044011280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:26:40 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-c856a3ce-26b3-4ab5-b5e4-5fb5438afb67 tempest-VolumesCloneNegativeTest-2044011280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:26:40 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-c856a3ce-26b3-4ab5-b5e4-5fb5438afb67 tempest-VolumesCloneNegativeTest-2044011280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:40 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c856a3ce-26b3-4ab5-b5e4-5fb5438afb67 tempest-VolumesCloneNegativeTest-2044011280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:40 devstack sudo[87983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:26:40 devstack sudo[87983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:41 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-6460a36e-121b-4f15-8670-4a174e83f3ae tempest-VolumesTransfersTest-1092821601 None] Transfer volume completed successfully.
Feb 27 01:26:41 devstack sudo[87983]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:41 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c856a3ce-26b3-4ab5-b5e4-5fb5438afb67 tempest-VolumesCloneNegativeTest-2044011280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.702s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:41 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-c856a3ce-26b3-4ab5-b5e4-5fb5438afb67 tempest-VolumesCloneNegativeTest-2044011280 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:26:41 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-c856a3ce-26b3-4ab5-b5e4-5fb5438afb67 tempest-VolumesCloneNegativeTest-2044011280 None] Deleted volume successfully.
Feb 27 01:26:41 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-c856a3ce-26b3-4ab5-b5e4-5fb5438afb67 tempest-VolumesCloneNegativeTest-2044011280 None] Lock "cinder-885d6c16-d44a-4861-8a31-9fd3335c0cac-delete_volume" released by "delete_volume" :: held 2.096s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:42 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-506a1e64-24e4-4873-a1be-9a8384be8bee tempest-VolumesTransfersTest-2092112231 None] Acquiring lock "cinder-ccb47a55-18d9-47bf-a86c-22632a543913-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:42 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-506a1e64-24e4-4873-a1be-9a8384be8bee tempest-VolumesTransfersTest-2092112231 None] Lock "cinder-ccb47a55-18d9-47bf-a86c-22632a543913-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:42 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-506a1e64-24e4-4873-a1be-9a8384be8bee tempest-VolumesTransfersTest-2092112231 None] Acquiring lock "cinder-quobyte-ccb47a55-18d9-47bf-a86c-22632a543913" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:42 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-506a1e64-24e4-4873-a1be-9a8384be8bee tempest-VolumesTransfersTest-2092112231 None] Lock "cinder-quobyte-ccb47a55-18d9-47bf-a86c-22632a543913" acquired by "delete_volume" :: waited 0.025s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:42 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[646e0a10-bb76-4378-ba4a-f11c663e088a]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:26:42 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-506a1e64-24e4-4873-a1be-9a8384be8bee tempest-VolumesTransfersTest-2092112231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ccb47a55-18d9-47bf-a86c-22632a543913 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:42 devstack sudo[87986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ccb47a55-18d9-47bf-a86c-22632a543913
Feb 27 01:26:42 devstack sudo[87986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:42 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cfabc35-31ab-4945-acbb-e91a1303e626 tempest-VolumesSnapshotListTestJSON-465864726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:26:43 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-4cfabc35-31ab-4945-acbb-e91a1303e626 tempest-VolumesSnapshotListTestJSON-465864726 None] Flow 'volume_create_manager' (a1a9bd64-6efc-4f8f-ae0a-07c7301242bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:26:43 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-4cfabc35-31ab-4945-acbb-e91a1303e626 tempest-VolumesSnapshotListTestJSON-465864726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0b404ae-d79c-4ff8-9844-22dd2fc8ada7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:43 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-4cfabc35-31ab-4945-acbb-e91a1303e626 tempest-VolumesSnapshotListTestJSON-465864726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0b404ae-d79c-4ff8-9844-22dd2fc8ada7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:26:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1221703451',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b01c7be6-aeb7-4079-8eb7-264dd1de1cb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3306dfcc39e44d2beb344dc04dbb132',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:26:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:26:43Z,use_quota=True,user_id='447344d4860943488ffa24c0fb6aad9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:43 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-4cfabc35-31ab-4945-acbb-e91a1303e626 tempest-VolumesSnapshotListTestJSON-465864726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7866605c-f94a-42c2-8651-ca3768d8ea25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:43 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-4cfabc35-31ab-4945-acbb-e91a1303e626 tempest-VolumesSnapshotListTestJSON-465864726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7866605c-f94a-42c2-8651-ca3768d8ea25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:43 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-4cfabc35-31ab-4945-acbb-e91a1303e626 tempest-VolumesSnapshotListTestJSON-465864726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17aab3df-6b37-4e31-91c1-9f83a6b07f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:43 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-4cfabc35-31ab-4945-acbb-e91a1303e626 tempest-VolumesSnapshotListTestJSON-465864726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17aab3df-6b37-4e31-91c1-9f83a6b07f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b01c7be6-aeb7-4079-8eb7-264dd1de1cb0', 'volume_name': 'volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:43 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-4cfabc35-31ab-4945-acbb-e91a1303e626 tempest-VolumesSnapshotListTestJSON-465864726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caf45486-96b8-4644-8e7a-0a344e53ce75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:43 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-4cfabc35-31ab-4945-acbb-e91a1303e626 tempest-VolumesSnapshotListTestJSON-465864726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caf45486-96b8-4644-8e7a-0a344e53ce75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:43 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-4cfabc35-31ab-4945-acbb-e91a1303e626 tempest-VolumesSnapshotListTestJSON-465864726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fecd6bbb-2501-49ef-9d20-037f1bfdb3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:43 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-4cfabc35-31ab-4945-acbb-e91a1303e626 tempest-VolumesSnapshotListTestJSON-465864726 None] Volume b01c7be6-aeb7-4079-8eb7-264dd1de1cb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0', 'volume_size': 1}
Feb 27 01:26:43 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-4cfabc35-31ab-4945-acbb-e91a1303e626 tempest-VolumesSnapshotListTestJSON-465864726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:43 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-4cfabc35-31ab-4945-acbb-e91a1303e626 tempest-VolumesSnapshotListTestJSON-465864726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:43 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-4cfabc35-31ab-4945-acbb-e91a1303e626 tempest-VolumesSnapshotListTestJSON-465864726 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:26:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1221703451',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b01c7be6-aeb7-4079-8eb7-264dd1de1cb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3306dfcc39e44d2beb344dc04dbb132',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:26:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:26:43Z,use_quota=True,user_id='447344d4860943488ffa24c0fb6aad9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:26:43 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-4cfabc35-31ab-4945-acbb-e91a1303e626 tempest-VolumesSnapshotListTestJSON-465864726 None] Creating volume b01c7be6-aeb7-4079-8eb7-264dd1de1cb0 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:26:43 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-4cfabc35-31ab-4945-acbb-e91a1303e626 tempest-VolumesSnapshotListTestJSON-465864726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:43 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-4cfabc35-31ab-4945-acbb-e91a1303e626 tempest-VolumesSnapshotListTestJSON-465864726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:43 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-4cfabc35-31ab-4945-acbb-e91a1303e626 tempest-VolumesSnapshotListTestJSON-465864726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:26:43 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-4cfabc35-31ab-4945-acbb-e91a1303e626 tempest-VolumesSnapshotListTestJSON-465864726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:26:43 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-4cfabc35-31ab-4945-acbb-e91a1303e626 tempest-VolumesSnapshotListTestJSON-465864726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:43 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-4cfabc35-31ab-4945-acbb-e91a1303e626 tempest-VolumesSnapshotListTestJSON-465864726 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:26:43 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-4cfabc35-31ab-4945-acbb-e91a1303e626 tempest-VolumesSnapshotListTestJSON-465864726 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:26:43 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-4cfabc35-31ab-4945-acbb-e91a1303e626 tempest-VolumesSnapshotListTestJSON-465864726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:43 devstack sudo[87995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0 1073741824
Feb 27 01:26:43 devstack sudo[87995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:43 devstack sudo[87986]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:43 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-506a1e64-24e4-4873-a1be-9a8384be8bee tempest-VolumesTransfersTest-2092112231 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ccb47a55-18d9-47bf-a86c-22632a543913" returned: 0 in 0.968s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:43 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-506a1e64-24e4-4873-a1be-9a8384be8bee tempest-VolumesTransfersTest-2092112231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ccb47a55-18d9-47bf-a86c-22632a543913 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:43 devstack sudo[88011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ccb47a55-18d9-47bf-a86c-22632a543913
Feb 27 01:26:43 devstack sudo[88011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:43 devstack sudo[87995]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:43 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-4cfabc35-31ab-4945-acbb-e91a1303e626 tempest-VolumesSnapshotListTestJSON-465864726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0 1073741824" returned: 0 in 0.665s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:43 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-4cfabc35-31ab-4945-acbb-e91a1303e626 tempest-VolumesSnapshotListTestJSON-465864726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:43 devstack sudo[88015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0
Feb 27 01:26:43 devstack sudo[88015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:44 devstack sudo[88011]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:44 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-506a1e64-24e4-4873-a1be-9a8384be8bee tempest-VolumesTransfersTest-2092112231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ccb47a55-18d9-47bf-a86c-22632a543913" returned: 0 in 0.577s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:44 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-506a1e64-24e4-4873-a1be-9a8384be8bee tempest-VolumesTransfersTest-2092112231 None] Lock "cinder-quobyte-ccb47a55-18d9-47bf-a86c-22632a543913" released by "delete_volume" :: held 1.586s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:44 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-506a1e64-24e4-4873-a1be-9a8384be8bee tempest-VolumesTransfersTest-2092112231 None] Created reservations ['472e63f0-a8e4-4557-91d8-b51f9a5361cc', '374b98f1-c4d4-4f87-8091-76de41d9ac80', 'f65338f0-70b8-456c-9a88-06e119bb5907', '9da1f8fb-82ac-43df-a242-450b3598bd5c'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:26:44 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-506a1e64-24e4-4873-a1be-9a8384be8bee tempest-VolumesTransfersTest-2092112231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:44 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-506a1e64-24e4-4873-a1be-9a8384be8bee tempest-VolumesTransfersTest-2092112231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:44 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-506a1e64-24e4-4873-a1be-9a8384be8bee tempest-VolumesTransfersTest-2092112231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:26:44 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-506a1e64-24e4-4873-a1be-9a8384be8bee tempest-VolumesTransfersTest-2092112231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:26:44 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-506a1e64-24e4-4873-a1be-9a8384be8bee tempest-VolumesTransfersTest-2092112231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:44 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-506a1e64-24e4-4873-a1be-9a8384be8bee tempest-VolumesTransfersTest-2092112231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:44 devstack sudo[88019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:26:44 devstack sudo[88019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:44 devstack sudo[88015]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:44 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-4cfabc35-31ab-4945-acbb-e91a1303e626 tempest-VolumesSnapshotListTestJSON-465864726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0" returned: 0 in 0.560s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:44 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-4cfabc35-31ab-4945-acbb-e91a1303e626 tempest-VolumesSnapshotListTestJSON-465864726 None] <== create_volume: return (1273ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:26:44 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-4cfabc35-31ab-4945-acbb-e91a1303e626 tempest-VolumesSnapshotListTestJSON-465864726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.276s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:44 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-4cfabc35-31ab-4945-acbb-e91a1303e626 tempest-VolumesSnapshotListTestJSON-465864726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fecd6bbb-2501-49ef-9d20-037f1bfdb3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:44 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-4cfabc35-31ab-4945-acbb-e91a1303e626 tempest-VolumesSnapshotListTestJSON-465864726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (886ca81e-7c7c-45c9-9c50-20cfaf261433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:44 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-4cfabc35-31ab-4945-acbb-e91a1303e626 tempest-VolumesSnapshotListTestJSON-465864726 None] Volume volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0 (b01c7be6-aeb7-4079-8eb7-264dd1de1cb0): created successfully
Feb 27 01:26:44 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-4cfabc35-31ab-4945-acbb-e91a1303e626 tempest-VolumesSnapshotListTestJSON-465864726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (886ca81e-7c7c-45c9-9c50-20cfaf261433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:44 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-4cfabc35-31ab-4945-acbb-e91a1303e626 tempest-VolumesSnapshotListTestJSON-465864726 None] Flow 'volume_create_manager' (a1a9bd64-6efc-4f8f-ae0a-07c7301242bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:26:44 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-4cfabc35-31ab-4945-acbb-e91a1303e626 tempest-VolumesSnapshotListTestJSON-465864726 None] Created volume successfully.
Feb 27 01:26:44 devstack sudo[88019]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:44 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-506a1e64-24e4-4873-a1be-9a8384be8bee tempest-VolumesTransfersTest-2092112231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.527s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:44 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-506a1e64-24e4-4873-a1be-9a8384be8bee tempest-VolumesTransfersTest-2092112231 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:26:44 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-506a1e64-24e4-4873-a1be-9a8384be8bee tempest-VolumesTransfersTest-2092112231 None] Deleted volume successfully.
Feb 27 01:26:44 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-506a1e64-24e4-4873-a1be-9a8384be8bee tempest-VolumesTransfersTest-2092112231 None] Lock "cinder-ccb47a55-18d9-47bf-a86c-22632a543913-delete_volume" released by "delete_volume" :: held 2.351s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:45 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-e989e65e-4b2f-46ab-a97b-e3206d026a38 tempest-VolumesTransfersTest-1010555345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:26:45 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-e989e65e-4b2f-46ab-a97b-e3206d026a38 tempest-VolumesTransfersTest-1010555345 None] Flow 'volume_create_manager' (645b83a5-2931-402d-bbbc-71223dfca9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:26:45 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-e989e65e-4b2f-46ab-a97b-e3206d026a38 tempest-VolumesTransfersTest-1010555345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d2650c6-17ac-4461-8e96-75a8b9b9e861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:45 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-e989e65e-4b2f-46ab-a97b-e3206d026a38 tempest-VolumesTransfersTest-1010555345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d2650c6-17ac-4461-8e96-75a8b9b9e861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:26:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-14193573',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b94f59b-57ee-4928-983a-6b69065c3e65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='832a7f0862f14162ac13c2c19061a374',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:26:45Z,use_quota=True,user_id='454d35b8703a49f6878cdd82608ede0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:45 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-e989e65e-4b2f-46ab-a97b-e3206d026a38 tempest-VolumesTransfersTest-1010555345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7efeecb6-2a2a-4f3e-bf3f-4f7a5159195b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:45 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-e989e65e-4b2f-46ab-a97b-e3206d026a38 tempest-VolumesTransfersTest-1010555345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7efeecb6-2a2a-4f3e-bf3f-4f7a5159195b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:45 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-e989e65e-4b2f-46ab-a97b-e3206d026a38 tempest-VolumesTransfersTest-1010555345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40e6a8d1-c6df-4aaf-a256-2e913fa6fab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:45 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-e989e65e-4b2f-46ab-a97b-e3206d026a38 tempest-VolumesTransfersTest-1010555345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40e6a8d1-c6df-4aaf-a256-2e913fa6fab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b94f59b-57ee-4928-983a-6b69065c3e65', 'volume_name': 'volume-1b94f59b-57ee-4928-983a-6b69065c3e65', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:45 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-e989e65e-4b2f-46ab-a97b-e3206d026a38 tempest-VolumesTransfersTest-1010555345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e87639a4-e585-4bb1-9545-8d4df2b35693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:45 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-e989e65e-4b2f-46ab-a97b-e3206d026a38 tempest-VolumesTransfersTest-1010555345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e87639a4-e585-4bb1-9545-8d4df2b35693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:45 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-e989e65e-4b2f-46ab-a97b-e3206d026a38 tempest-VolumesTransfersTest-1010555345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4bf0bad-f3d4-4a64-a4bf-e4baedb6f83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:45 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-e989e65e-4b2f-46ab-a97b-e3206d026a38 tempest-VolumesTransfersTest-1010555345 None] Volume 1b94f59b-57ee-4928-983a-6b69065c3e65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b94f59b-57ee-4928-983a-6b69065c3e65', 'volume_size': 1}
Feb 27 01:26:45 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-e989e65e-4b2f-46ab-a97b-e3206d026a38 tempest-VolumesTransfersTest-1010555345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:45 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-e989e65e-4b2f-46ab-a97b-e3206d026a38 tempest-VolumesTransfersTest-1010555345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:45 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-e989e65e-4b2f-46ab-a97b-e3206d026a38 tempest-VolumesTransfersTest-1010555345 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:26:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-14193573',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b94f59b-57ee-4928-983a-6b69065c3e65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='832a7f0862f14162ac13c2c19061a374',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:26:45Z,use_quota=True,user_id='454d35b8703a49f6878cdd82608ede0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:26:45 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-e989e65e-4b2f-46ab-a97b-e3206d026a38 tempest-VolumesTransfersTest-1010555345 None] Creating volume 1b94f59b-57ee-4928-983a-6b69065c3e65 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:26:45 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-e989e65e-4b2f-46ab-a97b-e3206d026a38 tempest-VolumesTransfersTest-1010555345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:45 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-e989e65e-4b2f-46ab-a97b-e3206d026a38 tempest-VolumesTransfersTest-1010555345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:45 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-e989e65e-4b2f-46ab-a97b-e3206d026a38 tempest-VolumesTransfersTest-1010555345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:26:45 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-e989e65e-4b2f-46ab-a97b-e3206d026a38 tempest-VolumesTransfersTest-1010555345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:26:45 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-e989e65e-4b2f-46ab-a97b-e3206d026a38 tempest-VolumesTransfersTest-1010555345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:45 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-e989e65e-4b2f-46ab-a97b-e3206d026a38 tempest-VolumesTransfersTest-1010555345 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:26:45 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-e989e65e-4b2f-46ab-a97b-e3206d026a38 tempest-VolumesTransfersTest-1010555345 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:26:45 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-e989e65e-4b2f-46ab-a97b-e3206d026a38 tempest-VolumesTransfersTest-1010555345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-1b94f59b-57ee-4928-983a-6b69065c3e65 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:45 devstack sudo[88022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-1b94f59b-57ee-4928-983a-6b69065c3e65 1073741824
Feb 27 01:26:45 devstack sudo[88022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:45 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-ee6c01bd-87f0-4650-bf71-b4c07519ae22 tempest-VolumesSnapshotListTestJSON-465864726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:45 devstack sudo[88022]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:45 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-e989e65e-4b2f-46ab-a97b-e3206d026a38 tempest-VolumesTransfersTest-1010555345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-1b94f59b-57ee-4928-983a-6b69065c3e65 1073741824" returned: 0 in 0.585s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:45 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-e989e65e-4b2f-46ab-a97b-e3206d026a38 tempest-VolumesTransfersTest-1010555345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-1b94f59b-57ee-4928-983a-6b69065c3e65 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:45 devstack sudo[88027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-1b94f59b-57ee-4928-983a-6b69065c3e65
Feb 27 01:26:45 devstack sudo[88027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:46 devstack sudo[88027]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:46 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-e989e65e-4b2f-46ab-a97b-e3206d026a38 tempest-VolumesTransfersTest-1010555345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-1b94f59b-57ee-4928-983a-6b69065c3e65" returned: 0 in 0.454s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:46 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-e989e65e-4b2f-46ab-a97b-e3206d026a38 tempest-VolumesTransfersTest-1010555345 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:26:46 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-e989e65e-4b2f-46ab-a97b-e3206d026a38 tempest-VolumesTransfersTest-1010555345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:46 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-ee6c01bd-87f0-4650-bf71-b4c07519ae22 tempest-VolumesSnapshotListTestJSON-465864726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.050s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:46 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-e989e65e-4b2f-46ab-a97b-e3206d026a38 tempest-VolumesTransfersTest-1010555345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4bf0bad-f3d4-4a64-a4bf-e4baedb6f83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b94f59b-57ee-4928-983a-6b69065c3e65', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:46 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-e989e65e-4b2f-46ab-a97b-e3206d026a38 tempest-VolumesTransfersTest-1010555345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41ea5d43-f7d9-4481-b73e-8c152297340b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:46 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-e989e65e-4b2f-46ab-a97b-e3206d026a38 tempest-VolumesTransfersTest-1010555345 None] Volume volume-1b94f59b-57ee-4928-983a-6b69065c3e65 (1b94f59b-57ee-4928-983a-6b69065c3e65): created successfully
Feb 27 01:26:46 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-e989e65e-4b2f-46ab-a97b-e3206d026a38 tempest-VolumesTransfersTest-1010555345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41ea5d43-f7d9-4481-b73e-8c152297340b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:46 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-e989e65e-4b2f-46ab-a97b-e3206d026a38 tempest-VolumesTransfersTest-1010555345 None] Flow 'volume_create_manager' (645b83a5-2931-402d-bbbc-71223dfca9a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:26:46 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-ee6c01bd-87f0-4650-bf71-b4c07519ae22 tempest-VolumesSnapshotListTestJSON-465864726 None] Creating offline snapshot 20dcb289-7197-41d8-974d-0a6728e736a1 of volume b01c7be6-aeb7-4079-8eb7-264dd1de1cb0 {{(pid=83106) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:26:46 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-e989e65e-4b2f-46ab-a97b-e3206d026a38 tempest-VolumesTransfersTest-1010555345 None] Created volume successfully.
Feb 27 01:26:46 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9cc33cd-810c-49a7-be38-710f7533e56b]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:26:46 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ee6c01bd-87f0-4650-bf71-b4c07519ae22 tempest-VolumesSnapshotListTestJSON-465864726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:46 devstack sudo[88030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0
Feb 27 01:26:46 devstack sudo[88030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:47 devstack sudo[88030]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:47 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ee6c01bd-87f0-4650-bf71-b4c07519ae22 tempest-VolumesSnapshotListTestJSON-465864726 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0" returned: 0 in 0.538s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:47 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ee6c01bd-87f0-4650-bf71-b4c07519ae22 tempest-VolumesSnapshotListTestJSON-465864726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.20dcb289-7197-41d8-974d-0a6728e736a1 1G {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:47 devstack sudo[88035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.20dcb289-7197-41d8-974d-0a6728e736a1 1G
Feb 27 01:26:47 devstack sudo[88035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:47 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-45e5663d-d517-42f2-b5d0-2a133b083ea4 tempest-VolumesTransfersTest-2092112231 None] Acquiring lock "cinder-1b94f59b-57ee-4928-983a-6b69065c3e65-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:47 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-45e5663d-d517-42f2-b5d0-2a133b083ea4 tempest-VolumesTransfersTest-2092112231 None] Lock "cinder-1b94f59b-57ee-4928-983a-6b69065c3e65-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:47 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-45e5663d-d517-42f2-b5d0-2a133b083ea4 tempest-VolumesTransfersTest-2092112231 None] Acquiring lock "cinder-quobyte-1b94f59b-57ee-4928-983a-6b69065c3e65" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:47 devstack sudo[88035]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:47 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ee6c01bd-87f0-4650-bf71-b4c07519ae22 tempest-VolumesSnapshotListTestJSON-465864726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.20dcb289-7197-41d8-974d-0a6728e736a1 1G" returned: 0 in 0.561s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:47 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ee6c01bd-87f0-4650-bf71-b4c07519ae22 tempest-VolumesSnapshotListTestJSON-465864726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.20dcb289-7197-41d8-974d-0a6728e736a1 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:47 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-45e5663d-d517-42f2-b5d0-2a133b083ea4 tempest-VolumesTransfersTest-2092112231 None] Lock "cinder-quobyte-1b94f59b-57ee-4928-983a-6b69065c3e65" acquired by "delete_volume" :: waited 0.020s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:47 devstack sudo[88043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.20dcb289-7197-41d8-974d-0a6728e736a1
Feb 27 01:26:47 devstack sudo[88043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:47 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1fe5037-81a5-438e-86bc-2b6ecb890596]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:26:47 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-45e5663d-d517-42f2-b5d0-2a133b083ea4 tempest-VolumesTransfersTest-2092112231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-1b94f59b-57ee-4928-983a-6b69065c3e65 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:47 devstack sudo[88045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-1b94f59b-57ee-4928-983a-6b69065c3e65
Feb 27 01:26:47 devstack sudo[88045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:48 devstack sudo[88043]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:48 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ee6c01bd-87f0-4650-bf71-b4c07519ae22 tempest-VolumesSnapshotListTestJSON-465864726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.20dcb289-7197-41d8-974d-0a6728e736a1" returned: 0 in 0.640s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:48 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-ee6c01bd-87f0-4650-bf71-b4c07519ae22 tempest-VolumesSnapshotListTestJSON-465864726 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.20dcb289-7197-41d8-974d-0a6728e736a1 is being set with open permissions: ugo+rw
Feb 27 01:26:48 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ee6c01bd-87f0-4650-bf71-b4c07519ae22 tempest-VolumesSnapshotListTestJSON-465864726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.20dcb289-7197-41d8-974d-0a6728e736a1 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:48 devstack sudo[88053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.20dcb289-7197-41d8-974d-0a6728e736a1
Feb 27 01:26:48 devstack sudo[88053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:48 devstack sudo[88045]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:48 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-45e5663d-d517-42f2-b5d0-2a133b083ea4 tempest-VolumesTransfersTest-2092112231 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-1b94f59b-57ee-4928-983a-6b69065c3e65" returned: 0 in 0.657s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:48 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-45e5663d-d517-42f2-b5d0-2a133b083ea4 tempest-VolumesTransfersTest-2092112231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-1b94f59b-57ee-4928-983a-6b69065c3e65 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:48 devstack sudo[88055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-1b94f59b-57ee-4928-983a-6b69065c3e65
Feb 27 01:26:48 devstack sudo[88055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:48 devstack sudo[88053]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:48 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ee6c01bd-87f0-4650-bf71-b4c07519ae22 tempest-VolumesSnapshotListTestJSON-465864726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.20dcb289-7197-41d8-974d-0a6728e736a1" returned: 0 in 0.597s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:48 devstack sudo[88055]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:48 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-45e5663d-d517-42f2-b5d0-2a133b083ea4 tempest-VolumesTransfersTest-2092112231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-1b94f59b-57ee-4928-983a-6b69065c3e65" returned: 0 in 0.585s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:48 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ee6c01bd-87f0-4650-bf71-b4c07519ae22 tempest-VolumesSnapshotListTestJSON-465864726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.info {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:48 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-45e5663d-d517-42f2-b5d0-2a133b083ea4 tempest-VolumesTransfersTest-2092112231 None] Lock "cinder-quobyte-1b94f59b-57ee-4928-983a-6b69065c3e65" released by "delete_volume" :: held 1.292s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:48 devstack sudo[88084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.info
Feb 27 01:26:48 devstack sudo[88084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:48 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-45e5663d-d517-42f2-b5d0-2a133b083ea4 tempest-VolumesTransfersTest-2092112231 None] Created reservations ['78b4ad60-bca4-4f98-85b5-6410e07bd4e7', '05c743f5-05f4-4831-9b36-ad28a5ab84c3', 'ef5aee91-1735-4355-aff2-15b95e44131e', 'c627be25-88a2-416a-ac71-953f586f3e1e'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:26:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-45e5663d-d517-42f2-b5d0-2a133b083ea4 tempest-VolumesTransfersTest-2092112231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-45e5663d-d517-42f2-b5d0-2a133b083ea4 tempest-VolumesTransfersTest-2092112231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:49 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-45e5663d-d517-42f2-b5d0-2a133b083ea4 tempest-VolumesTransfersTest-2092112231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:26:49 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-45e5663d-d517-42f2-b5d0-2a133b083ea4 tempest-VolumesTransfersTest-2092112231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:26:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-45e5663d-d517-42f2-b5d0-2a133b083ea4 tempest-VolumesTransfersTest-2092112231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-45e5663d-d517-42f2-b5d0-2a133b083ea4 tempest-VolumesTransfersTest-2092112231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:49 devstack sudo[88086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:26:49 devstack sudo[88086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:49 devstack sudo[88084]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ee6c01bd-87f0-4650-bf71-b4c07519ae22 tempest-VolumesSnapshotListTestJSON-465864726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.info" returned: 0 in 0.675s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:49 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-ee6c01bd-87f0-4650-bf71-b4c07519ae22 tempest-VolumesSnapshotListTestJSON-465864726 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.info is being set with open permissions: ugo+rw
Feb 27 01:26:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ee6c01bd-87f0-4650-bf71-b4c07519ae22 tempest-VolumesSnapshotListTestJSON-465864726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.info {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:49 devstack sudo[88089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.info
Feb 27 01:26:49 devstack sudo[88089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:49 devstack sudo[88086]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-45e5663d-d517-42f2-b5d0-2a133b083ea4 tempest-VolumesTransfersTest-2092112231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.669s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:49 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-45e5663d-d517-42f2-b5d0-2a133b083ea4 tempest-VolumesTransfersTest-2092112231 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:26:49 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-45e5663d-d517-42f2-b5d0-2a133b083ea4 tempest-VolumesTransfersTest-2092112231 None] Deleted volume successfully.
Feb 27 01:26:49 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-45e5663d-d517-42f2-b5d0-2a133b083ea4 tempest-VolumesTransfersTest-2092112231 None] Lock "cinder-1b94f59b-57ee-4928-983a-6b69065c3e65-delete_volume" released by "delete_volume" :: held 2.229s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:50 devstack sudo[88089]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:50 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ee6c01bd-87f0-4650-bf71-b4c07519ae22 tempest-VolumesSnapshotListTestJSON-465864726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.info" returned: 0 in 0.551s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:50 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-ee6c01bd-87f0-4650-bf71-b4c07519ae22 tempest-VolumesSnapshotListTestJSON-465864726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.726s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:50 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-ee6c01bd-87f0-4650-bf71-b4c07519ae22 tempest-VolumesSnapshotListTestJSON-465864726 None] Create snapshot completed successfully
Feb 27 01:26:50 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-b3e5be10-231f-4187-9d08-f0fd6bdf3a99 tempest-VolumesSnapshotListTestJSON-465864726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:50 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-b3e5be10-231f-4187-9d08-f0fd6bdf3a99 tempest-VolumesSnapshotListTestJSON-465864726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:50 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-b3e5be10-231f-4187-9d08-f0fd6bdf3a99 tempest-VolumesSnapshotListTestJSON-465864726 None] Creating offline snapshot e3804de5-d40c-4b50-9478-fce5e01e78ef of volume b01c7be6-aeb7-4079-8eb7-264dd1de1cb0 {{(pid=83106) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:26:50 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f74c47-7e85-4575-8555-ebcf94433f91]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:26:50 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b3e5be10-231f-4187-9d08-f0fd6bdf3a99 tempest-VolumesSnapshotListTestJSON-465864726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.20dcb289-7197-41d8-974d-0a6728e736a1 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:51 devstack sudo[88094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.20dcb289-7197-41d8-974d-0a6728e736a1
Feb 27 01:26:51 devstack sudo[88094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:51 devstack sudo[88094]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:51 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b3e5be10-231f-4187-9d08-f0fd6bdf3a99 tempest-VolumesSnapshotListTestJSON-465864726 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.20dcb289-7197-41d8-974d-0a6728e736a1" returned: 0 in 0.927s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:51 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-b3e5be10-231f-4187-9d08-f0fd6bdf3a99 tempest-VolumesSnapshotListTestJSON-465864726 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83106) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:26:51 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b3e5be10-231f-4187-9d08-f0fd6bdf3a99 tempest-VolumesSnapshotListTestJSON-465864726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.20dcb289-7197-41d8-974d-0a6728e736a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.e3804de5-d40c-4b50-9478-fce5e01e78ef 1G {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:51 devstack sudo[88100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.20dcb289-7197-41d8-974d-0a6728e736a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.e3804de5-d40c-4b50-9478-fce5e01e78ef 1G
Feb 27 01:26:51 devstack sudo[88100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:52 devstack sudo[88100]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:52 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b3e5be10-231f-4187-9d08-f0fd6bdf3a99 tempest-VolumesSnapshotListTestJSON-465864726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.20dcb289-7197-41d8-974d-0a6728e736a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.e3804de5-d40c-4b50-9478-fce5e01e78ef 1G" returned: 0 in 0.880s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:52 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b3e5be10-231f-4187-9d08-f0fd6bdf3a99 tempest-VolumesSnapshotListTestJSON-465864726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.20dcb289-7197-41d8-974d-0a6728e736a1 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.e3804de5-d40c-4b50-9478-fce5e01e78ef {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:52 devstack sudo[88105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.20dcb289-7197-41d8-974d-0a6728e736a1 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.e3804de5-d40c-4b50-9478-fce5e01e78ef
Feb 27 01:26:52 devstack sudo[88105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:52 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0b40b7b-adf3-44ca-883e-f041418b9348 tempest-VolumesSnapshotTestJSON-708792780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:26:52 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a0b40b7b-adf3-44ca-883e-f041418b9348 tempest-VolumesSnapshotTestJSON-708792780 None] Flow 'volume_create_manager' (2ccd4331-8a92-4661-af8d-708ab293db5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:26:52 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a0b40b7b-adf3-44ca-883e-f041418b9348 tempest-VolumesSnapshotTestJSON-708792780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91ffccda-dda6-451e-9854-b397deb6aa86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:52 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a0b40b7b-adf3-44ca-883e-f041418b9348 tempest-VolumesSnapshotTestJSON-708792780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91ffccda-dda6-451e-9854-b397deb6aa86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:26:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1963971963',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8077be60-e7c3-434b-876e-93ce60b85df5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fba5f3accb0d428597d9c1a212708a1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:26:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:26:53Z,use_quota=True,user_id='4b8cb8c9a1344b09921d38d6e27d2878',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:52 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a0b40b7b-adf3-44ca-883e-f041418b9348 tempest-VolumesSnapshotTestJSON-708792780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4024905a-1c4a-406e-9ec4-b91f526ad7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:52 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a0b40b7b-adf3-44ca-883e-f041418b9348 tempest-VolumesSnapshotTestJSON-708792780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4024905a-1c4a-406e-9ec4-b91f526ad7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:52 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a0b40b7b-adf3-44ca-883e-f041418b9348 tempest-VolumesSnapshotTestJSON-708792780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d38b8bcc-8110-44c9-979b-d33964b1cdc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:52 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a0b40b7b-adf3-44ca-883e-f041418b9348 tempest-VolumesSnapshotTestJSON-708792780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d38b8bcc-8110-44c9-979b-d33964b1cdc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8077be60-e7c3-434b-876e-93ce60b85df5', 'volume_name': 'volume-8077be60-e7c3-434b-876e-93ce60b85df5', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:52 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a0b40b7b-adf3-44ca-883e-f041418b9348 tempest-VolumesSnapshotTestJSON-708792780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08f6e753-e60f-4199-aa49-9711f88eb1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:52 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a0b40b7b-adf3-44ca-883e-f041418b9348 tempest-VolumesSnapshotTestJSON-708792780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08f6e753-e60f-4199-aa49-9711f88eb1f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:52 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a0b40b7b-adf3-44ca-883e-f041418b9348 tempest-VolumesSnapshotTestJSON-708792780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8df175b1-2c30-441a-9aa4-bab588ea70a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:52 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-a0b40b7b-adf3-44ca-883e-f041418b9348 tempest-VolumesSnapshotTestJSON-708792780 None] Volume 8077be60-e7c3-434b-876e-93ce60b85df5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8077be60-e7c3-434b-876e-93ce60b85df5', 'volume_size': 1}
Feb 27 01:26:52 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-a0b40b7b-adf3-44ca-883e-f041418b9348 tempest-VolumesSnapshotTestJSON-708792780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:53 devstack sudo[88105]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:53 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b3e5be10-231f-4187-9d08-f0fd6bdf3a99 tempest-VolumesSnapshotListTestJSON-465864726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.20dcb289-7197-41d8-974d-0a6728e736a1 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.e3804de5-d40c-4b50-9478-fce5e01e78ef" returned: 0 in 0.613s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:53 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-b3e5be10-231f-4187-9d08-f0fd6bdf3a99 tempest-VolumesSnapshotListTestJSON-465864726 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.e3804de5-d40c-4b50-9478-fce5e01e78ef is being set with open permissions: ugo+rw
Feb 27 01:26:53 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b3e5be10-231f-4187-9d08-f0fd6bdf3a99 tempest-VolumesSnapshotListTestJSON-465864726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.e3804de5-d40c-4b50-9478-fce5e01e78ef {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:53 devstack sudo[88111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.e3804de5-d40c-4b50-9478-fce5e01e78ef
Feb 27 01:26:53 devstack sudo[88111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:53 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d6d794d-ef13-42aa-96b2-0f3af91938b2 tempest-VolumesActionsTest-1945194074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:26:53 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-9d6d794d-ef13-42aa-96b2-0f3af91938b2 tempest-VolumesActionsTest-1945194074 None] Flow 'volume_create_manager' (a4b51ddb-f208-4e48-a457-86c144921a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:26:53 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-9d6d794d-ef13-42aa-96b2-0f3af91938b2 tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a07f186b-d373-4d8f-94cb-f400374c6bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:53 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-9d6d794d-ef13-42aa-96b2-0f3af91938b2 tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a07f186b-d373-4d8f-94cb-f400374c6bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:26:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1117926960',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fde7485e-0655-4911-90dc-23bf86b3d2bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be9dc0daf3794a089ad1aff6cd82e870',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:26:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:26:54Z,use_quota=True,user_id='c3f639f013f94fea9ca5469ad886c89b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:53 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-9d6d794d-ef13-42aa-96b2-0f3af91938b2 tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feec81fb-6c08-4bc0-b964-d6ac7df78c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:53 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-9d6d794d-ef13-42aa-96b2-0f3af91938b2 tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feec81fb-6c08-4bc0-b964-d6ac7df78c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:53 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-9d6d794d-ef13-42aa-96b2-0f3af91938b2 tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8adc992-a949-4ca8-a53c-d7b86af78a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:53 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-9d6d794d-ef13-42aa-96b2-0f3af91938b2 tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8adc992-a949-4ca8-a53c-d7b86af78a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fde7485e-0655-4911-90dc-23bf86b3d2bb', 'volume_name': 'volume-fde7485e-0655-4911-90dc-23bf86b3d2bb', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:53 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-9d6d794d-ef13-42aa-96b2-0f3af91938b2 tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f35e855d-ac92-4654-97ca-4bcb5ba9fb93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:53 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-9d6d794d-ef13-42aa-96b2-0f3af91938b2 tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f35e855d-ac92-4654-97ca-4bcb5ba9fb93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:53 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-9d6d794d-ef13-42aa-96b2-0f3af91938b2 tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d12bc282-e0d0-4e36-85fd-13ea92027ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:53 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-9d6d794d-ef13-42aa-96b2-0f3af91938b2 tempest-VolumesActionsTest-1945194074 None] Volume fde7485e-0655-4911-90dc-23bf86b3d2bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fde7485e-0655-4911-90dc-23bf86b3d2bb', 'volume_size': 1}
Feb 27 01:26:53 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-9d6d794d-ef13-42aa-96b2-0f3af91938b2 tempest-VolumesActionsTest-1945194074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:53 devstack sudo[88111]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:53 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b3e5be10-231f-4187-9d08-f0fd6bdf3a99 tempest-VolumesSnapshotListTestJSON-465864726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.e3804de5-d40c-4b50-9478-fce5e01e78ef" returned: 0 in 0.695s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:54 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-b3e5be10-231f-4187-9d08-f0fd6bdf3a99 tempest-VolumesSnapshotListTestJSON-465864726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.242s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:54 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-a0b40b7b-adf3-44ca-883e-f041418b9348 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.034s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:54 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-a0b40b7b-adf3-44ca-883e-f041418b9348 tempest-VolumesSnapshotTestJSON-708792780 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:26:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1963971963',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8077be60-e7c3-434b-876e-93ce60b85df5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fba5f3accb0d428597d9c1a212708a1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:26:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:26:53Z,use_quota=True,user_id='4b8cb8c9a1344b09921d38d6e27d2878',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:26:54 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-a0b40b7b-adf3-44ca-883e-f041418b9348 tempest-VolumesSnapshotTestJSON-708792780 None] Creating volume 8077be60-e7c3-434b-876e-93ce60b85df5 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:26:54 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-a0b40b7b-adf3-44ca-883e-f041418b9348 tempest-VolumesSnapshotTestJSON-708792780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:54 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-a0b40b7b-adf3-44ca-883e-f041418b9348 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:54 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-a0b40b7b-adf3-44ca-883e-f041418b9348 tempest-VolumesSnapshotTestJSON-708792780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:26:54 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-a0b40b7b-adf3-44ca-883e-f041418b9348 tempest-VolumesSnapshotTestJSON-708792780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:26:54 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-a0b40b7b-adf3-44ca-883e-f041418b9348 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:54 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-a0b40b7b-adf3-44ca-883e-f041418b9348 tempest-VolumesSnapshotTestJSON-708792780 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:26:54 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-a0b40b7b-adf3-44ca-883e-f041418b9348 tempest-VolumesSnapshotTestJSON-708792780 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:26:54 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a0b40b7b-adf3-44ca-883e-f041418b9348 tempest-VolumesSnapshotTestJSON-708792780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8077be60-e7c3-434b-876e-93ce60b85df5 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:54 devstack sudo[88114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8077be60-e7c3-434b-876e-93ce60b85df5 1073741824
Feb 27 01:26:54 devstack sudo[88114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:54 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-b3e5be10-231f-4187-9d08-f0fd6bdf3a99 tempest-VolumesSnapshotListTestJSON-465864726 None] Create snapshot completed successfully
Feb 27 01:26:54 devstack sudo[88114]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:54 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a0b40b7b-adf3-44ca-883e-f041418b9348 tempest-VolumesSnapshotTestJSON-708792780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8077be60-e7c3-434b-876e-93ce60b85df5 1073741824" returned: 0 in 0.579s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:54 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a0b40b7b-adf3-44ca-883e-f041418b9348 tempest-VolumesSnapshotTestJSON-708792780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8077be60-e7c3-434b-876e-93ce60b85df5 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:54 devstack sudo[88119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8077be60-e7c3-434b-876e-93ce60b85df5
Feb 27 01:26:54 devstack sudo[88119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-9d7fc8b6-2eb5-45da-ac88-9edd3c75d985 tempest-VolumesSnapshotListTestJSON-465864726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:55 devstack sudo[88119]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a0b40b7b-adf3-44ca-883e-f041418b9348 tempest-VolumesSnapshotTestJSON-708792780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8077be60-e7c3-434b-876e-93ce60b85df5" returned: 0 in 0.656s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:55 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-a0b40b7b-adf3-44ca-883e-f041418b9348 tempest-VolumesSnapshotTestJSON-708792780 None] <== create_volume: return (1263ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:26:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-a0b40b7b-adf3-44ca-883e-f041418b9348 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.266s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-9d6d794d-ef13-42aa-96b2-0f3af91938b2 tempest-VolumesActionsTest-1945194074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.415s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:55 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-9d6d794d-ef13-42aa-96b2-0f3af91938b2 tempest-VolumesActionsTest-1945194074 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:26:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1117926960',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fde7485e-0655-4911-90dc-23bf86b3d2bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be9dc0daf3794a089ad1aff6cd82e870',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:26:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:26:54Z,use_quota=True,user_id='c3f639f013f94fea9ca5469ad886c89b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:26:55 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-9d6d794d-ef13-42aa-96b2-0f3af91938b2 tempest-VolumesActionsTest-1945194074 None] Creating volume fde7485e-0655-4911-90dc-23bf86b3d2bb {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:26:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-9d6d794d-ef13-42aa-96b2-0f3af91938b2 tempest-VolumesActionsTest-1945194074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-9d6d794d-ef13-42aa-96b2-0f3af91938b2 tempest-VolumesActionsTest-1945194074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:55 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-9d6d794d-ef13-42aa-96b2-0f3af91938b2 tempest-VolumesActionsTest-1945194074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:26:55 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-9d6d794d-ef13-42aa-96b2-0f3af91938b2 tempest-VolumesActionsTest-1945194074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:26:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-9d6d794d-ef13-42aa-96b2-0f3af91938b2 tempest-VolumesActionsTest-1945194074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:55 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-9d6d794d-ef13-42aa-96b2-0f3af91938b2 tempest-VolumesActionsTest-1945194074 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:26:55 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-9d6d794d-ef13-42aa-96b2-0f3af91938b2 tempest-VolumesActionsTest-1945194074 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:26:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9d6d794d-ef13-42aa-96b2-0f3af91938b2 tempest-VolumesActionsTest-1945194074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-fde7485e-0655-4911-90dc-23bf86b3d2bb 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:55 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a0b40b7b-adf3-44ca-883e-f041418b9348 tempest-VolumesSnapshotTestJSON-708792780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8df175b1-2c30-441a-9aa4-bab588ea70a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8077be60-e7c3-434b-876e-93ce60b85df5', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:55 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a0b40b7b-adf3-44ca-883e-f041418b9348 tempest-VolumesSnapshotTestJSON-708792780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6e48e18-54b4-49af-af5d-2f4e8bcf93c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:55 devstack sudo[88122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-fde7485e-0655-4911-90dc-23bf86b3d2bb 1073741824
Feb 27 01:26:55 devstack sudo[88122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:55 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-a0b40b7b-adf3-44ca-883e-f041418b9348 tempest-VolumesSnapshotTestJSON-708792780 None] Volume volume-8077be60-e7c3-434b-876e-93ce60b85df5 (8077be60-e7c3-434b-876e-93ce60b85df5): created successfully
Feb 27 01:26:55 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a0b40b7b-adf3-44ca-883e-f041418b9348 tempest-VolumesSnapshotTestJSON-708792780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6e48e18-54b4-49af-af5d-2f4e8bcf93c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:55 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a0b40b7b-adf3-44ca-883e-f041418b9348 tempest-VolumesSnapshotTestJSON-708792780 None] Flow 'volume_create_manager' (2ccd4331-8a92-4661-af8d-708ab293db5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:26:55 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-a0b40b7b-adf3-44ca-883e-f041418b9348 tempest-VolumesSnapshotTestJSON-708792780 None] Created volume successfully.
Feb 27 01:26:55 devstack sudo[88122]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9d6d794d-ef13-42aa-96b2-0f3af91938b2 tempest-VolumesActionsTest-1945194074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-fde7485e-0655-4911-90dc-23bf86b3d2bb 1073741824" returned: 0 in 0.663s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9d6d794d-ef13-42aa-96b2-0f3af91938b2 tempest-VolumesActionsTest-1945194074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-fde7485e-0655-4911-90dc-23bf86b3d2bb {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:56 devstack sudo[88127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-fde7485e-0655-4911-90dc-23bf86b3d2bb
Feb 27 01:26:56 devstack sudo[88127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-cdea3878-d537-4dcd-a9b2-5c891e56a1ac tempest-VolumesSnapshotTestJSON-708792780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:56 devstack sudo[88127]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9d6d794d-ef13-42aa-96b2-0f3af91938b2 tempest-VolumesActionsTest-1945194074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-fde7485e-0655-4911-90dc-23bf86b3d2bb" returned: 0 in 0.591s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:56 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-9d6d794d-ef13-42aa-96b2-0f3af91938b2 tempest-VolumesActionsTest-1945194074 None] <== create_volume: return (1335ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:26:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-9d6d794d-ef13-42aa-96b2-0f3af91938b2 tempest-VolumesActionsTest-1945194074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.339s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-9d7fc8b6-2eb5-45da-ac88-9edd3c75d985 tempest-VolumesSnapshotListTestJSON-465864726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.544s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:56 devstack cinder-volume[83106]: DEBUG dbcounter [-] [83106] Writing DB stats cinder:UPDATE=162,cinder:DELETE=16,cinder:SELECT=116,cinder:INSERT=46 {{(pid=83106) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 01:26:56 devstack cinder-volume[83106]: DEBUG dbcounter [-] [83106] Writing DB stats cinder:UPDATE=157,cinder:SELECT=126,cinder:INSERT=37,cinder:DELETE=14 {{(pid=83106) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 01:26:56 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-9d7fc8b6-2eb5-45da-ac88-9edd3c75d985 tempest-VolumesSnapshotListTestJSON-465864726 None] Creating offline snapshot a717178a-a656-4647-b9aa-43715198b8e6 of volume b01c7be6-aeb7-4079-8eb7-264dd1de1cb0 {{(pid=83106) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:26:56 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-9d6d794d-ef13-42aa-96b2-0f3af91938b2 tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d12bc282-e0d0-4e36-85fd-13ea92027ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fde7485e-0655-4911-90dc-23bf86b3d2bb', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:56 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-9d6d794d-ef13-42aa-96b2-0f3af91938b2 tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dd88d52-972f-410d-8663-272b5509b595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:56 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[f403ec90-d485-4ba1-8107-59cf10bd758a]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:26:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9d7fc8b6-2eb5-45da-ac88-9edd3c75d985 tempest-VolumesSnapshotListTestJSON-465864726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.e3804de5-d40c-4b50-9478-fce5e01e78ef {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:56 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-9d6d794d-ef13-42aa-96b2-0f3af91938b2 tempest-VolumesActionsTest-1945194074 None] Volume volume-fde7485e-0655-4911-90dc-23bf86b3d2bb (fde7485e-0655-4911-90dc-23bf86b3d2bb): created successfully
Feb 27 01:26:56 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-9d6d794d-ef13-42aa-96b2-0f3af91938b2 tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dd88d52-972f-410d-8663-272b5509b595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:56 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-9d6d794d-ef13-42aa-96b2-0f3af91938b2 tempest-VolumesActionsTest-1945194074 None] Flow 'volume_create_manager' (a4b51ddb-f208-4e48-a457-86c144921a2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:26:56 devstack sudo[88130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.e3804de5-d40c-4b50-9478-fce5e01e78ef
Feb 27 01:26:56 devstack sudo[88130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:56 devstack cinder-volume[83106]: DEBUG oslo_service.periodic_task [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83106) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Feb 27 01:26:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:56 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:26:56 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:26:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:56 devstack sudo[88132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:26:56 devstack sudo[88132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:56 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-9d6d794d-ef13-42aa-96b2-0f3af91938b2 tempest-VolumesActionsTest-1945194074 None] Created volume successfully.
Feb 27 01:26:56 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-6324677b-e4e3-43be-aecc-7ea4b8a26ace tempest-VolumesTransfersV357Test-2048174445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:26:56 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-6324677b-e4e3-43be-aecc-7ea4b8a26ace tempest-VolumesTransfersV357Test-2048174445 None] Flow 'volume_create_manager' (502fe2d0-ff43-441b-bbe1-7e8264e27edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:26:56 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-6324677b-e4e3-43be-aecc-7ea4b8a26ace tempest-VolumesTransfersV357Test-2048174445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92347511-d804-4779-99a5-f3982d8af257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:57 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-6324677b-e4e3-43be-aecc-7ea4b8a26ace tempest-VolumesTransfersV357Test-2048174445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92347511-d804-4779-99a5-f3982d8af257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1691226680',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b42a527-2060-4221-b9cb-e60388081624,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e29938d268c54e0a80b694dc33b35082',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:26:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:26:57Z,use_quota=True,user_id='3e01f8df8e9f48af98045b0433c708e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:57 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-6324677b-e4e3-43be-aecc-7ea4b8a26ace tempest-VolumesTransfersV357Test-2048174445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f40898a-b439-4397-934f-c282cd1f2cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:57 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-6324677b-e4e3-43be-aecc-7ea4b8a26ace tempest-VolumesTransfersV357Test-2048174445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f40898a-b439-4397-934f-c282cd1f2cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:57 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-6324677b-e4e3-43be-aecc-7ea4b8a26ace tempest-VolumesTransfersV357Test-2048174445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3764144-f527-4304-ac87-f745737c4fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:57 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-6324677b-e4e3-43be-aecc-7ea4b8a26ace tempest-VolumesTransfersV357Test-2048174445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3764144-f527-4304-ac87-f745737c4fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b42a527-2060-4221-b9cb-e60388081624', 'volume_name': 'volume-6b42a527-2060-4221-b9cb-e60388081624', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:57 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-6324677b-e4e3-43be-aecc-7ea4b8a26ace tempest-VolumesTransfersV357Test-2048174445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9658d9fa-88e6-4bd8-8c70-16363e649a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:57 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-6324677b-e4e3-43be-aecc-7ea4b8a26ace tempest-VolumesTransfersV357Test-2048174445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9658d9fa-88e6-4bd8-8c70-16363e649a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:26:57 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-6324677b-e4e3-43be-aecc-7ea4b8a26ace tempest-VolumesTransfersV357Test-2048174445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (917478c4-7dad-4c7c-a982-f951416d47a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:26:57 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-6324677b-e4e3-43be-aecc-7ea4b8a26ace tempest-VolumesTransfersV357Test-2048174445 None] Volume 6b42a527-2060-4221-b9cb-e60388081624: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b42a527-2060-4221-b9cb-e60388081624', 'volume_size': 1}
Feb 27 01:26:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-6324677b-e4e3-43be-aecc-7ea4b8a26ace tempest-VolumesTransfersV357Test-2048174445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:26:57 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-e0844ddf-2060-44df-9a3f-8ad44aa79683 tempest-VolumesActionsTest-1945194074 None] Acquiring lock "cinder-fde7485e-0655-4911-90dc-23bf86b3d2bb" by "attach_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:57 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-e0844ddf-2060-44df-9a3f-8ad44aa79683 tempest-VolumesActionsTest-1945194074 None] Lock "cinder-fde7485e-0655-4911-90dc-23bf86b3d2bb" acquired by "attach_volume" :: waited 0.010s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:57 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-e0844ddf-2060-44df-9a3f-8ad44aa79683 tempest-VolumesActionsTest-1945194074 None] Attaching volume fde7485e-0655-4911-90dc-23bf86b3d2bb to instance f3ef391a-f4eb-435e-a11a-390ad416a765 at mountpoint /dev/vdb on host None.
Feb 27 01:26:57 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-e0844ddf-2060-44df-9a3f-8ad44aa79683 tempest-VolumesActionsTest-1945194074 None] Attach volume completed successfully.
Feb 27 01:26:57 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-e0844ddf-2060-44df-9a3f-8ad44aa79683 tempest-VolumesActionsTest-1945194074 None] Lock "cinder-fde7485e-0655-4911-90dc-23bf86b3d2bb" released by "attach_volume" :: held 0.168s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:57 devstack sudo[88130]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9d7fc8b6-2eb5-45da-ac88-9edd3c75d985 tempest-VolumesSnapshotListTestJSON-465864726 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.e3804de5-d40c-4b50-9478-fce5e01e78ef" returned: 0 in 0.572s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:57 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-9d7fc8b6-2eb5-45da-ac88-9edd3c75d985 tempest-VolumesSnapshotListTestJSON-465864726 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83106) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:26:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9d7fc8b6-2eb5-45da-ac88-9edd3c75d985 tempest-VolumesSnapshotListTestJSON-465864726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.e3804de5-d40c-4b50-9478-fce5e01e78ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.a717178a-a656-4647-b9aa-43715198b8e6 1G {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:57 devstack sudo[88138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.e3804de5-d40c-4b50-9478-fce5e01e78ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.a717178a-a656-4647-b9aa-43715198b8e6 1G
Feb 27 01:26:57 devstack sudo[88138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:57 devstack sudo[88132]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.528s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:57 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:26:57 devstack sudo[88138]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9d7fc8b6-2eb5-45da-ac88-9edd3c75d985 tempest-VolumesSnapshotListTestJSON-465864726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.e3804de5-d40c-4b50-9478-fce5e01e78ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.a717178a-a656-4647-b9aa-43715198b8e6 1G" returned: 0 in 0.548s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9d7fc8b6-2eb5-45da-ac88-9edd3c75d985 tempest-VolumesSnapshotListTestJSON-465864726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.e3804de5-d40c-4b50-9478-fce5e01e78ef -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.a717178a-a656-4647-b9aa-43715198b8e6 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:57 devstack sudo[88143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.e3804de5-d40c-4b50-9478-fce5e01e78ef -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.a717178a-a656-4647-b9aa-43715198b8e6
Feb 27 01:26:57 devstack sudo[88143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:57 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-afdf8bcc-0b21-490b-b593-7e0205b1f5bc tempest-VolumesActionsTest-1938141483 None] Terminate volume connection completed successfully.
Feb 27 01:26:58 devstack sudo[88143]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:58 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9d7fc8b6-2eb5-45da-ac88-9edd3c75d985 tempest-VolumesSnapshotListTestJSON-465864726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.e3804de5-d40c-4b50-9478-fce5e01e78ef -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.a717178a-a656-4647-b9aa-43715198b8e6" returned: 0 in 0.432s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:58 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-9d7fc8b6-2eb5-45da-ac88-9edd3c75d985 tempest-VolumesSnapshotListTestJSON-465864726 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.a717178a-a656-4647-b9aa-43715198b8e6 is being set with open permissions: ugo+rw
Feb 27 01:26:58 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9d7fc8b6-2eb5-45da-ac88-9edd3c75d985 tempest-VolumesSnapshotListTestJSON-465864726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.a717178a-a656-4647-b9aa-43715198b8e6 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:58 devstack sudo[88148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.a717178a-a656-4647-b9aa-43715198b8e6
Feb 27 01:26:58 devstack sudo[88148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:58 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-afdf8bcc-0b21-490b-b593-7e0205b1f5bc tempest-VolumesActionsTest-1938141483 None] Acquiring lock "cinder-fde7485e-0655-4911-90dc-23bf86b3d2bb-detach_volume" by "detach_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:58 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-afdf8bcc-0b21-490b-b593-7e0205b1f5bc tempest-VolumesActionsTest-1938141483 None] Lock "cinder-fde7485e-0655-4911-90dc-23bf86b3d2bb-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:58 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-afdf8bcc-0b21-490b-b593-7e0205b1f5bc tempest-VolumesActionsTest-1938141483 None] Detaching volume fde7485e-0655-4911-90dc-23bf86b3d2bb from instance f3ef391a-f4eb-435e-a11a-390ad416a765.
Feb 27 01:26:58 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-afdf8bcc-0b21-490b-b593-7e0205b1f5bc tempest-VolumesActionsTest-1938141483 None] Detach volume completed successfully.
Feb 27 01:26:58 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-afdf8bcc-0b21-490b-b593-7e0205b1f5bc tempest-VolumesActionsTest-1938141483 None] Lock "cinder-fde7485e-0655-4911-90dc-23bf86b3d2bb-detach_volume" released by "detach_volume" :: held 0.073s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:58 devstack sudo[88148]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:58 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9d7fc8b6-2eb5-45da-ac88-9edd3c75d985 tempest-VolumesSnapshotListTestJSON-465864726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.a717178a-a656-4647-b9aa-43715198b8e6" returned: 0 in 0.492s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:58 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-9d7fc8b6-2eb5-45da-ac88-9edd3c75d985 tempest-VolumesSnapshotListTestJSON-465864726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.140s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:26:58 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-cdea3878-d537-4dcd-a9b2-5c891e56a1ac tempest-VolumesSnapshotTestJSON-708792780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.360s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:26:58 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-cdea3878-d537-4dcd-a9b2-5c891e56a1ac tempest-VolumesSnapshotTestJSON-708792780 None] Creating offline snapshot 96aadcc1-4256-43e1-bd02-e251b8940d84 of volume 8077be60-e7c3-434b-876e-93ce60b85df5 {{(pid=83106) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:26:58 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[866f2b7f-2842-40a3-ba87-9008c82a0a21]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:26:58 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-cdea3878-d537-4dcd-a9b2-5c891e56a1ac tempest-VolumesSnapshotTestJSON-708792780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8077be60-e7c3-434b-876e-93ce60b85df5 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:58 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-9d7fc8b6-2eb5-45da-ac88-9edd3c75d985 tempest-VolumesSnapshotListTestJSON-465864726 None] Create snapshot completed successfully
Feb 27 01:26:58 devstack sudo[88151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8077be60-e7c3-434b-876e-93ce60b85df5
Feb 27 01:26:58 devstack sudo[88151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:59 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-ddb522a4-5f5b-43d7-8c64-4ea99fa15e37 tempest-VolumesActionsTest-1945194074 None] Acquiring lock "cinder-fde7485e-0655-4911-90dc-23bf86b3d2bb-detach_volume" by "detach_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:59 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-ddb522a4-5f5b-43d7-8c64-4ea99fa15e37 tempest-VolumesActionsTest-1945194074 None] Lock "cinder-fde7485e-0655-4911-90dc-23bf86b3d2bb-detach_volume" acquired by "detach_volume" :: waited 0.010s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:59 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-ddb522a4-5f5b-43d7-8c64-4ea99fa15e37 tempest-VolumesActionsTest-1945194074 None] Volume detach called, but volume not attached.
Feb 27 01:26:59 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-ddb522a4-5f5b-43d7-8c64-4ea99fa15e37 tempest-VolumesActionsTest-1945194074 None] Lock "cinder-fde7485e-0655-4911-90dc-23bf86b3d2bb-detach_volume" released by "detach_volume" :: held 0.011s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:26:59 devstack sudo[88151]: pam_unix(sudo:session): session closed for user root
Feb 27 01:26:59 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-cdea3878-d537-4dcd-a9b2-5c891e56a1ac tempest-VolumesSnapshotTestJSON-708792780 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8077be60-e7c3-434b-876e-93ce60b85df5" returned: 0 in 0.551s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:26:59 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-cdea3878-d537-4dcd-a9b2-5c891e56a1ac tempest-VolumesSnapshotTestJSON-708792780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8077be60-e7c3-434b-876e-93ce60b85df5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8077be60-e7c3-434b-876e-93ce60b85df5.96aadcc1-4256-43e1-bd02-e251b8940d84 1G {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:26:59 devstack sudo[88156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8077be60-e7c3-434b-876e-93ce60b85df5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8077be60-e7c3-434b-876e-93ce60b85df5.96aadcc1-4256-43e1-bd02-e251b8940d84 1G
Feb 27 01:26:59 devstack sudo[88156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:26:59 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-d83d1c26-3157-4838-a008-15eeda9437ae tempest-VolumesActionsTest-1945194074 None] Acquiring lock "cinder-fde7485e-0655-4911-90dc-23bf86b3d2bb-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:59 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-d83d1c26-3157-4838-a008-15eeda9437ae tempest-VolumesActionsTest-1945194074 None] Lock "cinder-fde7485e-0655-4911-90dc-23bf86b3d2bb-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:59 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-d83d1c26-3157-4838-a008-15eeda9437ae tempest-VolumesActionsTest-1945194074 None] Acquiring lock "cinder-quobyte-fde7485e-0655-4911-90dc-23bf86b3d2bb" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:26:59 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-d83d1c26-3157-4838-a008-15eeda9437ae tempest-VolumesActionsTest-1945194074 None] Lock "cinder-quobyte-fde7485e-0655-4911-90dc-23bf86b3d2bb" acquired by "delete_volume" :: waited 0.020s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:26:59 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[402f11bb-a10a-4632-ba15-63fa9270d0c4]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:26:59 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d83d1c26-3157-4838-a008-15eeda9437ae tempest-VolumesActionsTest-1945194074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-fde7485e-0655-4911-90dc-23bf86b3d2bb {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:00 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-582d0e1e-5046-40da-ba75-7312cf8911f4 tempest-VolumesSnapshotListTestJSON-465864726 None] Acquiring lock "cinder-a717178a-a656-4647-b9aa-43715198b8e6-delete_snapshot" by "delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:00 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-582d0e1e-5046-40da-ba75-7312cf8911f4 tempest-VolumesSnapshotListTestJSON-465864726 None] Lock "cinder-a717178a-a656-4647-b9aa-43715198b8e6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:00 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-582d0e1e-5046-40da-ba75-7312cf8911f4 tempest-VolumesSnapshotListTestJSON-465864726 None] Acquiring lock "cinder-quobyte-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0" by "delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:00 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-582d0e1e-5046-40da-ba75-7312cf8911f4 tempest-VolumesSnapshotListTestJSON-465864726 None] Lock "cinder-quobyte-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:00 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-582d0e1e-5046-40da-ba75-7312cf8911f4 tempest-VolumesSnapshotListTestJSON-465864726 None] Acquiring lock "cinder-quobyte-a717178a-a656-4647-b9aa-43715198b8e6" by "_delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:00 devstack sudo[88161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-fde7485e-0655-4911-90dc-23bf86b3d2bb
Feb 27 01:27:00 devstack sudo[88161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:00 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-582d0e1e-5046-40da-ba75-7312cf8911f4 tempest-VolumesSnapshotListTestJSON-465864726 None] Lock "cinder-quobyte-a717178a-a656-4647-b9aa-43715198b8e6" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:00 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-582d0e1e-5046-40da-ba75-7312cf8911f4 tempest-VolumesSnapshotListTestJSON-465864726 None] Deleting offline snapshot a717178a-a656-4647-b9aa-43715198b8e6 of volume b01c7be6-aeb7-4079-8eb7-264dd1de1cb0 {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:27:00 devstack sudo[88156]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:00 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-582d0e1e-5046-40da-ba75-7312cf8911f4 tempest-VolumesSnapshotListTestJSON-465864726 None] snapshot_file for this snap is: volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.a717178a-a656-4647-b9aa-43715198b8e6 {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:27:00 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-cdea3878-d537-4dcd-a9b2-5c891e56a1ac tempest-VolumesSnapshotTestJSON-708792780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8077be60-e7c3-434b-876e-93ce60b85df5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8077be60-e7c3-434b-876e-93ce60b85df5.96aadcc1-4256-43e1-bd02-e251b8940d84 1G" returned: 0 in 0.798s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:00 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-cdea3878-d537-4dcd-a9b2-5c891e56a1ac tempest-VolumesSnapshotTestJSON-708792780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8077be60-e7c3-434b-876e-93ce60b85df5 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8077be60-e7c3-434b-876e-93ce60b85df5.96aadcc1-4256-43e1-bd02-e251b8940d84 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:00 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[228f22a8-c475-4b64-a08a-04ff38f24ca7]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:00 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-582d0e1e-5046-40da-ba75-7312cf8911f4 tempest-VolumesSnapshotListTestJSON-465864726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.a717178a-a656-4647-b9aa-43715198b8e6 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:00 devstack sudo[88179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8077be60-e7c3-434b-876e-93ce60b85df5 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8077be60-e7c3-434b-876e-93ce60b85df5.96aadcc1-4256-43e1-bd02-e251b8940d84
Feb 27 01:27:00 devstack sudo[88179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:00 devstack sudo[88196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.a717178a-a656-4647-b9aa-43715198b8e6
Feb 27 01:27:00 devstack sudo[88196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:00 devstack sudo[88161]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:00 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d83d1c26-3157-4838-a008-15eeda9437ae tempest-VolumesActionsTest-1945194074 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-fde7485e-0655-4911-90dc-23bf86b3d2bb" returned: 0 in 0.694s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:00 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d83d1c26-3157-4838-a008-15eeda9437ae tempest-VolumesActionsTest-1945194074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-fde7485e-0655-4911-90dc-23bf86b3d2bb {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:00 devstack sudo[88210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-fde7485e-0655-4911-90dc-23bf86b3d2bb
Feb 27 01:27:00 devstack sudo[88210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:00 devstack sudo[88196]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:00 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-582d0e1e-5046-40da-ba75-7312cf8911f4 tempest-VolumesSnapshotListTestJSON-465864726 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.a717178a-a656-4647-b9aa-43715198b8e6" returned: 0 in 0.666s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:00 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-582d0e1e-5046-40da-ba75-7312cf8911f4 tempest-VolumesSnapshotListTestJSON-465864726 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83106) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:27:00 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c8aae8-b58c-4b79-b717-163a87661c85]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:00 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-582d0e1e-5046-40da-ba75-7312cf8911f4 tempest-VolumesSnapshotListTestJSON-465864726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.e3804de5-d40c-4b50-9478-fce5e01e78ef {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:00 devstack sudo[88179]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:00 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-cdea3878-d537-4dcd-a9b2-5c891e56a1ac tempest-VolumesSnapshotTestJSON-708792780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8077be60-e7c3-434b-876e-93ce60b85df5 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8077be60-e7c3-434b-876e-93ce60b85df5.96aadcc1-4256-43e1-bd02-e251b8940d84" returned: 0 in 0.716s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:00 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-cdea3878-d537-4dcd-a9b2-5c891e56a1ac tempest-VolumesSnapshotTestJSON-708792780 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8077be60-e7c3-434b-876e-93ce60b85df5.96aadcc1-4256-43e1-bd02-e251b8940d84 is being set with open permissions: ugo+rw
Feb 27 01:27:00 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-cdea3878-d537-4dcd-a9b2-5c891e56a1ac tempest-VolumesSnapshotTestJSON-708792780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8077be60-e7c3-434b-876e-93ce60b85df5.96aadcc1-4256-43e1-bd02-e251b8940d84 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:00 devstack sudo[88219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8077be60-e7c3-434b-876e-93ce60b85df5.96aadcc1-4256-43e1-bd02-e251b8940d84
Feb 27 01:27:00 devstack sudo[88219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:00 devstack sudo[88218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.e3804de5-d40c-4b50-9478-fce5e01e78ef
Feb 27 01:27:00 devstack sudo[88218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:01 devstack sudo[88210]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:01 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d83d1c26-3157-4838-a008-15eeda9437ae tempest-VolumesActionsTest-1945194074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-fde7485e-0655-4911-90dc-23bf86b3d2bb" returned: 0 in 0.586s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:01 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-d83d1c26-3157-4838-a008-15eeda9437ae tempest-VolumesActionsTest-1945194074 None] Lock "cinder-quobyte-fde7485e-0655-4911-90dc-23bf86b3d2bb" released by "delete_volume" :: held 1.345s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:01 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-d83d1c26-3157-4838-a008-15eeda9437ae tempest-VolumesActionsTest-1945194074 None] Created reservations ['a7ec9f85-b22e-4ed4-b365-08d4036daa5b', '6a8571ae-55a9-4ac1-846b-1e9ebe8338a4', 'fd7683ff-8186-48e3-8519-ebab23329f40', '35d6ac5a-6778-4bb7-8153-453a9dfd2eeb'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:27:01 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-d83d1c26-3157-4838-a008-15eeda9437ae tempest-VolumesActionsTest-1945194074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:01 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-d83d1c26-3157-4838-a008-15eeda9437ae tempest-VolumesActionsTest-1945194074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:01 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-d83d1c26-3157-4838-a008-15eeda9437ae tempest-VolumesActionsTest-1945194074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:01 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-d83d1c26-3157-4838-a008-15eeda9437ae tempest-VolumesActionsTest-1945194074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:01 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-d83d1c26-3157-4838-a008-15eeda9437ae tempest-VolumesActionsTest-1945194074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:01 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d83d1c26-3157-4838-a008-15eeda9437ae tempest-VolumesActionsTest-1945194074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:01 devstack sudo[88228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:27:01 devstack sudo[88228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:01 devstack sudo[88219]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:01 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-cdea3878-d537-4dcd-a9b2-5c891e56a1ac tempest-VolumesSnapshotTestJSON-708792780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8077be60-e7c3-434b-876e-93ce60b85df5.96aadcc1-4256-43e1-bd02-e251b8940d84" returned: 0 in 0.649s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:01 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-cdea3878-d537-4dcd-a9b2-5c891e56a1ac tempest-VolumesSnapshotTestJSON-708792780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8077be60-e7c3-434b-876e-93ce60b85df5.info {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:01 devstack sudo[88235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8077be60-e7c3-434b-876e-93ce60b85df5.info
Feb 27 01:27:01 devstack sudo[88235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:01 devstack sudo[88218]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:01 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-582d0e1e-5046-40da-ba75-7312cf8911f4 tempest-VolumesSnapshotListTestJSON-465864726 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.e3804de5-d40c-4b50-9478-fce5e01e78ef" returned: 0 in 0.783s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:01 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-582d0e1e-5046-40da-ba75-7312cf8911f4 tempest-VolumesSnapshotListTestJSON-465864726 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83106) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:27:01 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-582d0e1e-5046-40da-ba75-7312cf8911f4 tempest-VolumesSnapshotListTestJSON-465864726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.a717178a-a656-4647-b9aa-43715198b8e6 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:01 devstack sudo[88237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.a717178a-a656-4647-b9aa-43715198b8e6
Feb 27 01:27:01 devstack sudo[88237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:02 devstack sudo[88228]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:02 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d83d1c26-3157-4838-a008-15eeda9437ae tempest-VolumesActionsTest-1945194074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.783s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:02 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-d83d1c26-3157-4838-a008-15eeda9437ae tempest-VolumesActionsTest-1945194074 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:27:02 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-d83d1c26-3157-4838-a008-15eeda9437ae tempest-VolumesActionsTest-1945194074 None] Deleted volume successfully.
Feb 27 01:27:02 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-d83d1c26-3157-4838-a008-15eeda9437ae tempest-VolumesActionsTest-1945194074 None] Lock "cinder-fde7485e-0655-4911-90dc-23bf86b3d2bb-delete_volume" released by "delete_volume" :: held 2.335s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:02 devstack sudo[88235]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:02 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-cdea3878-d537-4dcd-a9b2-5c891e56a1ac tempest-VolumesSnapshotTestJSON-708792780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8077be60-e7c3-434b-876e-93ce60b85df5.info" returned: 0 in 0.670s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:02 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-cdea3878-d537-4dcd-a9b2-5c891e56a1ac tempest-VolumesSnapshotTestJSON-708792780 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8077be60-e7c3-434b-876e-93ce60b85df5.info is being set with open permissions: ugo+rw
Feb 27 01:27:02 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-cdea3878-d537-4dcd-a9b2-5c891e56a1ac tempest-VolumesSnapshotTestJSON-708792780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8077be60-e7c3-434b-876e-93ce60b85df5.info {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:02 devstack sudo[88245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8077be60-e7c3-434b-876e-93ce60b85df5.info
Feb 27 01:27:02 devstack sudo[88245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:02 devstack sudo[88237]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:02 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-582d0e1e-5046-40da-ba75-7312cf8911f4 tempest-VolumesSnapshotListTestJSON-465864726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.a717178a-a656-4647-b9aa-43715198b8e6" returned: 0 in 0.648s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:02 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-582d0e1e-5046-40da-ba75-7312cf8911f4 tempest-VolumesSnapshotListTestJSON-465864726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.a717178a-a656-4647-b9aa-43715198b8e6 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:02 devstack sudo[88247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.a717178a-a656-4647-b9aa-43715198b8e6
Feb 27 01:27:02 devstack sudo[88247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:02 devstack sudo[88245]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:02 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-cdea3878-d537-4dcd-a9b2-5c891e56a1ac tempest-VolumesSnapshotTestJSON-708792780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8077be60-e7c3-434b-876e-93ce60b85df5.info" returned: 0 in 0.532s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:02 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-cdea3878-d537-4dcd-a9b2-5c891e56a1ac tempest-VolumesSnapshotTestJSON-708792780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.015s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:02 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-6324677b-e4e3-43be-aecc-7ea4b8a26ace tempest-VolumesTransfersV357Test-2048174445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.768s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:02 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-6324677b-e4e3-43be-aecc-7ea4b8a26ace tempest-VolumesTransfersV357Test-2048174445 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1691226680',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b42a527-2060-4221-b9cb-e60388081624,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e29938d268c54e0a80b694dc33b35082',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:26:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:26:57Z,use_quota=True,user_id='3e01f8df8e9f48af98045b0433c708e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:27:02 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-6324677b-e4e3-43be-aecc-7ea4b8a26ace tempest-VolumesTransfersV357Test-2048174445 None] Creating volume 6b42a527-2060-4221-b9cb-e60388081624 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:27:02 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-6324677b-e4e3-43be-aecc-7ea4b8a26ace tempest-VolumesTransfersV357Test-2048174445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:02 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-6324677b-e4e3-43be-aecc-7ea4b8a26ace tempest-VolumesTransfersV357Test-2048174445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:02 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-6324677b-e4e3-43be-aecc-7ea4b8a26ace tempest-VolumesTransfersV357Test-2048174445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:02 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-6324677b-e4e3-43be-aecc-7ea4b8a26ace tempest-VolumesTransfersV357Test-2048174445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:02 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-6324677b-e4e3-43be-aecc-7ea4b8a26ace tempest-VolumesTransfersV357Test-2048174445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:02 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-6324677b-e4e3-43be-aecc-7ea4b8a26ace tempest-VolumesTransfersV357Test-2048174445 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:27:02 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-6324677b-e4e3-43be-aecc-7ea4b8a26ace tempest-VolumesTransfersV357Test-2048174445 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:27:02 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-6324677b-e4e3-43be-aecc-7ea4b8a26ace tempest-VolumesTransfersV357Test-2048174445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-6b42a527-2060-4221-b9cb-e60388081624 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:02 devstack sudo[88252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-6b42a527-2060-4221-b9cb-e60388081624 1073741824
Feb 27 01:27:02 devstack sudo[88252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:02 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-cdea3878-d537-4dcd-a9b2-5c891e56a1ac tempest-VolumesSnapshotTestJSON-708792780 None] Create snapshot completed successfully
Feb 27 01:27:02 devstack sudo[88247]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:02 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-582d0e1e-5046-40da-ba75-7312cf8911f4 tempest-VolumesSnapshotListTestJSON-465864726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.a717178a-a656-4647-b9aa-43715198b8e6" returned: 0 in 0.602s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:02 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-582d0e1e-5046-40da-ba75-7312cf8911f4 tempest-VolumesSnapshotListTestJSON-465864726 None] Lock "cinder-quobyte-a717178a-a656-4647-b9aa-43715198b8e6" released by "_delete_snapshot" :: held 2.798s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:02 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-582d0e1e-5046-40da-ba75-7312cf8911f4 tempest-VolumesSnapshotListTestJSON-465864726 None] Lock "cinder-quobyte-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0" released by "delete_snapshot" :: held 2.820s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:02 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-582d0e1e-5046-40da-ba75-7312cf8911f4 tempest-VolumesSnapshotListTestJSON-465864726 None] Created reservations ['d69a34be-4c94-495a-97df-826201c70a2b', 'ef550f1b-1dc5-446b-bf04-3cfac2e65c9e', '182eae19-210c-4126-a816-461fc2a796b7', 'c2d85d55-398a-4769-89a2-810c08210b1e'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:27:03 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-582d0e1e-5046-40da-ba75-7312cf8911f4 tempest-VolumesSnapshotListTestJSON-465864726 None] Delete snapshot completed successfully.
Feb 27 01:27:03 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-582d0e1e-5046-40da-ba75-7312cf8911f4 tempest-VolumesSnapshotListTestJSON-465864726 None] Lock "cinder-a717178a-a656-4647-b9aa-43715198b8e6-delete_snapshot" released by "delete_snapshot" :: held 2.922s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:03 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-9a54d5a5-9149-4884-96d4-7e1d5d82b972 tempest-VolumesSnapshotListTestJSON-465864726 None] Acquiring lock "cinder-e3804de5-d40c-4b50-9478-fce5e01e78ef-delete_snapshot" by "delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:03 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-9a54d5a5-9149-4884-96d4-7e1d5d82b972 tempest-VolumesSnapshotListTestJSON-465864726 None] Lock "cinder-e3804de5-d40c-4b50-9478-fce5e01e78ef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:03 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-9a54d5a5-9149-4884-96d4-7e1d5d82b972 tempest-VolumesSnapshotListTestJSON-465864726 None] Acquiring lock "cinder-quobyte-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0" by "delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:03 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-9a54d5a5-9149-4884-96d4-7e1d5d82b972 tempest-VolumesSnapshotListTestJSON-465864726 None] Lock "cinder-quobyte-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:03 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-9a54d5a5-9149-4884-96d4-7e1d5d82b972 tempest-VolumesSnapshotListTestJSON-465864726 None] Acquiring lock "cinder-quobyte-e3804de5-d40c-4b50-9478-fce5e01e78ef" by "_delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:03 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-9a54d5a5-9149-4884-96d4-7e1d5d82b972 tempest-VolumesSnapshotListTestJSON-465864726 None] Lock "cinder-quobyte-e3804de5-d40c-4b50-9478-fce5e01e78ef" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:03 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-9a54d5a5-9149-4884-96d4-7e1d5d82b972 tempest-VolumesSnapshotListTestJSON-465864726 None] Deleting offline snapshot e3804de5-d40c-4b50-9478-fce5e01e78ef of volume b01c7be6-aeb7-4079-8eb7-264dd1de1cb0 {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:27:03 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-9a54d5a5-9149-4884-96d4-7e1d5d82b972 tempest-VolumesSnapshotListTestJSON-465864726 None] snapshot_file for this snap is: volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.e3804de5-d40c-4b50-9478-fce5e01e78ef {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:27:03 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13d73d3-0ac8-4fc7-8ec0-7abbae2368cf]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:03 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9a54d5a5-9149-4884-96d4-7e1d5d82b972 tempest-VolumesSnapshotListTestJSON-465864726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.e3804de5-d40c-4b50-9478-fce5e01e78ef {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:03 devstack sudo[88266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.e3804de5-d40c-4b50-9478-fce5e01e78ef
Feb 27 01:27:03 devstack sudo[88266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:03 devstack sudo[88252]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:03 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-6324677b-e4e3-43be-aecc-7ea4b8a26ace tempest-VolumesTransfersV357Test-2048174445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-6b42a527-2060-4221-b9cb-e60388081624 1073741824" returned: 0 in 0.697s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:03 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-6324677b-e4e3-43be-aecc-7ea4b8a26ace tempest-VolumesTransfersV357Test-2048174445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-6b42a527-2060-4221-b9cb-e60388081624 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:03 devstack sudo[88284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-6b42a527-2060-4221-b9cb-e60388081624
Feb 27 01:27:03 devstack sudo[88284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:03 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-40770d70-af4f-429d-9983-cb79bb985f6a tempest-VolumesSnapshotTestJSON-708792780 None] Acquiring lock "cinder-96aadcc1-4256-43e1-bd02-e251b8940d84-delete_snapshot" by "delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:03 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-40770d70-af4f-429d-9983-cb79bb985f6a tempest-VolumesSnapshotTestJSON-708792780 None] Lock "cinder-96aadcc1-4256-43e1-bd02-e251b8940d84-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:03 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-40770d70-af4f-429d-9983-cb79bb985f6a tempest-VolumesSnapshotTestJSON-708792780 None] Acquiring lock "cinder-quobyte-8077be60-e7c3-434b-876e-93ce60b85df5" by "delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:03 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-40770d70-af4f-429d-9983-cb79bb985f6a tempest-VolumesSnapshotTestJSON-708792780 None] Lock "cinder-quobyte-8077be60-e7c3-434b-876e-93ce60b85df5" acquired by "delete_snapshot" :: waited 0.020s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:03 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-40770d70-af4f-429d-9983-cb79bb985f6a tempest-VolumesSnapshotTestJSON-708792780 None] Acquiring lock "cinder-quobyte-96aadcc1-4256-43e1-bd02-e251b8940d84" by "_delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:04 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-40770d70-af4f-429d-9983-cb79bb985f6a tempest-VolumesSnapshotTestJSON-708792780 None] Lock "cinder-quobyte-96aadcc1-4256-43e1-bd02-e251b8940d84" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:04 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-40770d70-af4f-429d-9983-cb79bb985f6a tempest-VolumesSnapshotTestJSON-708792780 None] Deleting offline snapshot 96aadcc1-4256-43e1-bd02-e251b8940d84 of volume 8077be60-e7c3-434b-876e-93ce60b85df5 {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:27:04 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-40770d70-af4f-429d-9983-cb79bb985f6a tempest-VolumesSnapshotTestJSON-708792780 None] snapshot_file for this snap is: volume-8077be60-e7c3-434b-876e-93ce60b85df5.96aadcc1-4256-43e1-bd02-e251b8940d84 {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:27:04 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[486f3765-d1d9-4b43-ba80-9e3ac0d08d71]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:04 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-40770d70-af4f-429d-9983-cb79bb985f6a tempest-VolumesSnapshotTestJSON-708792780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8077be60-e7c3-434b-876e-93ce60b85df5.96aadcc1-4256-43e1-bd02-e251b8940d84 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:04 devstack sudo[88266]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:04 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9a54d5a5-9149-4884-96d4-7e1d5d82b972 tempest-VolumesSnapshotListTestJSON-465864726 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.e3804de5-d40c-4b50-9478-fce5e01e78ef" returned: 0 in 0.686s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:04 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-9a54d5a5-9149-4884-96d4-7e1d5d82b972 tempest-VolumesSnapshotListTestJSON-465864726 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83106) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:27:04 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1cdbc2-341c-4d5a-9917-a0346bc0c925]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:04 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9a54d5a5-9149-4884-96d4-7e1d5d82b972 tempest-VolumesSnapshotListTestJSON-465864726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.20dcb289-7197-41d8-974d-0a6728e736a1 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:04 devstack sudo[88284]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:04 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-6324677b-e4e3-43be-aecc-7ea4b8a26ace tempest-VolumesTransfersV357Test-2048174445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-6b42a527-2060-4221-b9cb-e60388081624" returned: 0 in 0.584s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:04 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-6324677b-e4e3-43be-aecc-7ea4b8a26ace tempest-VolumesTransfersV357Test-2048174445 None] <== create_volume: return (1323ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:27:04 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-6324677b-e4e3-43be-aecc-7ea4b8a26ace tempest-VolumesTransfersV357Test-2048174445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.330s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:04 devstack sudo[88290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8077be60-e7c3-434b-876e-93ce60b85df5.96aadcc1-4256-43e1-bd02-e251b8940d84
Feb 27 01:27:04 devstack sudo[88290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:04 devstack sudo[88292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.20dcb289-7197-41d8-974d-0a6728e736a1
Feb 27 01:27:04 devstack sudo[88292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:04 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-6324677b-e4e3-43be-aecc-7ea4b8a26ace tempest-VolumesTransfersV357Test-2048174445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (917478c4-7dad-4c7c-a982-f951416d47a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b42a527-2060-4221-b9cb-e60388081624', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:04 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-6324677b-e4e3-43be-aecc-7ea4b8a26ace tempest-VolumesTransfersV357Test-2048174445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e75f181-1479-44c1-a640-74a6914299e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:04 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-6324677b-e4e3-43be-aecc-7ea4b8a26ace tempest-VolumesTransfersV357Test-2048174445 None] Volume volume-6b42a527-2060-4221-b9cb-e60388081624 (6b42a527-2060-4221-b9cb-e60388081624): created successfully
Feb 27 01:27:04 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-6324677b-e4e3-43be-aecc-7ea4b8a26ace tempest-VolumesTransfersV357Test-2048174445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e75f181-1479-44c1-a640-74a6914299e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:04 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-6324677b-e4e3-43be-aecc-7ea4b8a26ace tempest-VolumesTransfersV357Test-2048174445 None] Flow 'volume_create_manager' (502fe2d0-ff43-441b-bbe1-7e8264e27edc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:04 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-6324677b-e4e3-43be-aecc-7ea4b8a26ace tempest-VolumesTransfersV357Test-2048174445 None] Created volume successfully.
Feb 27 01:27:04 devstack sudo[88290]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:04 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-40770d70-af4f-429d-9983-cb79bb985f6a tempest-VolumesSnapshotTestJSON-708792780 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8077be60-e7c3-434b-876e-93ce60b85df5.96aadcc1-4256-43e1-bd02-e251b8940d84" returned: 0 in 0.536s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:04 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-40770d70-af4f-429d-9983-cb79bb985f6a tempest-VolumesSnapshotTestJSON-708792780 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8077be60-e7c3-434b-876e-93ce60b85df5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83106) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:27:04 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[021ca5ed-0e65-40ea-9680-4e0d414d94a9]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:04 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-40770d70-af4f-429d-9983-cb79bb985f6a tempest-VolumesSnapshotTestJSON-708792780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8077be60-e7c3-434b-876e-93ce60b85df5 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:04 devstack sudo[88301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8077be60-e7c3-434b-876e-93ce60b85df5
Feb 27 01:27:04 devstack sudo[88301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:04 devstack sudo[88292]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:04 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9a54d5a5-9149-4884-96d4-7e1d5d82b972 tempest-VolumesSnapshotListTestJSON-465864726 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.20dcb289-7197-41d8-974d-0a6728e736a1" returned: 0 in 0.597s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:04 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-9a54d5a5-9149-4884-96d4-7e1d5d82b972 tempest-VolumesSnapshotListTestJSON-465864726 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83106) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:27:04 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9a54d5a5-9149-4884-96d4-7e1d5d82b972 tempest-VolumesSnapshotListTestJSON-465864726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.e3804de5-d40c-4b50-9478-fce5e01e78ef {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:04 devstack sudo[88303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.e3804de5-d40c-4b50-9478-fce5e01e78ef
Feb 27 01:27:04 devstack sudo[88303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:05 devstack sudo[88301]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:05 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-40770d70-af4f-429d-9983-cb79bb985f6a tempest-VolumesSnapshotTestJSON-708792780 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8077be60-e7c3-434b-876e-93ce60b85df5" returned: 0 in 0.567s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:05 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-40770d70-af4f-429d-9983-cb79bb985f6a tempest-VolumesSnapshotTestJSON-708792780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8077be60-e7c3-434b-876e-93ce60b85df5.96aadcc1-4256-43e1-bd02-e251b8940d84 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:05 devstack sudo[88312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8077be60-e7c3-434b-876e-93ce60b85df5.96aadcc1-4256-43e1-bd02-e251b8940d84
Feb 27 01:27:05 devstack sudo[88312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:05 devstack sudo[88303]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:05 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9a54d5a5-9149-4884-96d4-7e1d5d82b972 tempest-VolumesSnapshotListTestJSON-465864726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.e3804de5-d40c-4b50-9478-fce5e01e78ef" returned: 0 in 0.586s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:05 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9a54d5a5-9149-4884-96d4-7e1d5d82b972 tempest-VolumesSnapshotListTestJSON-465864726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.e3804de5-d40c-4b50-9478-fce5e01e78ef {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:05 devstack sudo[88314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.e3804de5-d40c-4b50-9478-fce5e01e78ef
Feb 27 01:27:05 devstack sudo[88314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:05 devstack sudo[88312]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:05 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-40770d70-af4f-429d-9983-cb79bb985f6a tempest-VolumesSnapshotTestJSON-708792780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8077be60-e7c3-434b-876e-93ce60b85df5.96aadcc1-4256-43e1-bd02-e251b8940d84" returned: 0 in 0.575s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:05 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-40770d70-af4f-429d-9983-cb79bb985f6a tempest-VolumesSnapshotTestJSON-708792780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8077be60-e7c3-434b-876e-93ce60b85df5.96aadcc1-4256-43e1-bd02-e251b8940d84 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:05 devstack sudo[88320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8077be60-e7c3-434b-876e-93ce60b85df5.96aadcc1-4256-43e1-bd02-e251b8940d84
Feb 27 01:27:05 devstack sudo[88320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:05 devstack sudo[88314]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:05 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9a54d5a5-9149-4884-96d4-7e1d5d82b972 tempest-VolumesSnapshotListTestJSON-465864726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.e3804de5-d40c-4b50-9478-fce5e01e78ef" returned: 0 in 0.563s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:05 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-9a54d5a5-9149-4884-96d4-7e1d5d82b972 tempest-VolumesSnapshotListTestJSON-465864726 None] Lock "cinder-quobyte-e3804de5-d40c-4b50-9478-fce5e01e78ef" released by "_delete_snapshot" :: held 2.516s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:05 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-9a54d5a5-9149-4884-96d4-7e1d5d82b972 tempest-VolumesSnapshotListTestJSON-465864726 None] Lock "cinder-quobyte-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0" released by "delete_snapshot" :: held 2.555s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:05 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-53a08471-73c1-4cb3-811a-8c922c1ab7c6 tempest-VolumesTransfersV357Test-397855915 None] Transfer volume completed successfully.
Feb 27 01:27:05 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-9a54d5a5-9149-4884-96d4-7e1d5d82b972 tempest-VolumesSnapshotListTestJSON-465864726 None] Created reservations ['21a1d249-361d-492c-a6b7-4a506d83c64c', '45968b61-fb2d-49a7-9b3b-c2867f838958', 'ad67349d-0c7d-43c8-a556-a6ec98e18bd4', '9706e581-7a31-4aeb-8283-85cf1688f0fc'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:27:05 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-9a54d5a5-9149-4884-96d4-7e1d5d82b972 tempest-VolumesSnapshotListTestJSON-465864726 None] Delete snapshot completed successfully.
Feb 27 01:27:05 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-9a54d5a5-9149-4884-96d4-7e1d5d82b972 tempest-VolumesSnapshotListTestJSON-465864726 None] Lock "cinder-e3804de5-d40c-4b50-9478-fce5e01e78ef-delete_snapshot" released by "delete_snapshot" :: held 2.677s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:06 devstack sudo[88320]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:06 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-40770d70-af4f-429d-9983-cb79bb985f6a tempest-VolumesSnapshotTestJSON-708792780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8077be60-e7c3-434b-876e-93ce60b85df5.96aadcc1-4256-43e1-bd02-e251b8940d84" returned: 0 in 0.595s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:06 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-40770d70-af4f-429d-9983-cb79bb985f6a tempest-VolumesSnapshotTestJSON-708792780 None] Lock "cinder-quobyte-96aadcc1-4256-43e1-bd02-e251b8940d84" released by "_delete_snapshot" :: held 2.343s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:06 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-40770d70-af4f-429d-9983-cb79bb985f6a tempest-VolumesSnapshotTestJSON-708792780 None] Lock "cinder-quobyte-8077be60-e7c3-434b-876e-93ce60b85df5" released by "delete_snapshot" :: held 2.363s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:06 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-40770d70-af4f-429d-9983-cb79bb985f6a tempest-VolumesSnapshotTestJSON-708792780 None] Created reservations ['6607b63b-cadc-4a26-8160-0a0b3a6e1c0b', 'a055d272-93d1-4ec8-99c6-fb916ab4d878', 'a0c006e8-4af0-49c4-83f8-ac1f810ba715', 'bfb1c016-7d08-4c10-868c-2553c9a59118'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:27:06 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-ccc18efb-9ef4-4a37-8134-debe511b1c71 tempest-VolumesSnapshotListTestJSON-465864726 None] Acquiring lock "cinder-20dcb289-7197-41d8-974d-0a6728e736a1-delete_snapshot" by "delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:06 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-40770d70-af4f-429d-9983-cb79bb985f6a tempest-VolumesSnapshotTestJSON-708792780 None] Delete snapshot completed successfully.
Feb 27 01:27:06 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-ccc18efb-9ef4-4a37-8134-debe511b1c71 tempest-VolumesSnapshotListTestJSON-465864726 None] Lock "cinder-20dcb289-7197-41d8-974d-0a6728e736a1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:06 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-ccc18efb-9ef4-4a37-8134-debe511b1c71 tempest-VolumesSnapshotListTestJSON-465864726 None] Acquiring lock "cinder-quobyte-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0" by "delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:06 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-40770d70-af4f-429d-9983-cb79bb985f6a tempest-VolumesSnapshotTestJSON-708792780 None] Lock "cinder-96aadcc1-4256-43e1-bd02-e251b8940d84-delete_snapshot" released by "delete_snapshot" :: held 2.579s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:06 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-ccc18efb-9ef4-4a37-8134-debe511b1c71 tempest-VolumesSnapshotListTestJSON-465864726 None] Lock "cinder-quobyte-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0" acquired by "delete_snapshot" :: waited 0.021s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:06 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-ccc18efb-9ef4-4a37-8134-debe511b1c71 tempest-VolumesSnapshotListTestJSON-465864726 None] Acquiring lock "cinder-quobyte-20dcb289-7197-41d8-974d-0a6728e736a1" by "_delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:06 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-ccc18efb-9ef4-4a37-8134-debe511b1c71 tempest-VolumesSnapshotListTestJSON-465864726 None] Lock "cinder-quobyte-20dcb289-7197-41d8-974d-0a6728e736a1" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:06 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-ccc18efb-9ef4-4a37-8134-debe511b1c71 tempest-VolumesSnapshotListTestJSON-465864726 None] Deleting offline snapshot 20dcb289-7197-41d8-974d-0a6728e736a1 of volume b01c7be6-aeb7-4079-8eb7-264dd1de1cb0 {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:27:06 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-ccc18efb-9ef4-4a37-8134-debe511b1c71 tempest-VolumesSnapshotListTestJSON-465864726 None] snapshot_file for this snap is: volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.20dcb289-7197-41d8-974d-0a6728e736a1 {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:27:06 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ef3b27-799e-4852-8ef2-5621e7a641e7]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:06 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ccc18efb-9ef4-4a37-8134-debe511b1c71 tempest-VolumesSnapshotListTestJSON-465864726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.20dcb289-7197-41d8-974d-0a6728e736a1 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:06 devstack sudo[88323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.20dcb289-7197-41d8-974d-0a6728e736a1
Feb 27 01:27:06 devstack sudo[88323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:06 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-53edfd78-336c-4459-8492-a64ebcd41770 tempest-VolumesTransfersV357Test-1699416551 None] Acquiring lock "cinder-6b42a527-2060-4221-b9cb-e60388081624-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:06 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-53edfd78-336c-4459-8492-a64ebcd41770 tempest-VolumesTransfersV357Test-1699416551 None] Lock "cinder-6b42a527-2060-4221-b9cb-e60388081624-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:06 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-53edfd78-336c-4459-8492-a64ebcd41770 tempest-VolumesTransfersV357Test-1699416551 None] Acquiring lock "cinder-quobyte-6b42a527-2060-4221-b9cb-e60388081624" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:06 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-53edfd78-336c-4459-8492-a64ebcd41770 tempest-VolumesTransfersV357Test-1699416551 None] Lock "cinder-quobyte-6b42a527-2060-4221-b9cb-e60388081624" acquired by "delete_volume" :: waited 0.011s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:06 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6c8f65-61d0-4c1c-bdcf-a97ba5c77937]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:06 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-53edfd78-336c-4459-8492-a64ebcd41770 tempest-VolumesTransfersV357Test-1699416551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-6b42a527-2060-4221-b9cb-e60388081624 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:07 devstack sudo[88325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-6b42a527-2060-4221-b9cb-e60388081624
Feb 27 01:27:07 devstack sudo[88325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:07 devstack sudo[88323]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:07 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ccc18efb-9ef4-4a37-8134-debe511b1c71 tempest-VolumesSnapshotListTestJSON-465864726 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.20dcb289-7197-41d8-974d-0a6728e736a1" returned: 0 in 0.749s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:07 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-ccc18efb-9ef4-4a37-8134-debe511b1c71 tempest-VolumesSnapshotListTestJSON-465864726 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83106) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:27:07 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ea7879-83f5-48fc-8b8f-44707e359269]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:07 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ccc18efb-9ef4-4a37-8134-debe511b1c71 tempest-VolumesSnapshotListTestJSON-465864726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:07 devstack sudo[88330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0
Feb 27 01:27:07 devstack sudo[88330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:07 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b5f648d-dd14-4229-a50c-7b674f44ecae tempest-VolumesSnapshotTestJSON-708792780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:27:07 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-0b5f648d-dd14-4229-a50c-7b674f44ecae tempest-VolumesSnapshotTestJSON-708792780 None] Flow 'volume_create_manager' (56b573ec-8e47-4329-90d1-8f829d73008d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:07 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-0b5f648d-dd14-4229-a50c-7b674f44ecae tempest-VolumesSnapshotTestJSON-708792780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e2d7a51-a013-43ac-96d5-d251633c43e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:07 devstack sudo[88325]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:07 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-53edfd78-336c-4459-8492-a64ebcd41770 tempest-VolumesTransfersV357Test-1699416551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-6b42a527-2060-4221-b9cb-e60388081624" returned: 0 in 0.747s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:07 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-53edfd78-336c-4459-8492-a64ebcd41770 tempest-VolumesTransfersV357Test-1699416551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-6b42a527-2060-4221-b9cb-e60388081624 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:07 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-0b5f648d-dd14-4229-a50c-7b674f44ecae tempest-VolumesSnapshotTestJSON-708792780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e2d7a51-a013-43ac-96d5-d251633c43e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-607947120',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdfef233-6041-4768-b97d-9b716d1bf479,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fba5f3accb0d428597d9c1a212708a1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:08Z,use_quota=True,user_id='4b8cb8c9a1344b09921d38d6e27d2878',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:07 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-0b5f648d-dd14-4229-a50c-7b674f44ecae tempest-VolumesSnapshotTestJSON-708792780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8813068-9823-421a-b277-a05eb5cad482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:07 devstack sudo[88335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-6b42a527-2060-4221-b9cb-e60388081624
Feb 27 01:27:07 devstack sudo[88335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:07 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-0b5f648d-dd14-4229-a50c-7b674f44ecae tempest-VolumesSnapshotTestJSON-708792780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8813068-9823-421a-b277-a05eb5cad482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:07 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-0b5f648d-dd14-4229-a50c-7b674f44ecae tempest-VolumesSnapshotTestJSON-708792780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14d57310-532c-48f5-91bf-029893479361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:07 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-0b5f648d-dd14-4229-a50c-7b674f44ecae tempest-VolumesSnapshotTestJSON-708792780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14d57310-532c-48f5-91bf-029893479361) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdfef233-6041-4768-b97d-9b716d1bf479', 'volume_name': 'volume-cdfef233-6041-4768-b97d-9b716d1bf479', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:07 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-0b5f648d-dd14-4229-a50c-7b674f44ecae tempest-VolumesSnapshotTestJSON-708792780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e46984a1-7356-460e-85ca-a4a233849c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:07 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-0b5f648d-dd14-4229-a50c-7b674f44ecae tempest-VolumesSnapshotTestJSON-708792780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e46984a1-7356-460e-85ca-a4a233849c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:07 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-0b5f648d-dd14-4229-a50c-7b674f44ecae tempest-VolumesSnapshotTestJSON-708792780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29f7e6b5-07c9-47d0-9aab-e9376191e87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:07 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-0b5f648d-dd14-4229-a50c-7b674f44ecae tempest-VolumesSnapshotTestJSON-708792780 None] Volume cdfef233-6041-4768-b97d-9b716d1bf479: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdfef233-6041-4768-b97d-9b716d1bf479', 'volume_size': 1}
Feb 27 01:27:07 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-0b5f648d-dd14-4229-a50c-7b674f44ecae tempest-VolumesSnapshotTestJSON-708792780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:07 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-0b5f648d-dd14-4229-a50c-7b674f44ecae tempest-VolumesSnapshotTestJSON-708792780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:07 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-0b5f648d-dd14-4229-a50c-7b674f44ecae tempest-VolumesSnapshotTestJSON-708792780 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-607947120',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdfef233-6041-4768-b97d-9b716d1bf479,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fba5f3accb0d428597d9c1a212708a1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:08Z,use_quota=True,user_id='4b8cb8c9a1344b09921d38d6e27d2878',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:27:07 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-0b5f648d-dd14-4229-a50c-7b674f44ecae tempest-VolumesSnapshotTestJSON-708792780 None] Creating volume cdfef233-6041-4768-b97d-9b716d1bf479 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:27:07 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-0b5f648d-dd14-4229-a50c-7b674f44ecae tempest-VolumesSnapshotTestJSON-708792780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:07 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-0b5f648d-dd14-4229-a50c-7b674f44ecae tempest-VolumesSnapshotTestJSON-708792780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:07 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-0b5f648d-dd14-4229-a50c-7b674f44ecae tempest-VolumesSnapshotTestJSON-708792780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:07 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-0b5f648d-dd14-4229-a50c-7b674f44ecae tempest-VolumesSnapshotTestJSON-708792780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:07 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-0b5f648d-dd14-4229-a50c-7b674f44ecae tempest-VolumesSnapshotTestJSON-708792780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:07 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-0b5f648d-dd14-4229-a50c-7b674f44ecae tempest-VolumesSnapshotTestJSON-708792780 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:27:07 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-0b5f648d-dd14-4229-a50c-7b674f44ecae tempest-VolumesSnapshotTestJSON-708792780 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:27:07 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0b5f648d-dd14-4229-a50c-7b674f44ecae tempest-VolumesSnapshotTestJSON-708792780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-cdfef233-6041-4768-b97d-9b716d1bf479 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:07 devstack sudo[88337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-cdfef233-6041-4768-b97d-9b716d1bf479 1073741824
Feb 27 01:27:07 devstack sudo[88337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:08 devstack sudo[88330]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:08 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ccc18efb-9ef4-4a37-8134-debe511b1c71 tempest-VolumesSnapshotListTestJSON-465864726 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0" returned: 0 in 0.724s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:08 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ccc18efb-9ef4-4a37-8134-debe511b1c71 tempest-VolumesSnapshotListTestJSON-465864726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.20dcb289-7197-41d8-974d-0a6728e736a1 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:08 devstack sudo[88342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.20dcb289-7197-41d8-974d-0a6728e736a1
Feb 27 01:27:08 devstack sudo[88342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:08 devstack sudo[88335]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:08 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-53edfd78-336c-4459-8492-a64ebcd41770 tempest-VolumesTransfersV357Test-1699416551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-6b42a527-2060-4221-b9cb-e60388081624" returned: 0 in 0.565s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:08 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-53edfd78-336c-4459-8492-a64ebcd41770 tempest-VolumesTransfersV357Test-1699416551 None] Lock "cinder-quobyte-6b42a527-2060-4221-b9cb-e60388081624" released by "delete_volume" :: held 1.343s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:08 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-53edfd78-336c-4459-8492-a64ebcd41770 tempest-VolumesTransfersV357Test-1699416551 None] Created reservations ['cb0b006d-67df-4b1f-8b8e-6871c3cbd430', 'bebd25e0-ce82-4023-b969-cb32eaf1c920', 'cfc20bac-aa4f-4cd3-ae12-8801a7144708', '07d63efe-3952-41cb-8a36-c8f8f76237f9'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:27:08 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-53edfd78-336c-4459-8492-a64ebcd41770 tempest-VolumesTransfersV357Test-1699416551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:08 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-53edfd78-336c-4459-8492-a64ebcd41770 tempest-VolumesTransfersV357Test-1699416551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:08 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-53edfd78-336c-4459-8492-a64ebcd41770 tempest-VolumesTransfersV357Test-1699416551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:08 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-53edfd78-336c-4459-8492-a64ebcd41770 tempest-VolumesTransfersV357Test-1699416551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:08 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-53edfd78-336c-4459-8492-a64ebcd41770 tempest-VolumesTransfersV357Test-1699416551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:08 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-53edfd78-336c-4459-8492-a64ebcd41770 tempest-VolumesTransfersV357Test-1699416551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:08 devstack sudo[88337]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:08 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0b5f648d-dd14-4229-a50c-7b674f44ecae tempest-VolumesSnapshotTestJSON-708792780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-cdfef233-6041-4768-b97d-9b716d1bf479 1073741824" returned: 0 in 0.665s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:08 devstack sudo[88348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:27:08 devstack sudo[88348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:08 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0b5f648d-dd14-4229-a50c-7b674f44ecae tempest-VolumesSnapshotTestJSON-708792780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-cdfef233-6041-4768-b97d-9b716d1bf479 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:08 devstack sudo[88350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-cdfef233-6041-4768-b97d-9b716d1bf479
Feb 27 01:27:08 devstack sudo[88350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:08 devstack sudo[88342]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:08 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ccc18efb-9ef4-4a37-8134-debe511b1c71 tempest-VolumesSnapshotListTestJSON-465864726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.20dcb289-7197-41d8-974d-0a6728e736a1" returned: 0 in 0.659s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:08 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ccc18efb-9ef4-4a37-8134-debe511b1c71 tempest-VolumesSnapshotListTestJSON-465864726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.20dcb289-7197-41d8-974d-0a6728e736a1 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:08 devstack sudo[88355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.20dcb289-7197-41d8-974d-0a6728e736a1
Feb 27 01:27:08 devstack sudo[88355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:08 devstack sudo[88348]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:08 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-53edfd78-336c-4459-8492-a64ebcd41770 tempest-VolumesTransfersV357Test-1699416551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.484s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:08 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-53edfd78-336c-4459-8492-a64ebcd41770 tempest-VolumesTransfersV357Test-1699416551 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:27:08 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-53edfd78-336c-4459-8492-a64ebcd41770 tempest-VolumesTransfersV357Test-1699416551 None] Deleted volume successfully.
Feb 27 01:27:08 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-53edfd78-336c-4459-8492-a64ebcd41770 tempest-VolumesTransfersV357Test-1699416551 None] Lock "cinder-6b42a527-2060-4221-b9cb-e60388081624-delete_volume" released by "delete_volume" :: held 2.055s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:09 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-05e248e0-d425-4d29-94a4-5e6aea24f7cc tempest-VolumesActionsTest-1945194074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:27:09 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-05e248e0-d425-4d29-94a4-5e6aea24f7cc tempest-VolumesActionsTest-1945194074 None] Flow 'volume_create_manager' (392da648-10c8-4bc8-a7c9-9c737cf7f64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:09 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-05e248e0-d425-4d29-94a4-5e6aea24f7cc tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bea6c61-6bcf-4d0e-9571-72e33baac410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:09 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-05e248e0-d425-4d29-94a4-5e6aea24f7cc tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bea6c61-6bcf-4d0e-9571-72e33baac410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-187817194',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b001c2c6-8bea-49bb-81c7-a7a16739f47a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be9dc0daf3794a089ad1aff6cd82e870',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:09Z,use_quota=True,user_id='c3f639f013f94fea9ca5469ad886c89b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:09 devstack sudo[88350]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:09 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-05e248e0-d425-4d29-94a4-5e6aea24f7cc tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7a6a3b1-7c86-4cf9-b269-0914f0c1846b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:09 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-05e248e0-d425-4d29-94a4-5e6aea24f7cc tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7a6a3b1-7c86-4cf9-b269-0914f0c1846b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:09 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-05e248e0-d425-4d29-94a4-5e6aea24f7cc tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a87f53de-a7c0-4942-b817-5e75bbed4538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:09 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-05e248e0-d425-4d29-94a4-5e6aea24f7cc tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a87f53de-a7c0-4942-b817-5e75bbed4538) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b001c2c6-8bea-49bb-81c7-a7a16739f47a', 'volume_name': 'volume-b001c2c6-8bea-49bb-81c7-a7a16739f47a', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:09 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-05e248e0-d425-4d29-94a4-5e6aea24f7cc tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef7394d9-c884-4bc5-ab65-088b6ce6374b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:09 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-05e248e0-d425-4d29-94a4-5e6aea24f7cc tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef7394d9-c884-4bc5-ab65-088b6ce6374b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:09 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-05e248e0-d425-4d29-94a4-5e6aea24f7cc tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4b4219a-6fa3-4663-871e-700e727a3696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:09 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-05e248e0-d425-4d29-94a4-5e6aea24f7cc tempest-VolumesActionsTest-1945194074 None] Volume b001c2c6-8bea-49bb-81c7-a7a16739f47a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b001c2c6-8bea-49bb-81c7-a7a16739f47a', 'volume_size': 1}
Feb 27 01:27:09 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-05e248e0-d425-4d29-94a4-5e6aea24f7cc tempest-VolumesActionsTest-1945194074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:09 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0b5f648d-dd14-4229-a50c-7b674f44ecae tempest-VolumesSnapshotTestJSON-708792780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-cdfef233-6041-4768-b97d-9b716d1bf479" returned: 0 in 0.746s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:09 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-0b5f648d-dd14-4229-a50c-7b674f44ecae tempest-VolumesSnapshotTestJSON-708792780 None] <== create_volume: return (1456ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:27:09 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-0b5f648d-dd14-4229-a50c-7b674f44ecae tempest-VolumesSnapshotTestJSON-708792780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.459s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:09 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-05e248e0-d425-4d29-94a4-5e6aea24f7cc tempest-VolumesActionsTest-1945194074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:09 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-05e248e0-d425-4d29-94a4-5e6aea24f7cc tempest-VolumesActionsTest-1945194074 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-187817194',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b001c2c6-8bea-49bb-81c7-a7a16739f47a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be9dc0daf3794a089ad1aff6cd82e870',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:09Z,use_quota=True,user_id='c3f639f013f94fea9ca5469ad886c89b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:27:09 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-05e248e0-d425-4d29-94a4-5e6aea24f7cc tempest-VolumesActionsTest-1945194074 None] Creating volume b001c2c6-8bea-49bb-81c7-a7a16739f47a {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:27:09 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-05e248e0-d425-4d29-94a4-5e6aea24f7cc tempest-VolumesActionsTest-1945194074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:09 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-05e248e0-d425-4d29-94a4-5e6aea24f7cc tempest-VolumesActionsTest-1945194074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:09 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-05e248e0-d425-4d29-94a4-5e6aea24f7cc tempest-VolumesActionsTest-1945194074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:09 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-05e248e0-d425-4d29-94a4-5e6aea24f7cc tempest-VolumesActionsTest-1945194074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:09 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-05e248e0-d425-4d29-94a4-5e6aea24f7cc tempest-VolumesActionsTest-1945194074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:09 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-05e248e0-d425-4d29-94a4-5e6aea24f7cc tempest-VolumesActionsTest-1945194074 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:27:09 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-05e248e0-d425-4d29-94a4-5e6aea24f7cc tempest-VolumesActionsTest-1945194074 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:27:09 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-05e248e0-d425-4d29-94a4-5e6aea24f7cc tempest-VolumesActionsTest-1945194074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b001c2c6-8bea-49bb-81c7-a7a16739f47a 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:09 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-0b5f648d-dd14-4229-a50c-7b674f44ecae tempest-VolumesSnapshotTestJSON-708792780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29f7e6b5-07c9-47d0-9aab-e9376191e87c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdfef233-6041-4768-b97d-9b716d1bf479', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:09 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-0b5f648d-dd14-4229-a50c-7b674f44ecae tempest-VolumesSnapshotTestJSON-708792780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86a21b13-a810-4317-b4b2-37aadd4e27b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:09 devstack sudo[88359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b001c2c6-8bea-49bb-81c7-a7a16739f47a 1073741824
Feb 27 01:27:09 devstack sudo[88359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:09 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-0b5f648d-dd14-4229-a50c-7b674f44ecae tempest-VolumesSnapshotTestJSON-708792780 None] Volume volume-cdfef233-6041-4768-b97d-9b716d1bf479 (cdfef233-6041-4768-b97d-9b716d1bf479): created successfully
Feb 27 01:27:09 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-0b5f648d-dd14-4229-a50c-7b674f44ecae tempest-VolumesSnapshotTestJSON-708792780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86a21b13-a810-4317-b4b2-37aadd4e27b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:09 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-0b5f648d-dd14-4229-a50c-7b674f44ecae tempest-VolumesSnapshotTestJSON-708792780 None] Flow 'volume_create_manager' (56b573ec-8e47-4329-90d1-8f829d73008d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:09 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-0b5f648d-dd14-4229-a50c-7b674f44ecae tempest-VolumesSnapshotTestJSON-708792780 None] Created volume successfully.
Feb 27 01:27:09 devstack sudo[88355]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:09 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ccc18efb-9ef4-4a37-8134-debe511b1c71 tempest-VolumesSnapshotListTestJSON-465864726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0.20dcb289-7197-41d8-974d-0a6728e736a1" returned: 0 in 0.616s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:09 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-ccc18efb-9ef4-4a37-8134-debe511b1c71 tempest-VolumesSnapshotListTestJSON-465864726 None] Lock "cinder-quobyte-20dcb289-7197-41d8-974d-0a6728e736a1" released by "_delete_snapshot" :: held 2.856s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:09 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-ccc18efb-9ef4-4a37-8134-debe511b1c71 tempest-VolumesSnapshotListTestJSON-465864726 None] Lock "cinder-quobyte-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0" released by "delete_snapshot" :: held 2.873s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:09 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-00b26833-6256-482a-af24-17c91283c95a tempest-VolumesTransfersV357Test-2048174445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:27:09 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-00b26833-6256-482a-af24-17c91283c95a tempest-VolumesTransfersV357Test-2048174445 None] Flow 'volume_create_manager' (22b18529-78c2-41d6-b94e-c26c0d4df4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:09 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-00b26833-6256-482a-af24-17c91283c95a tempest-VolumesTransfersV357Test-2048174445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3605697-5eb2-42a0-8b0a-3036a8acb304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:09 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-00b26833-6256-482a-af24-17c91283c95a tempest-VolumesTransfersV357Test-2048174445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3605697-5eb2-42a0-8b0a-3036a8acb304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-931285710',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a5d2dac-7a35-43a1-99fd-20adf2647ef6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e29938d268c54e0a80b694dc33b35082',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:09Z,use_quota=True,user_id='3e01f8df8e9f48af98045b0433c708e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:09 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-00b26833-6256-482a-af24-17c91283c95a tempest-VolumesTransfersV357Test-2048174445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e92a03a-5443-44b0-9c6d-7107fe28ed7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:09 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-00b26833-6256-482a-af24-17c91283c95a tempest-VolumesTransfersV357Test-2048174445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e92a03a-5443-44b0-9c6d-7107fe28ed7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:09 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-00b26833-6256-482a-af24-17c91283c95a tempest-VolumesTransfersV357Test-2048174445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d5f216c-e788-43c0-86f9-677e3df269fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:09 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-00b26833-6256-482a-af24-17c91283c95a tempest-VolumesTransfersV357Test-2048174445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d5f216c-e788-43c0-86f9-677e3df269fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a5d2dac-7a35-43a1-99fd-20adf2647ef6', 'volume_name': 'volume-6a5d2dac-7a35-43a1-99fd-20adf2647ef6', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:09 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-00b26833-6256-482a-af24-17c91283c95a tempest-VolumesTransfersV357Test-2048174445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b57d51a-46a6-465e-8d7d-3b3e690b3ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:09 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-00b26833-6256-482a-af24-17c91283c95a tempest-VolumesTransfersV357Test-2048174445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b57d51a-46a6-465e-8d7d-3b3e690b3ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:09 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-00b26833-6256-482a-af24-17c91283c95a tempest-VolumesTransfersV357Test-2048174445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2e7761a-ecb1-4b10-927c-1fe484dd8c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:09 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-00b26833-6256-482a-af24-17c91283c95a tempest-VolumesTransfersV357Test-2048174445 None] Volume 6a5d2dac-7a35-43a1-99fd-20adf2647ef6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a5d2dac-7a35-43a1-99fd-20adf2647ef6', 'volume_size': 1}
Feb 27 01:27:09 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-00b26833-6256-482a-af24-17c91283c95a tempest-VolumesTransfersV357Test-2048174445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:09 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-ccc18efb-9ef4-4a37-8134-debe511b1c71 tempest-VolumesSnapshotListTestJSON-465864726 None] Created reservations ['ea9a4f25-7a27-4baa-aff0-a36f65d55ff9', 'c4fcf83f-9c6a-4cbd-ae3c-91ba990007f5', 'b931d4ce-0543-4b16-93e2-017ab9585d89', 'd5260bb9-1d46-4edb-bb51-8d7eef5b801a'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:27:09 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-ccc18efb-9ef4-4a37-8134-debe511b1c71 tempest-VolumesSnapshotListTestJSON-465864726 None] Delete snapshot completed successfully.
Feb 27 01:27:09 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-ccc18efb-9ef4-4a37-8134-debe511b1c71 tempest-VolumesSnapshotListTestJSON-465864726 None] Lock "cinder-20dcb289-7197-41d8-974d-0a6728e736a1-delete_snapshot" released by "delete_snapshot" :: held 3.045s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:09 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-e5bf673f-2fba-4e3b-9282-5a81d5034d71 tempest-VolumesSnapshotListTestJSON-465864726 None] Acquiring lock "cinder-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:09 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-e5bf673f-2fba-4e3b-9282-5a81d5034d71 tempest-VolumesSnapshotListTestJSON-465864726 None] Lock "cinder-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:09 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-e5bf673f-2fba-4e3b-9282-5a81d5034d71 tempest-VolumesSnapshotListTestJSON-465864726 None] Acquiring lock "cinder-quobyte-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:09 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-e5bf673f-2fba-4e3b-9282-5a81d5034d71 tempest-VolumesSnapshotListTestJSON-465864726 None] Lock "cinder-quobyte-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0" acquired by "delete_volume" :: waited 0.015s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:09 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1797e42-d0d6-4859-a39a-1f8f4ea2bedb]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:09 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-e5bf673f-2fba-4e3b-9282-5a81d5034d71 tempest-VolumesSnapshotListTestJSON-465864726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:09 devstack sudo[88359]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:09 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-05e248e0-d425-4d29-94a4-5e6aea24f7cc tempest-VolumesActionsTest-1945194074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b001c2c6-8bea-49bb-81c7-a7a16739f47a 1073741824" returned: 0 in 0.722s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:09 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-11ea10e1-716a-4200-95f6-ceae410b55c3 tempest-VolumesSnapshotTestJSON-708792780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:09 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-05e248e0-d425-4d29-94a4-5e6aea24f7cc tempest-VolumesActionsTest-1945194074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b001c2c6-8bea-49bb-81c7-a7a16739f47a {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:09 devstack sudo[88365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0
Feb 27 01:27:09 devstack sudo[88365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:09 devstack sudo[88367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b001c2c6-8bea-49bb-81c7-a7a16739f47a
Feb 27 01:27:09 devstack sudo[88367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:10 devstack sudo[88365]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:10 devstack sudo[88367]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:10 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-e5bf673f-2fba-4e3b-9282-5a81d5034d71 tempest-VolumesSnapshotListTestJSON-465864726 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0" returned: 0 in 0.585s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:10 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-e5bf673f-2fba-4e3b-9282-5a81d5034d71 tempest-VolumesSnapshotListTestJSON-465864726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:10 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-05e248e0-d425-4d29-94a4-5e6aea24f7cc tempest-VolumesActionsTest-1945194074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b001c2c6-8bea-49bb-81c7-a7a16739f47a" returned: 0 in 0.491s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:10 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-05e248e0-d425-4d29-94a4-5e6aea24f7cc tempest-VolumesActionsTest-1945194074 None] <== create_volume: return (1251ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:27:10 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-05e248e0-d425-4d29-94a4-5e6aea24f7cc tempest-VolumesActionsTest-1945194074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.256s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:10 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-00b26833-6256-482a-af24-17c91283c95a tempest-VolumesTransfersV357Test-2048174445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.955s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:10 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-00b26833-6256-482a-af24-17c91283c95a tempest-VolumesTransfersV357Test-2048174445 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-931285710',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a5d2dac-7a35-43a1-99fd-20adf2647ef6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e29938d268c54e0a80b694dc33b35082',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:09Z,use_quota=True,user_id='3e01f8df8e9f48af98045b0433c708e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:27:10 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-00b26833-6256-482a-af24-17c91283c95a tempest-VolumesTransfersV357Test-2048174445 None] Creating volume 6a5d2dac-7a35-43a1-99fd-20adf2647ef6 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:27:10 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-00b26833-6256-482a-af24-17c91283c95a tempest-VolumesTransfersV357Test-2048174445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:10 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-00b26833-6256-482a-af24-17c91283c95a tempest-VolumesTransfersV357Test-2048174445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:10 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-00b26833-6256-482a-af24-17c91283c95a tempest-VolumesTransfersV357Test-2048174445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:10 devstack sudo[88373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0
Feb 27 01:27:10 devstack sudo[88373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:10 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-00b26833-6256-482a-af24-17c91283c95a tempest-VolumesTransfersV357Test-2048174445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:10 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-00b26833-6256-482a-af24-17c91283c95a tempest-VolumesTransfersV357Test-2048174445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:10 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-00b26833-6256-482a-af24-17c91283c95a tempest-VolumesTransfersV357Test-2048174445 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:27:10 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-00b26833-6256-482a-af24-17c91283c95a tempest-VolumesTransfersV357Test-2048174445 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:27:10 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-00b26833-6256-482a-af24-17c91283c95a tempest-VolumesTransfersV357Test-2048174445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-6a5d2dac-7a35-43a1-99fd-20adf2647ef6 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:10 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-05e248e0-d425-4d29-94a4-5e6aea24f7cc tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4b4219a-6fa3-4663-871e-700e727a3696) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b001c2c6-8bea-49bb-81c7-a7a16739f47a', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:10 devstack sudo[88375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-6a5d2dac-7a35-43a1-99fd-20adf2647ef6 1073741824
Feb 27 01:27:10 devstack sudo[88375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:10 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-05e248e0-d425-4d29-94a4-5e6aea24f7cc tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06e62b23-84a0-4fa8-ac0a-c515b6ea67f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:10 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-05e248e0-d425-4d29-94a4-5e6aea24f7cc tempest-VolumesActionsTest-1945194074 None] Volume volume-b001c2c6-8bea-49bb-81c7-a7a16739f47a (b001c2c6-8bea-49bb-81c7-a7a16739f47a): created successfully
Feb 27 01:27:10 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-05e248e0-d425-4d29-94a4-5e6aea24f7cc tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06e62b23-84a0-4fa8-ac0a-c515b6ea67f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:10 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-05e248e0-d425-4d29-94a4-5e6aea24f7cc tempest-VolumesActionsTest-1945194074 None] Flow 'volume_create_manager' (392da648-10c8-4bc8-a7c9-9c737cf7f64f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:10 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-05e248e0-d425-4d29-94a4-5e6aea24f7cc tempest-VolumesActionsTest-1945194074 None] Created volume successfully.
Feb 27 01:27:10 devstack sudo[88373]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:10 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-e5bf673f-2fba-4e3b-9282-5a81d5034d71 tempest-VolumesSnapshotListTestJSON-465864726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0" returned: 0 in 0.511s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:10 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-e5bf673f-2fba-4e3b-9282-5a81d5034d71 tempest-VolumesSnapshotListTestJSON-465864726 None] Lock "cinder-quobyte-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0" released by "delete_volume" :: held 1.136s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:10 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-e5bf673f-2fba-4e3b-9282-5a81d5034d71 tempest-VolumesSnapshotListTestJSON-465864726 None] Created reservations ['e7d2e40a-ebc1-4c36-af5a-546756bd467c', '68eee020-fe3b-49c8-a0f2-4c6f2559d8fe', 'ebb6f3db-d38f-4be0-8503-5f335602dc87', '3c251360-b6a1-412e-9665-57bdf9aac7a6'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:27:11 devstack sudo[88375]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:11 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-00b26833-6256-482a-af24-17c91283c95a tempest-VolumesTransfersV357Test-2048174445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-6a5d2dac-7a35-43a1-99fd-20adf2647ef6 1073741824" returned: 0 in 0.559s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:11 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-e5bf673f-2fba-4e3b-9282-5a81d5034d71 tempest-VolumesSnapshotListTestJSON-465864726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:11 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-e5bf673f-2fba-4e3b-9282-5a81d5034d71 tempest-VolumesSnapshotListTestJSON-465864726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:11 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-e5bf673f-2fba-4e3b-9282-5a81d5034d71 tempest-VolumesSnapshotListTestJSON-465864726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:11 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-e5bf673f-2fba-4e3b-9282-5a81d5034d71 tempest-VolumesSnapshotListTestJSON-465864726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:11 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-e5bf673f-2fba-4e3b-9282-5a81d5034d71 tempest-VolumesSnapshotListTestJSON-465864726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:11 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-e5bf673f-2fba-4e3b-9282-5a81d5034d71 tempest-VolumesSnapshotListTestJSON-465864726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:11 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-00b26833-6256-482a-af24-17c91283c95a tempest-VolumesTransfersV357Test-2048174445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-6a5d2dac-7a35-43a1-99fd-20adf2647ef6 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:11 devstack sudo[88381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:27:11 devstack sudo[88381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:11 devstack sudo[88382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-6a5d2dac-7a35-43a1-99fd-20adf2647ef6
Feb 27 01:27:11 devstack sudo[88382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:11 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-69a2eb8e-fd41-4bd1-a72b-d24f069d5aa4 tempest-VolumesActionsTest-1938141483 None] Acquiring lock "cinder-b001c2c6-8bea-49bb-81c7-a7a16739f47a-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:11 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-69a2eb8e-fd41-4bd1-a72b-d24f069d5aa4 tempest-VolumesActionsTest-1938141483 None] Lock "cinder-b001c2c6-8bea-49bb-81c7-a7a16739f47a-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:11 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-69a2eb8e-fd41-4bd1-a72b-d24f069d5aa4 tempest-VolumesActionsTest-1938141483 None] Acquiring lock "cinder-quobyte-b001c2c6-8bea-49bb-81c7-a7a16739f47a" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:11 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-69a2eb8e-fd41-4bd1-a72b-d24f069d5aa4 tempest-VolumesActionsTest-1938141483 None] Lock "cinder-quobyte-b001c2c6-8bea-49bb-81c7-a7a16739f47a" acquired by "delete_volume" :: waited 0.013s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:11 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1aa09f2-d7a3-4dce-bde2-422078bf1a11]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:11 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-69a2eb8e-fd41-4bd1-a72b-d24f069d5aa4 tempest-VolumesActionsTest-1938141483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b001c2c6-8bea-49bb-81c7-a7a16739f47a {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:11 devstack sudo[88381]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:11 devstack sudo[88382]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:11 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-e5bf673f-2fba-4e3b-9282-5a81d5034d71 tempest-VolumesSnapshotListTestJSON-465864726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.508s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:11 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-e5bf673f-2fba-4e3b-9282-5a81d5034d71 tempest-VolumesSnapshotListTestJSON-465864726 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:27:11 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-00b26833-6256-482a-af24-17c91283c95a tempest-VolumesTransfersV357Test-2048174445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-6a5d2dac-7a35-43a1-99fd-20adf2647ef6" returned: 0 in 0.499s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:11 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-00b26833-6256-482a-af24-17c91283c95a tempest-VolumesTransfersV357Test-2048174445 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:27:11 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-00b26833-6256-482a-af24-17c91283c95a tempest-VolumesTransfersV357Test-2048174445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:11 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-11ea10e1-716a-4200-95f6-ceae410b55c3 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.651s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:11 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-e5bf673f-2fba-4e3b-9282-5a81d5034d71 tempest-VolumesSnapshotListTestJSON-465864726 None] Deleted volume successfully.
Feb 27 01:27:11 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-00b26833-6256-482a-af24-17c91283c95a tempest-VolumesTransfersV357Test-2048174445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2e7761a-ecb1-4b10-927c-1fe484dd8c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a5d2dac-7a35-43a1-99fd-20adf2647ef6', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:11 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-00b26833-6256-482a-af24-17c91283c95a tempest-VolumesTransfersV357Test-2048174445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dba30f58-cd10-40af-9bed-9e8b93f4b2ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:11 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-11ea10e1-716a-4200-95f6-ceae410b55c3 tempest-VolumesSnapshotTestJSON-708792780 None] Creating offline snapshot 74ae11bb-fe6a-48a5-aeba-dcbd7e915c64 of volume cdfef233-6041-4768-b97d-9b716d1bf479 {{(pid=83106) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:27:11 devstack sudo[88387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b001c2c6-8bea-49bb-81c7-a7a16739f47a
Feb 27 01:27:11 devstack sudo[88387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:11 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-e5bf673f-2fba-4e3b-9282-5a81d5034d71 tempest-VolumesSnapshotListTestJSON-465864726 None] Lock "cinder-b01c7be6-aeb7-4079-8eb7-264dd1de1cb0-delete_volume" released by "delete_volume" :: held 1.864s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:11 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[f401a5a4-b16a-42b5-abef-3e75b1a15148]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:11 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-11ea10e1-716a-4200-95f6-ceae410b55c3 tempest-VolumesSnapshotTestJSON-708792780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-cdfef233-6041-4768-b97d-9b716d1bf479 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:11 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-00b26833-6256-482a-af24-17c91283c95a tempest-VolumesTransfersV357Test-2048174445 None] Volume volume-6a5d2dac-7a35-43a1-99fd-20adf2647ef6 (6a5d2dac-7a35-43a1-99fd-20adf2647ef6): created successfully
Feb 27 01:27:11 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-00b26833-6256-482a-af24-17c91283c95a tempest-VolumesTransfersV357Test-2048174445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dba30f58-cd10-40af-9bed-9e8b93f4b2ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:11 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-00b26833-6256-482a-af24-17c91283c95a tempest-VolumesTransfersV357Test-2048174445 None] Flow 'volume_create_manager' (22b18529-78c2-41d6-b94e-c26c0d4df4f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:11 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-00b26833-6256-482a-af24-17c91283c95a tempest-VolumesTransfersV357Test-2048174445 None] Created volume successfully.
Feb 27 01:27:11 devstack sudo[88389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-cdfef233-6041-4768-b97d-9b716d1bf479
Feb 27 01:27:11 devstack sudo[88389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:12 devstack sudo[88387]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:12 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-69a2eb8e-fd41-4bd1-a72b-d24f069d5aa4 tempest-VolumesActionsTest-1938141483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b001c2c6-8bea-49bb-81c7-a7a16739f47a" returned: 0 in 0.595s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:12 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-69a2eb8e-fd41-4bd1-a72b-d24f069d5aa4 tempest-VolumesActionsTest-1938141483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b001c2c6-8bea-49bb-81c7-a7a16739f47a {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:12 devstack sudo[88397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b001c2c6-8bea-49bb-81c7-a7a16739f47a
Feb 27 01:27:12 devstack sudo[88397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:12 devstack sudo[88389]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:12 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-11ea10e1-716a-4200-95f6-ceae410b55c3 tempest-VolumesSnapshotTestJSON-708792780 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-cdfef233-6041-4768-b97d-9b716d1bf479" returned: 0 in 0.514s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:12 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-11ea10e1-716a-4200-95f6-ceae410b55c3 tempest-VolumesSnapshotTestJSON-708792780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-cdfef233-6041-4768-b97d-9b716d1bf479,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-cdfef233-6041-4768-b97d-9b716d1bf479.74ae11bb-fe6a-48a5-aeba-dcbd7e915c64 1G {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:12 devstack sudo[88399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-cdfef233-6041-4768-b97d-9b716d1bf479,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-cdfef233-6041-4768-b97d-9b716d1bf479.74ae11bb-fe6a-48a5-aeba-dcbd7e915c64 1G
Feb 27 01:27:12 devstack sudo[88399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:12 devstack sudo[88397]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:12 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-69a2eb8e-fd41-4bd1-a72b-d24f069d5aa4 tempest-VolumesActionsTest-1938141483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b001c2c6-8bea-49bb-81c7-a7a16739f47a" returned: 0 in 0.479s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:12 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-69a2eb8e-fd41-4bd1-a72b-d24f069d5aa4 tempest-VolumesActionsTest-1938141483 None] Lock "cinder-quobyte-b001c2c6-8bea-49bb-81c7-a7a16739f47a" released by "delete_volume" :: held 1.128s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:12 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-69a2eb8e-fd41-4bd1-a72b-d24f069d5aa4 tempest-VolumesActionsTest-1938141483 None] Created reservations ['0516ed43-b6fa-45b3-a06c-c60987794103', '164f7efb-5636-4faf-9cf1-2269276073ca', 'e1a6dd29-5435-4e04-ae25-741c5af51d81', 'c9755ac8-b4f2-4ffd-9e8b-1b9c13c55911'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:27:12 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-69a2eb8e-fd41-4bd1-a72b-d24f069d5aa4 tempest-VolumesActionsTest-1938141483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:12 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-69a2eb8e-fd41-4bd1-a72b-d24f069d5aa4 tempest-VolumesActionsTest-1938141483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:12 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-69a2eb8e-fd41-4bd1-a72b-d24f069d5aa4 tempest-VolumesActionsTest-1938141483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:12 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-69a2eb8e-fd41-4bd1-a72b-d24f069d5aa4 tempest-VolumesActionsTest-1938141483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:12 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-69a2eb8e-fd41-4bd1-a72b-d24f069d5aa4 tempest-VolumesActionsTest-1938141483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:12 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-69a2eb8e-fd41-4bd1-a72b-d24f069d5aa4 tempest-VolumesActionsTest-1938141483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:12 devstack sudo[88405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:27:12 devstack sudo[88405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:12 devstack sudo[88399]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:12 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-11ea10e1-716a-4200-95f6-ceae410b55c3 tempest-VolumesSnapshotTestJSON-708792780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-cdfef233-6041-4768-b97d-9b716d1bf479,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-cdfef233-6041-4768-b97d-9b716d1bf479.74ae11bb-fe6a-48a5-aeba-dcbd7e915c64 1G" returned: 0 in 0.633s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:12 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-11ea10e1-716a-4200-95f6-ceae410b55c3 tempest-VolumesSnapshotTestJSON-708792780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cdfef233-6041-4768-b97d-9b716d1bf479 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-cdfef233-6041-4768-b97d-9b716d1bf479.74ae11bb-fe6a-48a5-aeba-dcbd7e915c64 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:12 devstack sudo[88407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cdfef233-6041-4768-b97d-9b716d1bf479 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-cdfef233-6041-4768-b97d-9b716d1bf479.74ae11bb-fe6a-48a5-aeba-dcbd7e915c64
Feb 27 01:27:12 devstack sudo[88407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:12 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-ab8f970b-f9e6-4014-87ef-aabf4d493dd0 tempest-VolumesTransfersV357Test-1699416551 None] Acquiring lock "cinder-6a5d2dac-7a35-43a1-99fd-20adf2647ef6-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:13 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-ab8f970b-f9e6-4014-87ef-aabf4d493dd0 tempest-VolumesTransfersV357Test-1699416551 None] Lock "cinder-6a5d2dac-7a35-43a1-99fd-20adf2647ef6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:13 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-ab8f970b-f9e6-4014-87ef-aabf4d493dd0 tempest-VolumesTransfersV357Test-1699416551 None] Acquiring lock "cinder-quobyte-6a5d2dac-7a35-43a1-99fd-20adf2647ef6" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:13 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-ab8f970b-f9e6-4014-87ef-aabf4d493dd0 tempest-VolumesTransfersV357Test-1699416551 None] Lock "cinder-quobyte-6a5d2dac-7a35-43a1-99fd-20adf2647ef6" acquired by "delete_volume" :: waited 0.014s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:13 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6bef50-6d72-4eb4-a983-2f1812b1028d]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:13 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ab8f970b-f9e6-4014-87ef-aabf4d493dd0 tempest-VolumesTransfersV357Test-1699416551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-6a5d2dac-7a35-43a1-99fd-20adf2647ef6 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:13 devstack sudo[88410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-6a5d2dac-7a35-43a1-99fd-20adf2647ef6
Feb 27 01:27:13 devstack sudo[88410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:13 devstack sudo[88405]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:13 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-69a2eb8e-fd41-4bd1-a72b-d24f069d5aa4 tempest-VolumesActionsTest-1938141483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.529s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:13 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-69a2eb8e-fd41-4bd1-a72b-d24f069d5aa4 tempest-VolumesActionsTest-1938141483 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:27:13 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-69a2eb8e-fd41-4bd1-a72b-d24f069d5aa4 tempest-VolumesActionsTest-1938141483 None] Deleted volume successfully.
Feb 27 01:27:13 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-69a2eb8e-fd41-4bd1-a72b-d24f069d5aa4 tempest-VolumesActionsTest-1938141483 None] Lock "cinder-b001c2c6-8bea-49bb-81c7-a7a16739f47a-delete_volume" released by "delete_volume" :: held 1.870s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:13 devstack sudo[88407]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:13 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-11ea10e1-716a-4200-95f6-ceae410b55c3 tempest-VolumesSnapshotTestJSON-708792780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cdfef233-6041-4768-b97d-9b716d1bf479 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-cdfef233-6041-4768-b97d-9b716d1bf479.74ae11bb-fe6a-48a5-aeba-dcbd7e915c64" returned: 0 in 0.579s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:13 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-11ea10e1-716a-4200-95f6-ceae410b55c3 tempest-VolumesSnapshotTestJSON-708792780 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-cdfef233-6041-4768-b97d-9b716d1bf479.74ae11bb-fe6a-48a5-aeba-dcbd7e915c64 is being set with open permissions: ugo+rw
Feb 27 01:27:13 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-11ea10e1-716a-4200-95f6-ceae410b55c3 tempest-VolumesSnapshotTestJSON-708792780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-cdfef233-6041-4768-b97d-9b716d1bf479.74ae11bb-fe6a-48a5-aeba-dcbd7e915c64 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:13 devstack sudo[88416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-cdfef233-6041-4768-b97d-9b716d1bf479.74ae11bb-fe6a-48a5-aeba-dcbd7e915c64
Feb 27 01:27:13 devstack sudo[88416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:13 devstack sudo[88410]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:13 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ab8f970b-f9e6-4014-87ef-aabf4d493dd0 tempest-VolumesTransfersV357Test-1699416551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-6a5d2dac-7a35-43a1-99fd-20adf2647ef6" returned: 0 in 0.541s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:13 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ab8f970b-f9e6-4014-87ef-aabf4d493dd0 tempest-VolumesTransfersV357Test-1699416551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-6a5d2dac-7a35-43a1-99fd-20adf2647ef6 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:13 devstack sudo[88421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-6a5d2dac-7a35-43a1-99fd-20adf2647ef6
Feb 27 01:27:13 devstack sudo[88421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:13 devstack sudo[88416]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:13 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-11ea10e1-716a-4200-95f6-ceae410b55c3 tempest-VolumesSnapshotTestJSON-708792780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-cdfef233-6041-4768-b97d-9b716d1bf479.74ae11bb-fe6a-48a5-aeba-dcbd7e915c64" returned: 0 in 0.487s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:13 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-11ea10e1-716a-4200-95f6-ceae410b55c3 tempest-VolumesSnapshotTestJSON-708792780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-cdfef233-6041-4768-b97d-9b716d1bf479.info {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:13 devstack sudo[88424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-cdfef233-6041-4768-b97d-9b716d1bf479.info
Feb 27 01:27:13 devstack sudo[88424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:13 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-d53787d0-5d78-4482-a985-cd31e7b82273 tempest-VolumesActionsTest-1945194074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:27:13 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d53787d0-5d78-4482-a985-cd31e7b82273 tempest-VolumesActionsTest-1945194074 None] Flow 'volume_create_manager' (accde2cf-96a1-4b0b-93d7-e5d743780ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:13 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d53787d0-5d78-4482-a985-cd31e7b82273 tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3df67db-6d00-4e44-8d1e-7b30c8cb2cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:13 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d53787d0-5d78-4482-a985-cd31e7b82273 tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3df67db-6d00-4e44-8d1e-7b30c8cb2cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-874063340',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea4ba313-8035-4664-b5a7-d6f67c51d8c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be9dc0daf3794a089ad1aff6cd82e870',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:14Z,use_quota=True,user_id='c3f639f013f94fea9ca5469ad886c89b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:14 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d53787d0-5d78-4482-a985-cd31e7b82273 tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (776ce019-bc83-4db7-b3a0-73cb3045af25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:14 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d53787d0-5d78-4482-a985-cd31e7b82273 tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (776ce019-bc83-4db7-b3a0-73cb3045af25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:14 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d53787d0-5d78-4482-a985-cd31e7b82273 tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da964cf2-b2ae-4d60-acc7-f01692bbdd35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:14 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d53787d0-5d78-4482-a985-cd31e7b82273 tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da964cf2-b2ae-4d60-acc7-f01692bbdd35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea4ba313-8035-4664-b5a7-d6f67c51d8c1', 'volume_name': 'volume-ea4ba313-8035-4664-b5a7-d6f67c51d8c1', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:14 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d53787d0-5d78-4482-a985-cd31e7b82273 tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1009ce0b-1575-44e3-9ab6-05b805ee51f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:14 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d53787d0-5d78-4482-a985-cd31e7b82273 tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1009ce0b-1575-44e3-9ab6-05b805ee51f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:14 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d53787d0-5d78-4482-a985-cd31e7b82273 tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e690372b-9e84-47bd-8f92-f8ff3a20031a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:14 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-d53787d0-5d78-4482-a985-cd31e7b82273 tempest-VolumesActionsTest-1945194074 None] Volume ea4ba313-8035-4664-b5a7-d6f67c51d8c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea4ba313-8035-4664-b5a7-d6f67c51d8c1', 'volume_size': 1}
Feb 27 01:27:14 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-d53787d0-5d78-4482-a985-cd31e7b82273 tempest-VolumesActionsTest-1945194074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:14 devstack sudo[88421]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:14 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ab8f970b-f9e6-4014-87ef-aabf4d493dd0 tempest-VolumesTransfersV357Test-1699416551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-6a5d2dac-7a35-43a1-99fd-20adf2647ef6" returned: 0 in 0.444s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:14 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-ab8f970b-f9e6-4014-87ef-aabf4d493dd0 tempest-VolumesTransfersV357Test-1699416551 None] Lock "cinder-quobyte-6a5d2dac-7a35-43a1-99fd-20adf2647ef6" released by "delete_volume" :: held 1.020s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:14 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-ab8f970b-f9e6-4014-87ef-aabf4d493dd0 tempest-VolumesTransfersV357Test-1699416551 None] Created reservations ['15b1f28e-9e34-49d9-a17a-ae5af7420a75', '52636998-c1cf-45d4-8864-af0c26479852', '9794b35b-0edd-478a-a901-d9775b4d5189', 'b833ad5c-827b-4247-9bdf-a1a9d48bcd71'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:27:14 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-ab8f970b-f9e6-4014-87ef-aabf4d493dd0 tempest-VolumesTransfersV357Test-1699416551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:14 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-ab8f970b-f9e6-4014-87ef-aabf4d493dd0 tempest-VolumesTransfersV357Test-1699416551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:14 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-ab8f970b-f9e6-4014-87ef-aabf4d493dd0 tempest-VolumesTransfersV357Test-1699416551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:14 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-ab8f970b-f9e6-4014-87ef-aabf4d493dd0 tempest-VolumesTransfersV357Test-1699416551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:14 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-ab8f970b-f9e6-4014-87ef-aabf4d493dd0 tempest-VolumesTransfersV357Test-1699416551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:14 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ab8f970b-f9e6-4014-87ef-aabf4d493dd0 tempest-VolumesTransfersV357Test-1699416551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:14 devstack sudo[88427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:27:14 devstack sudo[88427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:14 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-3052cb82-159c-4f8c-ba14-69c2d8d4cb32 tempest-CreateVolumesFromImageTest-1065198505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:27:14 devstack sudo[88424]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:14 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-3052cb82-159c-4f8c-ba14-69c2d8d4cb32 tempest-CreateVolumesFromImageTest-1065198505 None] Flow 'volume_create_manager' (7b8b8e30-09f9-416a-97a3-e156aa75a4e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:14 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-3052cb82-159c-4f8c-ba14-69c2d8d4cb32 tempest-CreateVolumesFromImageTest-1065198505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3276924c-710d-4ea6-8b53-e6c1063c1381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:14 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-11ea10e1-716a-4200-95f6-ceae410b55c3 tempest-VolumesSnapshotTestJSON-708792780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-cdfef233-6041-4768-b97d-9b716d1bf479.info" returned: 0 in 0.563s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:14 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-11ea10e1-716a-4200-95f6-ceae410b55c3 tempest-VolumesSnapshotTestJSON-708792780 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-cdfef233-6041-4768-b97d-9b716d1bf479.info is being set with open permissions: ugo+rw
Feb 27 01:27:14 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-11ea10e1-716a-4200-95f6-ceae410b55c3 tempest-VolumesSnapshotTestJSON-708792780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-cdfef233-6041-4768-b97d-9b716d1bf479.info {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:14 devstack sudo[88430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-cdfef233-6041-4768-b97d-9b716d1bf479.info
Feb 27 01:27:14 devstack sudo[88430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:14 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-3052cb82-159c-4f8c-ba14-69c2d8d4cb32 tempest-CreateVolumesFromImageTest-1065198505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3276924c-710d-4ea6-8b53-e6c1063c1381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2146437458',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c50fdf17-0a30-488c-a529-b5e7aff93e25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bcdd53a2b2c4c80940f7d56793b1a5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:14Z,use_quota=True,user_id='ba9e0fac3cf149ea9c964d9a58b5d8bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:14 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-3052cb82-159c-4f8c-ba14-69c2d8d4cb32 tempest-CreateVolumesFromImageTest-1065198505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00fef71b-f4b0-4d8a-8ae7-ebb1fd21ea92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:14 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-3052cb82-159c-4f8c-ba14-69c2d8d4cb32 tempest-CreateVolumesFromImageTest-1065198505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00fef71b-f4b0-4d8a-8ae7-ebb1fd21ea92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:14 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-3052cb82-159c-4f8c-ba14-69c2d8d4cb32 tempest-CreateVolumesFromImageTest-1065198505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a76bfd3-385d-4bae-8847-8d162c7961f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:14 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-3052cb82-159c-4f8c-ba14-69c2d8d4cb32 tempest-CreateVolumesFromImageTest-1065198505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a76bfd3-385d-4bae-8847-8d162c7961f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c50fdf17-0a30-488c-a529-b5e7aff93e25', 'volume_name': 'volume-c50fdf17-0a30-488c-a529-b5e7aff93e25', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:14 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-3052cb82-159c-4f8c-ba14-69c2d8d4cb32 tempest-CreateVolumesFromImageTest-1065198505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec9fd30c-0948-4b9c-8fd0-85efc5a5b71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:14 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-3052cb82-159c-4f8c-ba14-69c2d8d4cb32 tempest-CreateVolumesFromImageTest-1065198505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec9fd30c-0948-4b9c-8fd0-85efc5a5b71a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:14 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-3052cb82-159c-4f8c-ba14-69c2d8d4cb32 tempest-CreateVolumesFromImageTest-1065198505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41400287-a399-4e80-8d9f-6900321b7470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:14 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-3052cb82-159c-4f8c-ba14-69c2d8d4cb32 tempest-CreateVolumesFromImageTest-1065198505 None] Volume c50fdf17-0a30-488c-a529-b5e7aff93e25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c50fdf17-0a30-488c-a529-b5e7aff93e25', 'volume_size': 1}
Feb 27 01:27:14 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-3052cb82-159c-4f8c-ba14-69c2d8d4cb32 tempest-CreateVolumesFromImageTest-1065198505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:14 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-777c3e7e-bc25-4bef-8340-2f4873f6994e tempest-CreateVolumesFromImageTest-1065198505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:27:14 devstack sudo[88427]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:14 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-777c3e7e-bc25-4bef-8340-2f4873f6994e tempest-CreateVolumesFromImageTest-1065198505 None] Flow 'volume_create_manager' (b6f7beca-eb2b-4a72-9cdc-b63b87650726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:14 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-777c3e7e-bc25-4bef-8340-2f4873f6994e tempest-CreateVolumesFromImageTest-1065198505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d19edf5-4801-4547-88c3-ca7849267cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:14 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-777c3e7e-bc25-4bef-8340-2f4873f6994e tempest-CreateVolumesFromImageTest-1065198505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d19edf5-4801-4547-88c3-ca7849267cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2056140937',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18dbf232-1084-44c6-974a-0b5b2c3234a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bcdd53a2b2c4c80940f7d56793b1a5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:15Z,use_quota=True,user_id='ba9e0fac3cf149ea9c964d9a58b5d8bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:14 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-777c3e7e-bc25-4bef-8340-2f4873f6994e tempest-CreateVolumesFromImageTest-1065198505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65037ece-0fcb-4691-8107-2843c9c0b631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:14 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-777c3e7e-bc25-4bef-8340-2f4873f6994e tempest-CreateVolumesFromImageTest-1065198505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65037ece-0fcb-4691-8107-2843c9c0b631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:14 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-777c3e7e-bc25-4bef-8340-2f4873f6994e tempest-CreateVolumesFromImageTest-1065198505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d89af0c3-e117-4817-8b68-fe33a1bc499d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:14 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-777c3e7e-bc25-4bef-8340-2f4873f6994e tempest-CreateVolumesFromImageTest-1065198505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d89af0c3-e117-4817-8b68-fe33a1bc499d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18dbf232-1084-44c6-974a-0b5b2c3234a0', 'volume_name': 'volume-18dbf232-1084-44c6-974a-0b5b2c3234a0', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:14 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-777c3e7e-bc25-4bef-8340-2f4873f6994e tempest-CreateVolumesFromImageTest-1065198505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afecdedf-ab3c-4c13-8252-db9ab6c03800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:14 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-777c3e7e-bc25-4bef-8340-2f4873f6994e tempest-CreateVolumesFromImageTest-1065198505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afecdedf-ab3c-4c13-8252-db9ab6c03800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:14 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-777c3e7e-bc25-4bef-8340-2f4873f6994e tempest-CreateVolumesFromImageTest-1065198505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71b4a43f-4ae3-4756-91b3-0c514572e918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:14 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-777c3e7e-bc25-4bef-8340-2f4873f6994e tempest-CreateVolumesFromImageTest-1065198505 None] Volume 18dbf232-1084-44c6-974a-0b5b2c3234a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18dbf232-1084-44c6-974a-0b5b2c3234a0', 'volume_size': 1}
Feb 27 01:27:14 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-777c3e7e-bc25-4bef-8340-2f4873f6994e tempest-CreateVolumesFromImageTest-1065198505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:14 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ab8f970b-f9e6-4014-87ef-aabf4d493dd0 tempest-VolumesTransfersV357Test-1699416551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.556s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:14 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-ab8f970b-f9e6-4014-87ef-aabf4d493dd0 tempest-VolumesTransfersV357Test-1699416551 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:27:14 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-ab8f970b-f9e6-4014-87ef-aabf4d493dd0 tempest-VolumesTransfersV357Test-1699416551 None] Deleted volume successfully.
Feb 27 01:27:14 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-ab8f970b-f9e6-4014-87ef-aabf4d493dd0 tempest-VolumesTransfersV357Test-1699416551 None] Lock "cinder-6a5d2dac-7a35-43a1-99fd-20adf2647ef6-delete_volume" released by "delete_volume" :: held 1.742s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:14 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-40a5ad00-96e4-4a95-8335-1543eb30ab3a tempest-CreateVolumesFromImageTest-1065198505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:27:14 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-40a5ad00-96e4-4a95-8335-1543eb30ab3a tempest-CreateVolumesFromImageTest-1065198505 None] Flow 'volume_create_manager' (66de0f46-bbee-4fd9-9f00-d89e65419520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:14 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-40a5ad00-96e4-4a95-8335-1543eb30ab3a tempest-CreateVolumesFromImageTest-1065198505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13eaf618-33d1-4d6f-87c8-f6744b1221fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:14 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-40a5ad00-96e4-4a95-8335-1543eb30ab3a tempest-CreateVolumesFromImageTest-1065198505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13eaf618-33d1-4d6f-87c8-f6744b1221fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-308019493',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7639162-97ad-4b17-9752-4de21ad83458,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bcdd53a2b2c4c80940f7d56793b1a5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:15Z,use_quota=True,user_id='ba9e0fac3cf149ea9c964d9a58b5d8bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:14 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-40a5ad00-96e4-4a95-8335-1543eb30ab3a tempest-CreateVolumesFromImageTest-1065198505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (203510f6-e3c4-42fd-9593-a0cbe4f835f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:14 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-40a5ad00-96e4-4a95-8335-1543eb30ab3a tempest-CreateVolumesFromImageTest-1065198505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (203510f6-e3c4-42fd-9593-a0cbe4f835f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:14 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-40a5ad00-96e4-4a95-8335-1543eb30ab3a tempest-CreateVolumesFromImageTest-1065198505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06b757c6-e496-4fb8-a72f-d5ce88e686ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:14 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-40a5ad00-96e4-4a95-8335-1543eb30ab3a tempest-CreateVolumesFromImageTest-1065198505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06b757c6-e496-4fb8-a72f-d5ce88e686ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7639162-97ad-4b17-9752-4de21ad83458', 'volume_name': 'volume-c7639162-97ad-4b17-9752-4de21ad83458', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:14 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-40a5ad00-96e4-4a95-8335-1543eb30ab3a tempest-CreateVolumesFromImageTest-1065198505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38a35ee2-f32e-4425-8ce8-4c01db21ff5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:14 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-40a5ad00-96e4-4a95-8335-1543eb30ab3a tempest-CreateVolumesFromImageTest-1065198505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38a35ee2-f32e-4425-8ce8-4c01db21ff5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:14 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-40a5ad00-96e4-4a95-8335-1543eb30ab3a tempest-CreateVolumesFromImageTest-1065198505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f8a983c-a2b6-4497-b6fe-2e1a3b439e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:14 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-40a5ad00-96e4-4a95-8335-1543eb30ab3a tempest-CreateVolumesFromImageTest-1065198505 None] Volume c7639162-97ad-4b17-9752-4de21ad83458: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7639162-97ad-4b17-9752-4de21ad83458', 'volume_size': 1}
Feb 27 01:27:14 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-40a5ad00-96e4-4a95-8335-1543eb30ab3a tempest-CreateVolumesFromImageTest-1065198505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:14 devstack sudo[88430]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:14 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-11ea10e1-716a-4200-95f6-ceae410b55c3 tempest-VolumesSnapshotTestJSON-708792780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-cdfef233-6041-4768-b97d-9b716d1bf479.info" returned: 0 in 0.519s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:14 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-11ea10e1-716a-4200-95f6-ceae410b55c3 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.392s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:14 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-d53787d0-5d78-4482-a985-cd31e7b82273 tempest-VolumesActionsTest-1945194074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.931s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:14 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-d53787d0-5d78-4482-a985-cd31e7b82273 tempest-VolumesActionsTest-1945194074 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-874063340',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea4ba313-8035-4664-b5a7-d6f67c51d8c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be9dc0daf3794a089ad1aff6cd82e870',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:14Z,use_quota=True,user_id='c3f639f013f94fea9ca5469ad886c89b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:27:14 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-d53787d0-5d78-4482-a985-cd31e7b82273 tempest-VolumesActionsTest-1945194074 None] Creating volume ea4ba313-8035-4664-b5a7-d6f67c51d8c1 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:27:14 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-d53787d0-5d78-4482-a985-cd31e7b82273 tempest-VolumesActionsTest-1945194074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:14 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-d53787d0-5d78-4482-a985-cd31e7b82273 tempest-VolumesActionsTest-1945194074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:14 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-d53787d0-5d78-4482-a985-cd31e7b82273 tempest-VolumesActionsTest-1945194074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:14 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-d53787d0-5d78-4482-a985-cd31e7b82273 tempest-VolumesActionsTest-1945194074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:14 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-d53787d0-5d78-4482-a985-cd31e7b82273 tempest-VolumesActionsTest-1945194074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:14 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-d53787d0-5d78-4482-a985-cd31e7b82273 tempest-VolumesActionsTest-1945194074 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:27:14 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-d53787d0-5d78-4482-a985-cd31e7b82273 tempest-VolumesActionsTest-1945194074 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:27:14 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d53787d0-5d78-4482-a985-cd31e7b82273 tempest-VolumesActionsTest-1945194074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ea4ba313-8035-4664-b5a7-d6f67c51d8c1 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:14 devstack sudo[88434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ea4ba313-8035-4664-b5a7-d6f67c51d8c1 1073741824
Feb 27 01:27:14 devstack sudo[88434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:14 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-11ea10e1-716a-4200-95f6-ceae410b55c3 tempest-VolumesSnapshotTestJSON-708792780 None] Create snapshot completed successfully
Feb 27 01:27:15 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-47333654-e23d-4bea-a4fc-b66ffc408fcd tempest-CreateVolumesFromImageTest-1065198505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:27:15 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-47333654-e23d-4bea-a4fc-b66ffc408fcd tempest-CreateVolumesFromImageTest-1065198505 None] Flow 'volume_create_manager' (4cc9827d-91c9-498c-8279-6d74f69d68c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:15 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-47333654-e23d-4bea-a4fc-b66ffc408fcd tempest-CreateVolumesFromImageTest-1065198505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23c08442-7f55-496d-a508-012aced5d1db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:15 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-47333654-e23d-4bea-a4fc-b66ffc408fcd tempest-CreateVolumesFromImageTest-1065198505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23c08442-7f55-496d-a508-012aced5d1db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1501816984',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40b54d2b-75be-43ac-9fd8-53cfeba760ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bcdd53a2b2c4c80940f7d56793b1a5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:15Z,use_quota=True,user_id='ba9e0fac3cf149ea9c964d9a58b5d8bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:15 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-47333654-e23d-4bea-a4fc-b66ffc408fcd tempest-CreateVolumesFromImageTest-1065198505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7a913dd-d97a-4d44-8574-1376cd2db4a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:15 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-47333654-e23d-4bea-a4fc-b66ffc408fcd tempest-CreateVolumesFromImageTest-1065198505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7a913dd-d97a-4d44-8574-1376cd2db4a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:15 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-47333654-e23d-4bea-a4fc-b66ffc408fcd tempest-CreateVolumesFromImageTest-1065198505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69ba4883-9468-4bc5-9529-aa1b58128aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:15 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-47333654-e23d-4bea-a4fc-b66ffc408fcd tempest-CreateVolumesFromImageTest-1065198505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69ba4883-9468-4bc5-9529-aa1b58128aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40b54d2b-75be-43ac-9fd8-53cfeba760ce', 'volume_name': 'volume-40b54d2b-75be-43ac-9fd8-53cfeba760ce', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:15 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-47333654-e23d-4bea-a4fc-b66ffc408fcd tempest-CreateVolumesFromImageTest-1065198505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcd4e606-51dd-4431-970a-096613416261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:15 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-47333654-e23d-4bea-a4fc-b66ffc408fcd tempest-CreateVolumesFromImageTest-1065198505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcd4e606-51dd-4431-970a-096613416261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:15 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-47333654-e23d-4bea-a4fc-b66ffc408fcd tempest-CreateVolumesFromImageTest-1065198505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (333495cd-d386-4313-95df-3b4d5f41bd35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:15 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-47333654-e23d-4bea-a4fc-b66ffc408fcd tempest-CreateVolumesFromImageTest-1065198505 None] Volume 40b54d2b-75be-43ac-9fd8-53cfeba760ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40b54d2b-75be-43ac-9fd8-53cfeba760ce', 'volume_size': 1}
Feb 27 01:27:15 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-47333654-e23d-4bea-a4fc-b66ffc408fcd tempest-CreateVolumesFromImageTest-1065198505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:15 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-4527470f-7756-4223-ab96-a3037fa7164d tempest-CreateVolumesFromImageTest-1065198505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:27:15 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-4527470f-7756-4223-ab96-a3037fa7164d tempest-CreateVolumesFromImageTest-1065198505 None] Flow 'volume_create_manager' (542a83f9-3472-46b3-9a14-171310a50da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:15 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-4527470f-7756-4223-ab96-a3037fa7164d tempest-CreateVolumesFromImageTest-1065198505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8ae09a3-d0b7-4c3a-b8a1-e3dd606729e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:15 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-4527470f-7756-4223-ab96-a3037fa7164d tempest-CreateVolumesFromImageTest-1065198505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8ae09a3-d0b7-4c3a-b8a1-e3dd606729e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1033308475',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=215110df-a9d7-4b2e-a281-4f942c55dc1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bcdd53a2b2c4c80940f7d56793b1a5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:15Z,use_quota=True,user_id='ba9e0fac3cf149ea9c964d9a58b5d8bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:15 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-4527470f-7756-4223-ab96-a3037fa7164d tempest-CreateVolumesFromImageTest-1065198505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1159bed-0ba6-4512-9ace-00d0b8be1ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:15 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-4527470f-7756-4223-ab96-a3037fa7164d tempest-CreateVolumesFromImageTest-1065198505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1159bed-0ba6-4512-9ace-00d0b8be1ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:15 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-4527470f-7756-4223-ab96-a3037fa7164d tempest-CreateVolumesFromImageTest-1065198505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a45ce0b5-7cc3-43a7-b417-dfb8f2139c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:15 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-4527470f-7756-4223-ab96-a3037fa7164d tempest-CreateVolumesFromImageTest-1065198505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a45ce0b5-7cc3-43a7-b417-dfb8f2139c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '215110df-a9d7-4b2e-a281-4f942c55dc1e', 'volume_name': 'volume-215110df-a9d7-4b2e-a281-4f942c55dc1e', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:15 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-4527470f-7756-4223-ab96-a3037fa7164d tempest-CreateVolumesFromImageTest-1065198505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31d7924d-60b1-4edf-9f74-3f33fbed5d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:15 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-4527470f-7756-4223-ab96-a3037fa7164d tempest-CreateVolumesFromImageTest-1065198505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31d7924d-60b1-4edf-9f74-3f33fbed5d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:15 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-4527470f-7756-4223-ab96-a3037fa7164d tempest-CreateVolumesFromImageTest-1065198505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b452d04-6727-4540-86c4-5af27f9ff494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:15 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-4527470f-7756-4223-ab96-a3037fa7164d tempest-CreateVolumesFromImageTest-1065198505 None] Volume 215110df-a9d7-4b2e-a281-4f942c55dc1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-215110df-a9d7-4b2e-a281-4f942c55dc1e', 'volume_size': 1}
Feb 27 01:27:15 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-4527470f-7756-4223-ab96-a3037fa7164d tempest-CreateVolumesFromImageTest-1065198505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:15 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-1be2c8ef-0f36-4207-90c7-8d35429a03f4 tempest-VolumesSnapshotTestJSON-708792780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:27:15 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1be2c8ef-0f36-4207-90c7-8d35429a03f4 tempest-VolumesSnapshotTestJSON-708792780 None] Flow 'volume_create_manager' (c73724e9-e3ab-46d0-b466-b475f2037259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:15 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1be2c8ef-0f36-4207-90c7-8d35429a03f4 tempest-VolumesSnapshotTestJSON-708792780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac430495-6a26-48da-90f9-769321e49425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:15 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1be2c8ef-0f36-4207-90c7-8d35429a03f4 tempest-VolumesSnapshotTestJSON-708792780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac430495-6a26-48da-90f9-769321e49425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-583179668',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e56102f5-8063-4d7e-b138-3c2ef979160e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fba5f3accb0d428597d9c1a212708a1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:15Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=74ae11bb-fe6a-48a5-aeba-dcbd7e915c64,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:15Z,use_quota=True,user_id='4b8cb8c9a1344b09921d38d6e27d2878',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:15 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1be2c8ef-0f36-4207-90c7-8d35429a03f4 tempest-VolumesSnapshotTestJSON-708792780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80dea8d2-932b-4fd6-bb07-7ced6cf68946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:15 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1be2c8ef-0f36-4207-90c7-8d35429a03f4 tempest-VolumesSnapshotTestJSON-708792780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80dea8d2-932b-4fd6-bb07-7ced6cf68946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:15 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1be2c8ef-0f36-4207-90c7-8d35429a03f4 tempest-VolumesSnapshotTestJSON-708792780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fb54f25-e38d-494f-8609-14b1f148a061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:15 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1be2c8ef-0f36-4207-90c7-8d35429a03f4 tempest-VolumesSnapshotTestJSON-708792780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fb54f25-e38d-494f-8609-14b1f148a061) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e56102f5-8063-4d7e-b138-3c2ef979160e', 'volume_name': 'volume-e56102f5-8063-4d7e-b138-3c2ef979160e', 'volume_size': 2, 'snapshot_id': '74ae11bb-fe6a-48a5-aeba-dcbd7e915c64'}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:15 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1be2c8ef-0f36-4207-90c7-8d35429a03f4 tempest-VolumesSnapshotTestJSON-708792780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb208f8b-f7ca-4479-889f-283f8595bb6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:15 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1be2c8ef-0f36-4207-90c7-8d35429a03f4 tempest-VolumesSnapshotTestJSON-708792780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb208f8b-f7ca-4479-889f-283f8595bb6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:15 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1be2c8ef-0f36-4207-90c7-8d35429a03f4 tempest-VolumesSnapshotTestJSON-708792780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (162cc7e4-50c4-4c14-a459-b75497ff285b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:15 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-1be2c8ef-0f36-4207-90c7-8d35429a03f4 tempest-VolumesSnapshotTestJSON-708792780 None] Volume e56102f5-8063-4d7e-b138-3c2ef979160e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e56102f5-8063-4d7e-b138-3c2ef979160e', 'volume_size': 2, 'snapshot_id': '74ae11bb-fe6a-48a5-aeba-dcbd7e915c64'}
Feb 27 01:27:15 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-1be2c8ef-0f36-4207-90c7-8d35429a03f4 tempest-VolumesSnapshotTestJSON-708792780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:15 devstack sudo[88434]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:15 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d53787d0-5d78-4482-a985-cd31e7b82273 tempest-VolumesActionsTest-1945194074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ea4ba313-8035-4664-b5a7-d6f67c51d8c1 1073741824" returned: 0 in 0.680s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:15 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d53787d0-5d78-4482-a985-cd31e7b82273 tempest-VolumesActionsTest-1945194074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ea4ba313-8035-4664-b5a7-d6f67c51d8c1 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:15 devstack sudo[88440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ea4ba313-8035-4664-b5a7-d6f67c51d8c1
Feb 27 01:27:15 devstack sudo[88440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:16 devstack sudo[88440]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:16 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d53787d0-5d78-4482-a985-cd31e7b82273 tempest-VolumesActionsTest-1945194074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ea4ba313-8035-4664-b5a7-d6f67c51d8c1" returned: 0 in 0.444s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:16 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-d53787d0-5d78-4482-a985-cd31e7b82273 tempest-VolumesActionsTest-1945194074 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:27:16 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-d53787d0-5d78-4482-a985-cd31e7b82273 tempest-VolumesActionsTest-1945194074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.156s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:16 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-3052cb82-159c-4f8c-ba14-69c2d8d4cb32 tempest-CreateVolumesFromImageTest-1065198505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.639s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:16 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-3052cb82-159c-4f8c-ba14-69c2d8d4cb32 tempest-CreateVolumesFromImageTest-1065198505 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2146437458',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c50fdf17-0a30-488c-a529-b5e7aff93e25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bcdd53a2b2c4c80940f7d56793b1a5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:14Z,use_quota=True,user_id='ba9e0fac3cf149ea9c964d9a58b5d8bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:27:16 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-3052cb82-159c-4f8c-ba14-69c2d8d4cb32 tempest-CreateVolumesFromImageTest-1065198505 None] Creating volume c50fdf17-0a30-488c-a529-b5e7aff93e25 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:27:16 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-3052cb82-159c-4f8c-ba14-69c2d8d4cb32 tempest-CreateVolumesFromImageTest-1065198505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:16 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-3052cb82-159c-4f8c-ba14-69c2d8d4cb32 tempest-CreateVolumesFromImageTest-1065198505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:16 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-3052cb82-159c-4f8c-ba14-69c2d8d4cb32 tempest-CreateVolumesFromImageTest-1065198505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:16 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-3052cb82-159c-4f8c-ba14-69c2d8d4cb32 tempest-CreateVolumesFromImageTest-1065198505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:16 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-3052cb82-159c-4f8c-ba14-69c2d8d4cb32 tempest-CreateVolumesFromImageTest-1065198505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:16 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-3052cb82-159c-4f8c-ba14-69c2d8d4cb32 tempest-CreateVolumesFromImageTest-1065198505 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:27:16 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-3052cb82-159c-4f8c-ba14-69c2d8d4cb32 tempest-CreateVolumesFromImageTest-1065198505 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:27:16 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-3052cb82-159c-4f8c-ba14-69c2d8d4cb32 tempest-CreateVolumesFromImageTest-1065198505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c50fdf17-0a30-488c-a529-b5e7aff93e25 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:16 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d53787d0-5d78-4482-a985-cd31e7b82273 tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e690372b-9e84-47bd-8f92-f8ff3a20031a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea4ba313-8035-4664-b5a7-d6f67c51d8c1', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:16 devstack sudo[88443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c50fdf17-0a30-488c-a529-b5e7aff93e25 1073741824
Feb 27 01:27:16 devstack sudo[88443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:16 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d53787d0-5d78-4482-a985-cd31e7b82273 tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb66d6fb-a269-4d04-bfdc-14146aa5cfcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:16 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-d53787d0-5d78-4482-a985-cd31e7b82273 tempest-VolumesActionsTest-1945194074 None] Volume volume-ea4ba313-8035-4664-b5a7-d6f67c51d8c1 (ea4ba313-8035-4664-b5a7-d6f67c51d8c1): created successfully
Feb 27 01:27:16 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d53787d0-5d78-4482-a985-cd31e7b82273 tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb66d6fb-a269-4d04-bfdc-14146aa5cfcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:16 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d53787d0-5d78-4482-a985-cd31e7b82273 tempest-VolumesActionsTest-1945194074 None] Flow 'volume_create_manager' (accde2cf-96a1-4b0b-93d7-e5d743780ab8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:16 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-d53787d0-5d78-4482-a985-cd31e7b82273 tempest-VolumesActionsTest-1945194074 None] Created volume successfully.
Feb 27 01:27:16 devstack sudo[88443]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:16 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-3052cb82-159c-4f8c-ba14-69c2d8d4cb32 tempest-CreateVolumesFromImageTest-1065198505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c50fdf17-0a30-488c-a529-b5e7aff93e25 1073741824" returned: 0 in 0.545s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:16 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-3052cb82-159c-4f8c-ba14-69c2d8d4cb32 tempest-CreateVolumesFromImageTest-1065198505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c50fdf17-0a30-488c-a529-b5e7aff93e25 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:16 devstack sudo[88448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c50fdf17-0a30-488c-a529-b5e7aff93e25
Feb 27 01:27:16 devstack sudo[88448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:17 devstack sudo[88448]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:17 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-3052cb82-159c-4f8c-ba14-69c2d8d4cb32 tempest-CreateVolumesFromImageTest-1065198505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c50fdf17-0a30-488c-a529-b5e7aff93e25" returned: 0 in 0.503s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:17 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-3052cb82-159c-4f8c-ba14-69c2d8d4cb32 tempest-CreateVolumesFromImageTest-1065198505 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:27:17 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-3052cb82-159c-4f8c-ba14-69c2d8d4cb32 tempest-CreateVolumesFromImageTest-1065198505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:17 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-777c3e7e-bc25-4bef-8340-2f4873f6994e tempest-CreateVolumesFromImageTest-1065198505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.481s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:17 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-777c3e7e-bc25-4bef-8340-2f4873f6994e tempest-CreateVolumesFromImageTest-1065198505 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2056140937',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18dbf232-1084-44c6-974a-0b5b2c3234a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bcdd53a2b2c4c80940f7d56793b1a5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:15Z,use_quota=True,user_id='ba9e0fac3cf149ea9c964d9a58b5d8bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:27:17 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-777c3e7e-bc25-4bef-8340-2f4873f6994e tempest-CreateVolumesFromImageTest-1065198505 None] Creating volume 18dbf232-1084-44c6-974a-0b5b2c3234a0 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:27:17 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-777c3e7e-bc25-4bef-8340-2f4873f6994e tempest-CreateVolumesFromImageTest-1065198505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:17 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-777c3e7e-bc25-4bef-8340-2f4873f6994e tempest-CreateVolumesFromImageTest-1065198505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:17 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-777c3e7e-bc25-4bef-8340-2f4873f6994e tempest-CreateVolumesFromImageTest-1065198505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:17 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-777c3e7e-bc25-4bef-8340-2f4873f6994e tempest-CreateVolumesFromImageTest-1065198505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:17 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-777c3e7e-bc25-4bef-8340-2f4873f6994e tempest-CreateVolumesFromImageTest-1065198505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:17 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-777c3e7e-bc25-4bef-8340-2f4873f6994e tempest-CreateVolumesFromImageTest-1065198505 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:27:17 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-777c3e7e-bc25-4bef-8340-2f4873f6994e tempest-CreateVolumesFromImageTest-1065198505 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:27:17 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-777c3e7e-bc25-4bef-8340-2f4873f6994e tempest-CreateVolumesFromImageTest-1065198505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-18dbf232-1084-44c6-974a-0b5b2c3234a0 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:17 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-3052cb82-159c-4f8c-ba14-69c2d8d4cb32 tempest-CreateVolumesFromImageTest-1065198505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41400287-a399-4e80-8d9f-6900321b7470) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c50fdf17-0a30-488c-a529-b5e7aff93e25', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:17 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-3052cb82-159c-4f8c-ba14-69c2d8d4cb32 tempest-CreateVolumesFromImageTest-1065198505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (520112cb-b277-44b5-9982-25052347f508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:17 devstack sudo[88452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-18dbf232-1084-44c6-974a-0b5b2c3234a0 1073741824
Feb 27 01:27:17 devstack sudo[88452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:17 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-3052cb82-159c-4f8c-ba14-69c2d8d4cb32 tempest-CreateVolumesFromImageTest-1065198505 None] Volume volume-c50fdf17-0a30-488c-a529-b5e7aff93e25 (c50fdf17-0a30-488c-a529-b5e7aff93e25): created successfully
Feb 27 01:27:17 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-3052cb82-159c-4f8c-ba14-69c2d8d4cb32 tempest-CreateVolumesFromImageTest-1065198505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (520112cb-b277-44b5-9982-25052347f508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:17 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-3052cb82-159c-4f8c-ba14-69c2d8d4cb32 tempest-CreateVolumesFromImageTest-1065198505 None] Flow 'volume_create_manager' (7b8b8e30-09f9-416a-97a3-e156aa75a4e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:17 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-3052cb82-159c-4f8c-ba14-69c2d8d4cb32 tempest-CreateVolumesFromImageTest-1065198505 None] Created volume successfully.
Feb 27 01:27:17 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-84e3d926-88b1-4599-b1b7-e944381f7711 tempest-VolumesActionsTest-1938141483 None] Acquiring lock "cinder-ea4ba313-8035-4664-b5a7-d6f67c51d8c1-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:17 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-84e3d926-88b1-4599-b1b7-e944381f7711 tempest-VolumesActionsTest-1938141483 None] Lock "cinder-ea4ba313-8035-4664-b5a7-d6f67c51d8c1-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:17 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-84e3d926-88b1-4599-b1b7-e944381f7711 tempest-VolumesActionsTest-1938141483 None] Acquiring lock "cinder-quobyte-ea4ba313-8035-4664-b5a7-d6f67c51d8c1" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:17 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-84e3d926-88b1-4599-b1b7-e944381f7711 tempest-VolumesActionsTest-1938141483 None] Lock "cinder-quobyte-ea4ba313-8035-4664-b5a7-d6f67c51d8c1" acquired by "delete_volume" :: waited 0.011s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:17 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef3ba30f-c8e6-4859-9a60-446c12ce1e33]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:17 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-84e3d926-88b1-4599-b1b7-e944381f7711 tempest-VolumesActionsTest-1938141483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ea4ba313-8035-4664-b5a7-d6f67c51d8c1 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:17 devstack sudo[88454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ea4ba313-8035-4664-b5a7-d6f67c51d8c1
Feb 27 01:27:17 devstack sudo[88454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:17 devstack sudo[88452]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:17 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-777c3e7e-bc25-4bef-8340-2f4873f6994e tempest-CreateVolumesFromImageTest-1065198505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-18dbf232-1084-44c6-974a-0b5b2c3234a0 1073741824" returned: 0 in 0.759s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:18 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-777c3e7e-bc25-4bef-8340-2f4873f6994e tempest-CreateVolumesFromImageTest-1065198505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-18dbf232-1084-44c6-974a-0b5b2c3234a0 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:18 devstack sudo[88462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-18dbf232-1084-44c6-974a-0b5b2c3234a0
Feb 27 01:27:18 devstack sudo[88462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:18 devstack sudo[88454]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:18 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-84e3d926-88b1-4599-b1b7-e944381f7711 tempest-VolumesActionsTest-1938141483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ea4ba313-8035-4664-b5a7-d6f67c51d8c1" returned: 0 in 0.684s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:18 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-84e3d926-88b1-4599-b1b7-e944381f7711 tempest-VolumesActionsTest-1938141483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ea4ba313-8035-4664-b5a7-d6f67c51d8c1 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:18 devstack sudo[88464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ea4ba313-8035-4664-b5a7-d6f67c51d8c1
Feb 27 01:27:18 devstack sudo[88464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:18 devstack sudo[88462]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:18 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-777c3e7e-bc25-4bef-8340-2f4873f6994e tempest-CreateVolumesFromImageTest-1065198505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-18dbf232-1084-44c6-974a-0b5b2c3234a0" returned: 0 in 0.599s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:18 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-777c3e7e-bc25-4bef-8340-2f4873f6994e tempest-CreateVolumesFromImageTest-1065198505 None] <== create_volume: return (1418ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:27:18 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-777c3e7e-bc25-4bef-8340-2f4873f6994e tempest-CreateVolumesFromImageTest-1065198505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.423s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:18 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-40a5ad00-96e4-4a95-8335-1543eb30ab3a tempest-CreateVolumesFromImageTest-1065198505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.691s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:18 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-40a5ad00-96e4-4a95-8335-1543eb30ab3a tempest-CreateVolumesFromImageTest-1065198505 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-308019493',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7639162-97ad-4b17-9752-4de21ad83458,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bcdd53a2b2c4c80940f7d56793b1a5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:15Z,use_quota=True,user_id='ba9e0fac3cf149ea9c964d9a58b5d8bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:27:18 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-40a5ad00-96e4-4a95-8335-1543eb30ab3a tempest-CreateVolumesFromImageTest-1065198505 None] Creating volume c7639162-97ad-4b17-9752-4de21ad83458 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:27:18 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-40a5ad00-96e4-4a95-8335-1543eb30ab3a tempest-CreateVolumesFromImageTest-1065198505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:18 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-40a5ad00-96e4-4a95-8335-1543eb30ab3a tempest-CreateVolumesFromImageTest-1065198505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:18 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-40a5ad00-96e4-4a95-8335-1543eb30ab3a tempest-CreateVolumesFromImageTest-1065198505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:18 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-40a5ad00-96e4-4a95-8335-1543eb30ab3a tempest-CreateVolumesFromImageTest-1065198505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:18 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-40a5ad00-96e4-4a95-8335-1543eb30ab3a tempest-CreateVolumesFromImageTest-1065198505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:18 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-40a5ad00-96e4-4a95-8335-1543eb30ab3a tempest-CreateVolumesFromImageTest-1065198505 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:27:18 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-40a5ad00-96e4-4a95-8335-1543eb30ab3a tempest-CreateVolumesFromImageTest-1065198505 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:27:18 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-40a5ad00-96e4-4a95-8335-1543eb30ab3a tempest-CreateVolumesFromImageTest-1065198505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c7639162-97ad-4b17-9752-4de21ad83458 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:18 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-777c3e7e-bc25-4bef-8340-2f4873f6994e tempest-CreateVolumesFromImageTest-1065198505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71b4a43f-4ae3-4756-91b3-0c514572e918) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18dbf232-1084-44c6-974a-0b5b2c3234a0', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:18 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-777c3e7e-bc25-4bef-8340-2f4873f6994e tempest-CreateVolumesFromImageTest-1065198505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (089852b2-0abe-4383-b9cb-ab8d3bf80902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:18 devstack sudo[88467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c7639162-97ad-4b17-9752-4de21ad83458 1073741824
Feb 27 01:27:18 devstack sudo[88467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:18 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-777c3e7e-bc25-4bef-8340-2f4873f6994e tempest-CreateVolumesFromImageTest-1065198505 None] Volume volume-18dbf232-1084-44c6-974a-0b5b2c3234a0 (18dbf232-1084-44c6-974a-0b5b2c3234a0): created successfully
Feb 27 01:27:18 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-777c3e7e-bc25-4bef-8340-2f4873f6994e tempest-CreateVolumesFromImageTest-1065198505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (089852b2-0abe-4383-b9cb-ab8d3bf80902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:18 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-777c3e7e-bc25-4bef-8340-2f4873f6994e tempest-CreateVolumesFromImageTest-1065198505 None] Flow 'volume_create_manager' (b6f7beca-eb2b-4a72-9cdc-b63b87650726) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:18 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-777c3e7e-bc25-4bef-8340-2f4873f6994e tempest-CreateVolumesFromImageTest-1065198505 None] Created volume successfully.
Feb 27 01:27:18 devstack sudo[88464]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:18 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-84e3d926-88b1-4599-b1b7-e944381f7711 tempest-VolumesActionsTest-1938141483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ea4ba313-8035-4664-b5a7-d6f67c51d8c1" returned: 0 in 0.688s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:18 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-84e3d926-88b1-4599-b1b7-e944381f7711 tempest-VolumesActionsTest-1938141483 None] Lock "cinder-quobyte-ea4ba313-8035-4664-b5a7-d6f67c51d8c1" released by "delete_volume" :: held 1.406s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:18 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-84e3d926-88b1-4599-b1b7-e944381f7711 tempest-VolumesActionsTest-1938141483 None] Created reservations ['dd46e96f-8b7b-44b1-b8ff-fc24b22b130c', 'ec10cc5b-7304-4456-bebc-b2163ef4f1e8', '2eef7c8f-8cb1-4a88-99f7-42be53ffeeb2', '2527e740-673e-43e9-89c2-cb411e87c0bb'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:27:18 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-84e3d926-88b1-4599-b1b7-e944381f7711 tempest-VolumesActionsTest-1938141483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:18 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-84e3d926-88b1-4599-b1b7-e944381f7711 tempest-VolumesActionsTest-1938141483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:18 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-84e3d926-88b1-4599-b1b7-e944381f7711 tempest-VolumesActionsTest-1938141483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:18 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-84e3d926-88b1-4599-b1b7-e944381f7711 tempest-VolumesActionsTest-1938141483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:18 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-84e3d926-88b1-4599-b1b7-e944381f7711 tempest-VolumesActionsTest-1938141483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:18 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-84e3d926-88b1-4599-b1b7-e944381f7711 tempest-VolumesActionsTest-1938141483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:18 devstack sudo[88470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:27:18 devstack sudo[88470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:19 devstack sudo[88467]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:19 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-40a5ad00-96e4-4a95-8335-1543eb30ab3a tempest-CreateVolumesFromImageTest-1065198505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c7639162-97ad-4b17-9752-4de21ad83458 1073741824" returned: 0 in 0.668s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:19 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-40a5ad00-96e4-4a95-8335-1543eb30ab3a tempest-CreateVolumesFromImageTest-1065198505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c7639162-97ad-4b17-9752-4de21ad83458 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:19 devstack sudo[88475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c7639162-97ad-4b17-9752-4de21ad83458
Feb 27 01:27:19 devstack sudo[88475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:19 devstack sudo[88470]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:19 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-84e3d926-88b1-4599-b1b7-e944381f7711 tempest-VolumesActionsTest-1938141483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.597s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:19 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-84e3d926-88b1-4599-b1b7-e944381f7711 tempest-VolumesActionsTest-1938141483 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:27:19 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-84e3d926-88b1-4599-b1b7-e944381f7711 tempest-VolumesActionsTest-1938141483 None] Deleted volume successfully.
Feb 27 01:27:19 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-84e3d926-88b1-4599-b1b7-e944381f7711 tempest-VolumesActionsTest-1938141483 None] Lock "cinder-ea4ba313-8035-4664-b5a7-d6f67c51d8c1-delete_volume" released by "delete_volume" :: held 2.194s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:19 devstack sudo[88475]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:19 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-40a5ad00-96e4-4a95-8335-1543eb30ab3a tempest-CreateVolumesFromImageTest-1065198505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c7639162-97ad-4b17-9752-4de21ad83458" returned: 0 in 0.560s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:19 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-40a5ad00-96e4-4a95-8335-1543eb30ab3a tempest-CreateVolumesFromImageTest-1065198505 None] <== create_volume: return (1257ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:27:19 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-40a5ad00-96e4-4a95-8335-1543eb30ab3a tempest-CreateVolumesFromImageTest-1065198505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.260s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:19 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-47333654-e23d-4bea-a4fc-b66ffc408fcd tempest-CreateVolumesFromImageTest-1065198505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.680s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:19 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-47333654-e23d-4bea-a4fc-b66ffc408fcd tempest-CreateVolumesFromImageTest-1065198505 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1501816984',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40b54d2b-75be-43ac-9fd8-53cfeba760ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bcdd53a2b2c4c80940f7d56793b1a5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:15Z,use_quota=True,user_id='ba9e0fac3cf149ea9c964d9a58b5d8bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:27:19 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-47333654-e23d-4bea-a4fc-b66ffc408fcd tempest-CreateVolumesFromImageTest-1065198505 None] Creating volume 40b54d2b-75be-43ac-9fd8-53cfeba760ce {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:27:19 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-47333654-e23d-4bea-a4fc-b66ffc408fcd tempest-CreateVolumesFromImageTest-1065198505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:19 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-47333654-e23d-4bea-a4fc-b66ffc408fcd tempest-CreateVolumesFromImageTest-1065198505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:19 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-47333654-e23d-4bea-a4fc-b66ffc408fcd tempest-CreateVolumesFromImageTest-1065198505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:19 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-47333654-e23d-4bea-a4fc-b66ffc408fcd tempest-CreateVolumesFromImageTest-1065198505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:19 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-47333654-e23d-4bea-a4fc-b66ffc408fcd tempest-CreateVolumesFromImageTest-1065198505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:19 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-47333654-e23d-4bea-a4fc-b66ffc408fcd tempest-CreateVolumesFromImageTest-1065198505 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:27:19 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-47333654-e23d-4bea-a4fc-b66ffc408fcd tempest-CreateVolumesFromImageTest-1065198505 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:27:19 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-47333654-e23d-4bea-a4fc-b66ffc408fcd tempest-CreateVolumesFromImageTest-1065198505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-40b54d2b-75be-43ac-9fd8-53cfeba760ce 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:19 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-40a5ad00-96e4-4a95-8335-1543eb30ab3a tempest-CreateVolumesFromImageTest-1065198505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f8a983c-a2b6-4497-b6fe-2e1a3b439e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7639162-97ad-4b17-9752-4de21ad83458', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:19 devstack sudo[88479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-40b54d2b-75be-43ac-9fd8-53cfeba760ce 1073741824
Feb 27 01:27:19 devstack sudo[88479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:19 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-40a5ad00-96e4-4a95-8335-1543eb30ab3a tempest-CreateVolumesFromImageTest-1065198505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (246453ea-947f-4ea4-92b8-ad808000345c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:19 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-40a5ad00-96e4-4a95-8335-1543eb30ab3a tempest-CreateVolumesFromImageTest-1065198505 None] Volume volume-c7639162-97ad-4b17-9752-4de21ad83458 (c7639162-97ad-4b17-9752-4de21ad83458): created successfully
Feb 27 01:27:19 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-40a5ad00-96e4-4a95-8335-1543eb30ab3a tempest-CreateVolumesFromImageTest-1065198505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (246453ea-947f-4ea4-92b8-ad808000345c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:19 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-40a5ad00-96e4-4a95-8335-1543eb30ab3a tempest-CreateVolumesFromImageTest-1065198505 None] Flow 'volume_create_manager' (66de0f46-bbee-4fd9-9f00-d89e65419520) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:19 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-40a5ad00-96e4-4a95-8335-1543eb30ab3a tempest-CreateVolumesFromImageTest-1065198505 None] Created volume successfully.
Feb 27 01:27:19 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-60ffd6a5-c7f5-461c-b343-d2e555f1620e tempest-VolumesActionsTest-1945194074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:27:19 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-60ffd6a5-c7f5-461c-b343-d2e555f1620e tempest-VolumesActionsTest-1945194074 None] Flow 'volume_create_manager' (3139d0ca-42e1-4b52-94ef-4d3221b8f08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:19 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-60ffd6a5-c7f5-461c-b343-d2e555f1620e tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e902932-0680-40fd-91fd-c591383b38cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-60ffd6a5-c7f5-461c-b343-d2e555f1620e tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e902932-0680-40fd-91fd-c591383b38cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-871789663',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53d4d29e-8a59-491d-8708-c02b479bee89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be9dc0daf3794a089ad1aff6cd82e870',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:20Z,use_quota=True,user_id='c3f639f013f94fea9ca5469ad886c89b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-60ffd6a5-c7f5-461c-b343-d2e555f1620e tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ca816e7-ea47-4669-b3e1-09314f2c04c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-60ffd6a5-c7f5-461c-b343-d2e555f1620e tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ca816e7-ea47-4669-b3e1-09314f2c04c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-60ffd6a5-c7f5-461c-b343-d2e555f1620e tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53539b1e-a6d5-4666-bb09-0341b7aa0fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-60ffd6a5-c7f5-461c-b343-d2e555f1620e tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53539b1e-a6d5-4666-bb09-0341b7aa0fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53d4d29e-8a59-491d-8708-c02b479bee89', 'volume_name': 'volume-53d4d29e-8a59-491d-8708-c02b479bee89', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-60ffd6a5-c7f5-461c-b343-d2e555f1620e tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6167cad4-0f97-4cc6-a5f3-d907b1f26ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-60ffd6a5-c7f5-461c-b343-d2e555f1620e tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6167cad4-0f97-4cc6-a5f3-d907b1f26ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-60ffd6a5-c7f5-461c-b343-d2e555f1620e tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ac21607-ca7c-47b0-a4f1-13cf13e4261b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:20 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-60ffd6a5-c7f5-461c-b343-d2e555f1620e tempest-VolumesActionsTest-1945194074 None] Volume 53d4d29e-8a59-491d-8708-c02b479bee89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53d4d29e-8a59-491d-8708-c02b479bee89', 'volume_size': 1}
Feb 27 01:27:20 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-60ffd6a5-c7f5-461c-b343-d2e555f1620e tempest-VolumesActionsTest-1945194074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:20 devstack sudo[88479]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:20 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-47333654-e23d-4bea-a4fc-b66ffc408fcd tempest-CreateVolumesFromImageTest-1065198505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-40b54d2b-75be-43ac-9fd8-53cfeba760ce 1073741824" returned: 0 in 0.581s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:20 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-47333654-e23d-4bea-a4fc-b66ffc408fcd tempest-CreateVolumesFromImageTest-1065198505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-40b54d2b-75be-43ac-9fd8-53cfeba760ce {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:20 devstack sudo[88484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-40b54d2b-75be-43ac-9fd8-53cfeba760ce
Feb 27 01:27:20 devstack sudo[88484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:20 devstack sudo[88484]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:20 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-47333654-e23d-4bea-a4fc-b66ffc408fcd tempest-CreateVolumesFromImageTest-1065198505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-40b54d2b-75be-43ac-9fd8-53cfeba760ce" returned: 0 in 0.469s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:20 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-47333654-e23d-4bea-a4fc-b66ffc408fcd tempest-CreateVolumesFromImageTest-1065198505 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:27:20 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-47333654-e23d-4bea-a4fc-b66ffc408fcd tempest-CreateVolumesFromImageTest-1065198505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:20 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-4527470f-7756-4223-ab96-a3037fa7164d tempest-CreateVolumesFromImageTest-1065198505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.525s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:20 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-4527470f-7756-4223-ab96-a3037fa7164d tempest-CreateVolumesFromImageTest-1065198505 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1033308475',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=215110df-a9d7-4b2e-a281-4f942c55dc1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bcdd53a2b2c4c80940f7d56793b1a5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:15Z,use_quota=True,user_id='ba9e0fac3cf149ea9c964d9a58b5d8bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:27:20 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-4527470f-7756-4223-ab96-a3037fa7164d tempest-CreateVolumesFromImageTest-1065198505 None] Creating volume 215110df-a9d7-4b2e-a281-4f942c55dc1e {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:27:20 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-4527470f-7756-4223-ab96-a3037fa7164d tempest-CreateVolumesFromImageTest-1065198505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:20 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-4527470f-7756-4223-ab96-a3037fa7164d tempest-CreateVolumesFromImageTest-1065198505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:20 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-4527470f-7756-4223-ab96-a3037fa7164d tempest-CreateVolumesFromImageTest-1065198505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:20 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-4527470f-7756-4223-ab96-a3037fa7164d tempest-CreateVolumesFromImageTest-1065198505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:20 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-4527470f-7756-4223-ab96-a3037fa7164d tempest-CreateVolumesFromImageTest-1065198505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:20 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-4527470f-7756-4223-ab96-a3037fa7164d tempest-CreateVolumesFromImageTest-1065198505 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:27:20 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-4527470f-7756-4223-ab96-a3037fa7164d tempest-CreateVolumesFromImageTest-1065198505 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:27:20 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-4527470f-7756-4223-ab96-a3037fa7164d tempest-CreateVolumesFromImageTest-1065198505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-215110df-a9d7-4b2e-a281-4f942c55dc1e 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:21 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-47333654-e23d-4bea-a4fc-b66ffc408fcd tempest-CreateVolumesFromImageTest-1065198505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (333495cd-d386-4313-95df-3b4d5f41bd35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40b54d2b-75be-43ac-9fd8-53cfeba760ce', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:21 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-47333654-e23d-4bea-a4fc-b66ffc408fcd tempest-CreateVolumesFromImageTest-1065198505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58eb3a61-c644-4c26-8a67-d049699a065c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:21 devstack sudo[88487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-215110df-a9d7-4b2e-a281-4f942c55dc1e 1073741824
Feb 27 01:27:21 devstack sudo[88487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:21 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-47333654-e23d-4bea-a4fc-b66ffc408fcd tempest-CreateVolumesFromImageTest-1065198505 None] Volume volume-40b54d2b-75be-43ac-9fd8-53cfeba760ce (40b54d2b-75be-43ac-9fd8-53cfeba760ce): created successfully
Feb 27 01:27:21 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-47333654-e23d-4bea-a4fc-b66ffc408fcd tempest-CreateVolumesFromImageTest-1065198505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58eb3a61-c644-4c26-8a67-d049699a065c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:21 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-47333654-e23d-4bea-a4fc-b66ffc408fcd tempest-CreateVolumesFromImageTest-1065198505 None] Flow 'volume_create_manager' (4cc9827d-91c9-498c-8279-6d74f69d68c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:21 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-47333654-e23d-4bea-a4fc-b66ffc408fcd tempest-CreateVolumesFromImageTest-1065198505 None] Created volume successfully.
Feb 27 01:27:21 devstack sudo[88487]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:21 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-4527470f-7756-4223-ab96-a3037fa7164d tempest-CreateVolumesFromImageTest-1065198505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-215110df-a9d7-4b2e-a281-4f942c55dc1e 1073741824" returned: 0 in 0.597s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:21 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-4527470f-7756-4223-ab96-a3037fa7164d tempest-CreateVolumesFromImageTest-1065198505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-215110df-a9d7-4b2e-a281-4f942c55dc1e {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:21 devstack sudo[88492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-215110df-a9d7-4b2e-a281-4f942c55dc1e
Feb 27 01:27:21 devstack sudo[88492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:22 devstack sudo[88492]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:22 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-4527470f-7756-4223-ab96-a3037fa7164d tempest-CreateVolumesFromImageTest-1065198505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-215110df-a9d7-4b2e-a281-4f942c55dc1e" returned: 0 in 0.543s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:22 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-4527470f-7756-4223-ab96-a3037fa7164d tempest-CreateVolumesFromImageTest-1065198505 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:27:22 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-4527470f-7756-4223-ab96-a3037fa7164d tempest-CreateVolumesFromImageTest-1065198505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:22 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-1be2c8ef-0f36-4207-90c7-8d35429a03f4 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 6.589s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:22 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-1be2c8ef-0f36-4207-90c7-8d35429a03f4 tempest-VolumesSnapshotTestJSON-708792780 None] Acquiring lock "cinder-quobyte-74ae11bb-fe6a-48a5-aeba-dcbd7e915c64-e56102f5-8063-4d7e-b138-3c2ef979160e" by "_create_volume_from_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:22 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-4527470f-7756-4223-ab96-a3037fa7164d tempest-CreateVolumesFromImageTest-1065198505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b452d04-6727-4540-86c4-5af27f9ff494) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-215110df-a9d7-4b2e-a281-4f942c55dc1e', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:22 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-4527470f-7756-4223-ab96-a3037fa7164d tempest-CreateVolumesFromImageTest-1065198505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2ddeb39-0af1-4886-8534-18d12a3c5dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:22 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-4527470f-7756-4223-ab96-a3037fa7164d tempest-CreateVolumesFromImageTest-1065198505 None] Volume volume-215110df-a9d7-4b2e-a281-4f942c55dc1e (215110df-a9d7-4b2e-a281-4f942c55dc1e): created successfully
Feb 27 01:27:22 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-4527470f-7756-4223-ab96-a3037fa7164d tempest-CreateVolumesFromImageTest-1065198505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2ddeb39-0af1-4886-8534-18d12a3c5dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:22 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-4527470f-7756-4223-ab96-a3037fa7164d tempest-CreateVolumesFromImageTest-1065198505 None] Flow 'volume_create_manager' (542a83f9-3472-46b3-9a14-171310a50da3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:22 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-1be2c8ef-0f36-4207-90c7-8d35429a03f4 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "cinder-quobyte-74ae11bb-fe6a-48a5-aeba-dcbd7e915c64-e56102f5-8063-4d7e-b138-3c2ef979160e" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:22 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-1be2c8ef-0f36-4207-90c7-8d35429a03f4 tempest-VolumesSnapshotTestJSON-708792780 None] Creating volume e56102f5-8063-4d7e-b138-3c2ef979160e from snapshot 74ae11bb-fe6a-48a5-aeba-dcbd7e915c64 {{(pid=83106) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Feb 27 01:27:22 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-1be2c8ef-0f36-4207-90c7-8d35429a03f4 tempest-VolumesSnapshotTestJSON-708792780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:22 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-1be2c8ef-0f36-4207-90c7-8d35429a03f4 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:22 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-1be2c8ef-0f36-4207-90c7-8d35429a03f4 tempest-VolumesSnapshotTestJSON-708792780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:22 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-1be2c8ef-0f36-4207-90c7-8d35429a03f4 tempest-VolumesSnapshotTestJSON-708792780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:22 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-1be2c8ef-0f36-4207-90c7-8d35429a03f4 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:22 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-1be2c8ef-0f36-4207-90c7-8d35429a03f4 tempest-VolumesSnapshotTestJSON-708792780 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:27:22 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-1be2c8ef-0f36-4207-90c7-8d35429a03f4 tempest-VolumesSnapshotTestJSON-708792780 None] Acquiring lock "cinder-quobyte-e56102f5-8063-4d7e-b138-3c2ef979160e" by "_copy_volume_from_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:22 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-4527470f-7756-4223-ab96-a3037fa7164d tempest-CreateVolumesFromImageTest-1065198505 None] Created volume successfully.
Feb 27 01:27:22 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-1be2c8ef-0f36-4207-90c7-8d35429a03f4 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "cinder-quobyte-e56102f5-8063-4d7e-b138-3c2ef979160e" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:22 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-1be2c8ef-0f36-4207-90c7-8d35429a03f4 tempest-VolumesSnapshotTestJSON-708792780 None] snapshot: 74ae11bb-fe6a-48a5-aeba-dcbd7e915c64, volume: e56102f5-8063-4d7e-b138-3c2ef979160e,  {{(pid=83106) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Feb 27 01:27:22 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-1be2c8ef-0f36-4207-90c7-8d35429a03f4 tempest-VolumesSnapshotTestJSON-708792780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:22 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-1be2c8ef-0f36-4207-90c7-8d35429a03f4 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:22 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-1be2c8ef-0f36-4207-90c7-8d35429a03f4 tempest-VolumesSnapshotTestJSON-708792780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:22 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-1be2c8ef-0f36-4207-90c7-8d35429a03f4 tempest-VolumesSnapshotTestJSON-708792780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:22 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-1be2c8ef-0f36-4207-90c7-8d35429a03f4 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:22 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a56655-de46-45a5-a325-a2193d27c0cb]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:22 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-1be2c8ef-0f36-4207-90c7-8d35429a03f4 tempest-VolumesSnapshotTestJSON-708792780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-cdfef233-6041-4768-b97d-9b716d1bf479.74ae11bb-fe6a-48a5-aeba-dcbd7e915c64 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:22 devstack sudo[88495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-cdfef233-6041-4768-b97d-9b716d1bf479.74ae11bb-fe6a-48a5-aeba-dcbd7e915c64
Feb 27 01:27:22 devstack sudo[88495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:22 devstack sudo[88495]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:22 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-1be2c8ef-0f36-4207-90c7-8d35429a03f4 tempest-VolumesSnapshotTestJSON-708792780 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-cdfef233-6041-4768-b97d-9b716d1bf479.74ae11bb-fe6a-48a5-aeba-dcbd7e915c64" returned: 0 in 0.554s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:22 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-1be2c8ef-0f36-4207-90c7-8d35429a03f4 tempest-VolumesSnapshotTestJSON-708792780 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cdfef233-6041-4768-b97d-9b716d1bf479(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83106) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:27:22 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-1be2c8ef-0f36-4207-90c7-8d35429a03f4 tempest-VolumesSnapshotTestJSON-708792780 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-cdfef233-6041-4768-b97d-9b716d1bf479 {{(pid=83106) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Feb 27 01:27:22 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-1be2c8ef-0f36-4207-90c7-8d35429a03f4 tempest-VolumesSnapshotTestJSON-708792780 None] Creating direct copy from snapshot {{(pid=83106) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Feb 27 01:27:22 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f267a7-343f-4a2f-964a-67588580a6ee]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:22 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-1be2c8ef-0f36-4207-90c7-8d35429a03f4 tempest-VolumesSnapshotTestJSON-708792780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-cdfef233-6041-4768-b97d-9b716d1bf479 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:22 devstack sudo[88501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-cdfef233-6041-4768-b97d-9b716d1bf479
Feb 27 01:27:22 devstack sudo[88501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:23 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-c653f4f8-743f-48df-9e47-070cbf465f4e tempest-CreateVolumesFromImageTest-1065198505 None] Acquiring lock "cinder-215110df-a9d7-4b2e-a281-4f942c55dc1e-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:23 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-c653f4f8-743f-48df-9e47-070cbf465f4e tempest-CreateVolumesFromImageTest-1065198505 None] Lock "cinder-215110df-a9d7-4b2e-a281-4f942c55dc1e-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:23 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-c653f4f8-743f-48df-9e47-070cbf465f4e tempest-CreateVolumesFromImageTest-1065198505 None] Acquiring lock "cinder-quobyte-215110df-a9d7-4b2e-a281-4f942c55dc1e" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:23 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-c653f4f8-743f-48df-9e47-070cbf465f4e tempest-CreateVolumesFromImageTest-1065198505 None] Lock "cinder-quobyte-215110df-a9d7-4b2e-a281-4f942c55dc1e" acquired by "delete_volume" :: waited 0.007s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:23 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8abce38-5f09-4181-9eff-2a26b3aa0024]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:23 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c653f4f8-743f-48df-9e47-070cbf465f4e tempest-CreateVolumesFromImageTest-1065198505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-215110df-a9d7-4b2e-a281-4f942c55dc1e {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:23 devstack sudo[88503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-215110df-a9d7-4b2e-a281-4f942c55dc1e
Feb 27 01:27:23 devstack sudo[88503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:23 devstack sudo[88501]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:23 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-1be2c8ef-0f36-4207-90c7-8d35429a03f4 tempest-VolumesSnapshotTestJSON-708792780 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-cdfef233-6041-4768-b97d-9b716d1bf479" returned: 0 in 0.570s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:23 devstack cinder-volume[83106]: DEBUG cinder.utils [None req-1be2c8ef-0f36-4207-90c7-8d35429a03f4 tempest-VolumesSnapshotTestJSON-708792780 None] Path /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e56102f5-8063-4d7e-b138-3c2ef979160e not found in is_blk_device check {{(pid=83106) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Feb 27 01:27:23 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-1be2c8ef-0f36-4207-90c7-8d35429a03f4 tempest-VolumesSnapshotTestJSON-708792780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-cdfef233-6041-4768-b97d-9b716d1bf479 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e56102f5-8063-4d7e-b138-3c2ef979160e {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:23 devstack sudo[88508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-cdfef233-6041-4768-b97d-9b716d1bf479 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e56102f5-8063-4d7e-b138-3c2ef979160e
Feb 27 01:27:23 devstack sudo[88508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:23 devstack sudo[88503]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:23 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c653f4f8-743f-48df-9e47-070cbf465f4e tempest-CreateVolumesFromImageTest-1065198505 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-215110df-a9d7-4b2e-a281-4f942c55dc1e" returned: 0 in 0.521s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:23 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c653f4f8-743f-48df-9e47-070cbf465f4e tempest-CreateVolumesFromImageTest-1065198505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-215110df-a9d7-4b2e-a281-4f942c55dc1e {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:23 devstack sudo[88514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-215110df-a9d7-4b2e-a281-4f942c55dc1e
Feb 27 01:27:23 devstack sudo[88514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:24 devstack sudo[88514]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:24 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c653f4f8-743f-48df-9e47-070cbf465f4e tempest-CreateVolumesFromImageTest-1065198505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-215110df-a9d7-4b2e-a281-4f942c55dc1e" returned: 0 in 1.131s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:24 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-c653f4f8-743f-48df-9e47-070cbf465f4e tempest-CreateVolumesFromImageTest-1065198505 None] Lock "cinder-quobyte-215110df-a9d7-4b2e-a281-4f942c55dc1e" released by "delete_volume" :: held 1.682s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:24 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-c653f4f8-743f-48df-9e47-070cbf465f4e tempest-CreateVolumesFromImageTest-1065198505 None] Created reservations ['b1f2a5ae-453e-4c97-9b86-a8cc81671ed6', '9f9d362f-f65b-4450-a1fc-e846b5af1ff5', 'fd76e5c9-2f55-43fb-90c2-66defb180813', '4d4c3129-f2b9-45d4-a1e4-fb49c1f3853a'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:27:25 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-c653f4f8-743f-48df-9e47-070cbf465f4e tempest-CreateVolumesFromImageTest-1065198505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:25 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-c653f4f8-743f-48df-9e47-070cbf465f4e tempest-CreateVolumesFromImageTest-1065198505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:25 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-c653f4f8-743f-48df-9e47-070cbf465f4e tempest-CreateVolumesFromImageTest-1065198505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:25 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-c653f4f8-743f-48df-9e47-070cbf465f4e tempest-CreateVolumesFromImageTest-1065198505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:25 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-c653f4f8-743f-48df-9e47-070cbf465f4e tempest-CreateVolumesFromImageTest-1065198505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:25 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c653f4f8-743f-48df-9e47-070cbf465f4e tempest-CreateVolumesFromImageTest-1065198505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:25 devstack sudo[88528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:27:25 devstack sudo[88528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:25 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-0efc8bbb-9de2-4857-8981-958d8efd2d02 tempest-CreateVolumesFromImageTest-1065198505 None] Acquiring lock "cinder-40b54d2b-75be-43ac-9fd8-53cfeba760ce-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:25 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-0efc8bbb-9de2-4857-8981-958d8efd2d02 tempest-CreateVolumesFromImageTest-1065198505 None] Lock "cinder-40b54d2b-75be-43ac-9fd8-53cfeba760ce-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:25 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-0efc8bbb-9de2-4857-8981-958d8efd2d02 tempest-CreateVolumesFromImageTest-1065198505 None] Acquiring lock "cinder-quobyte-40b54d2b-75be-43ac-9fd8-53cfeba760ce" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:25 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-0efc8bbb-9de2-4857-8981-958d8efd2d02 tempest-CreateVolumesFromImageTest-1065198505 None] Lock "cinder-quobyte-40b54d2b-75be-43ac-9fd8-53cfeba760ce" acquired by "delete_volume" :: waited 0.024s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:25 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[4488f5d9-5009-4455-a1fe-7479d7426d81]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:25 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0efc8bbb-9de2-4857-8981-958d8efd2d02 tempest-CreateVolumesFromImageTest-1065198505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-40b54d2b-75be-43ac-9fd8-53cfeba760ce {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:26 devstack sudo[88530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-40b54d2b-75be-43ac-9fd8-53cfeba760ce
Feb 27 01:27:26 devstack sudo[88530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:26 devstack sudo[88508]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:26 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-1be2c8ef-0f36-4207-90c7-8d35429a03f4 tempest-VolumesSnapshotTestJSON-708792780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-cdfef233-6041-4768-b97d-9b716d1bf479 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e56102f5-8063-4d7e-b138-3c2ef979160e" returned: 0 in 2.936s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:26 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4860d6-de73-4b94-a2ad-6804257829a6]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:26 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-1be2c8ef-0f36-4207-90c7-8d35429a03f4 tempest-VolumesSnapshotTestJSON-708792780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-cdfef233-6041-4768-b97d-9b716d1bf479 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:26 devstack sudo[88528]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:26 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c653f4f8-743f-48df-9e47-070cbf465f4e tempest-CreateVolumesFromImageTest-1065198505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 1.209s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:26 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-c653f4f8-743f-48df-9e47-070cbf465f4e tempest-CreateVolumesFromImageTest-1065198505 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:27:26 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-c653f4f8-743f-48df-9e47-070cbf465f4e tempest-CreateVolumesFromImageTest-1065198505 None] Deleted volume successfully.
Feb 27 01:27:26 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-c653f4f8-743f-48df-9e47-070cbf465f4e tempest-CreateVolumesFromImageTest-1065198505 None] Lock "cinder-215110df-a9d7-4b2e-a281-4f942c55dc1e-delete_volume" released by "delete_volume" :: held 3.315s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:26 devstack sudo[88534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-cdfef233-6041-4768-b97d-9b716d1bf479
Feb 27 01:27:26 devstack sudo[88534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:26 devstack sudo[88530]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:26 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0efc8bbb-9de2-4857-8981-958d8efd2d02 tempest-CreateVolumesFromImageTest-1065198505 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-40b54d2b-75be-43ac-9fd8-53cfeba760ce" returned: 0 in 0.747s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:26 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0efc8bbb-9de2-4857-8981-958d8efd2d02 tempest-CreateVolumesFromImageTest-1065198505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-40b54d2b-75be-43ac-9fd8-53cfeba760ce {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:26 devstack sudo[88539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-40b54d2b-75be-43ac-9fd8-53cfeba760ce
Feb 27 01:27:26 devstack sudo[88539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:27 devstack sudo[88534]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-1be2c8ef-0f36-4207-90c7-8d35429a03f4 tempest-VolumesSnapshotTestJSON-708792780 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-cdfef233-6041-4768-b97d-9b716d1bf479" returned: 0 in 0.914s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:27 devstack cinder-volume[83106]: DEBUG cinder.image.image_utils [None req-1be2c8ef-0f36-4207-90c7-8d35429a03f4 tempest-VolumesSnapshotTestJSON-708792780 None] Image conversion details: src /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-cdfef233-6041-4768-b97d-9b716d1bf479, size 1024.00 MB, duration 2.94 sec, destination /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e56102f5-8063-4d7e-b138-3c2ef979160e {{(pid=83106) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 27 01:27:27 devstack cinder-volume[83106]: INFO cinder.image.image_utils [None req-1be2c8ef-0f36-4207-90c7-8d35429a03f4 tempest-VolumesSnapshotTestJSON-708792780 None] Converted 1024.00 MB image at 348.63 MB/s
Feb 27 01:27:27 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-1be2c8ef-0f36-4207-90c7-8d35429a03f4 tempest-VolumesSnapshotTestJSON-708792780 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e56102f5-8063-4d7e-b138-3c2ef979160e is being set with open permissions: ugo+rw
Feb 27 01:27:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-1be2c8ef-0f36-4207-90c7-8d35429a03f4 tempest-VolumesSnapshotTestJSON-708792780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e56102f5-8063-4d7e-b138-3c2ef979160e {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:27 devstack sudo[88545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e56102f5-8063-4d7e-b138-3c2ef979160e
Feb 27 01:27:27 devstack sudo[88545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:27 devstack sudo[88539]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0efc8bbb-9de2-4857-8981-958d8efd2d02 tempest-CreateVolumesFromImageTest-1065198505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-40b54d2b-75be-43ac-9fd8-53cfeba760ce" returned: 0 in 0.621s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:27 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-0efc8bbb-9de2-4857-8981-958d8efd2d02 tempest-CreateVolumesFromImageTest-1065198505 None] Lock "cinder-quobyte-40b54d2b-75be-43ac-9fd8-53cfeba760ce" released by "delete_volume" :: held 1.440s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:27 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-0efc8bbb-9de2-4857-8981-958d8efd2d02 tempest-CreateVolumesFromImageTest-1065198505 None] Created reservations ['abca320a-bc71-4b12-bf4c-2930c1ff502c', '42f1d1b5-156e-4628-a788-de7cf1286381', '78fe2255-d81a-4711-9859-7b9ae413b3a0', '6e1a3275-ce03-455c-9c96-049795a99f69'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:27:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-0efc8bbb-9de2-4857-8981-958d8efd2d02 tempest-CreateVolumesFromImageTest-1065198505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-0efc8bbb-9de2-4857-8981-958d8efd2d02 tempest-CreateVolumesFromImageTest-1065198505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:27 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-0efc8bbb-9de2-4857-8981-958d8efd2d02 tempest-CreateVolumesFromImageTest-1065198505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:27 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-0efc8bbb-9de2-4857-8981-958d8efd2d02 tempest-CreateVolumesFromImageTest-1065198505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-0efc8bbb-9de2-4857-8981-958d8efd2d02 tempest-CreateVolumesFromImageTest-1065198505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0efc8bbb-9de2-4857-8981-958d8efd2d02 tempest-CreateVolumesFromImageTest-1065198505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:27 devstack sudo[88547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:27:27 devstack sudo[88547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:27 devstack sudo[88545]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-1be2c8ef-0f36-4207-90c7-8d35429a03f4 tempest-VolumesSnapshotTestJSON-708792780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e56102f5-8063-4d7e-b138-3c2ef979160e" returned: 0 in 0.511s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:27 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-1be2c8ef-0f36-4207-90c7-8d35429a03f4 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "cinder-quobyte-e56102f5-8063-4d7e-b138-3c2ef979160e" released by "_copy_volume_from_snapshot" :: held 5.551s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:27 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-1be2c8ef-0f36-4207-90c7-8d35429a03f4 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "cinder-quobyte-74ae11bb-fe6a-48a5-aeba-dcbd7e915c64-e56102f5-8063-4d7e-b138-3c2ef979160e" released by "_create_volume_from_snapshot" :: held 5.578s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-1be2c8ef-0f36-4207-90c7-8d35429a03f4 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.615s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-60ffd6a5-c7f5-461c-b343-d2e555f1620e tempest-VolumesActionsTest-1945194074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.757s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:27 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-60ffd6a5-c7f5-461c-b343-d2e555f1620e tempest-VolumesActionsTest-1945194074 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-871789663',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53d4d29e-8a59-491d-8708-c02b479bee89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be9dc0daf3794a089ad1aff6cd82e870',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:20Z,use_quota=True,user_id='c3f639f013f94fea9ca5469ad886c89b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:27:27 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-60ffd6a5-c7f5-461c-b343-d2e555f1620e tempest-VolumesActionsTest-1945194074 None] Creating volume 53d4d29e-8a59-491d-8708-c02b479bee89 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:27:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-60ffd6a5-c7f5-461c-b343-d2e555f1620e tempest-VolumesActionsTest-1945194074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-60ffd6a5-c7f5-461c-b343-d2e555f1620e tempest-VolumesActionsTest-1945194074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:27 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-60ffd6a5-c7f5-461c-b343-d2e555f1620e tempest-VolumesActionsTest-1945194074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:27 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-60ffd6a5-c7f5-461c-b343-d2e555f1620e tempest-VolumesActionsTest-1945194074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-60ffd6a5-c7f5-461c-b343-d2e555f1620e tempest-VolumesActionsTest-1945194074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:27 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-60ffd6a5-c7f5-461c-b343-d2e555f1620e tempest-VolumesActionsTest-1945194074 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:27:27 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-60ffd6a5-c7f5-461c-b343-d2e555f1620e tempest-VolumesActionsTest-1945194074 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:27:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-60ffd6a5-c7f5-461c-b343-d2e555f1620e tempest-VolumesActionsTest-1945194074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-53d4d29e-8a59-491d-8708-c02b479bee89 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:27 devstack sudo[88550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-53d4d29e-8a59-491d-8708-c02b479bee89 1073741824
Feb 27 01:27:27 devstack sudo[88550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:27 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1be2c8ef-0f36-4207-90c7-8d35429a03f4 tempest-VolumesSnapshotTestJSON-708792780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (162cc7e4-50c4-4c14-a459-b75497ff285b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e56102f5-8063-4d7e-b138-3c2ef979160e', 'volume_size': 2, 'snapshot_id': '74ae11bb-fe6a-48a5-aeba-dcbd7e915c64'}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:27 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1be2c8ef-0f36-4207-90c7-8d35429a03f4 tempest-VolumesSnapshotTestJSON-708792780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c0a3eb7-92d6-4f15-a153-fc6d58006815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:27 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-1be2c8ef-0f36-4207-90c7-8d35429a03f4 tempest-VolumesSnapshotTestJSON-708792780 None] Volume volume-e56102f5-8063-4d7e-b138-3c2ef979160e (e56102f5-8063-4d7e-b138-3c2ef979160e): created successfully
Feb 27 01:27:27 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1be2c8ef-0f36-4207-90c7-8d35429a03f4 tempest-VolumesSnapshotTestJSON-708792780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c0a3eb7-92d6-4f15-a153-fc6d58006815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:27 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1be2c8ef-0f36-4207-90c7-8d35429a03f4 tempest-VolumesSnapshotTestJSON-708792780 None] Flow 'volume_create_manager' (c73724e9-e3ab-46d0-b466-b475f2037259) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:27 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-1be2c8ef-0f36-4207-90c7-8d35429a03f4 tempest-VolumesSnapshotTestJSON-708792780 None] Created volume successfully.
Feb 27 01:27:28 devstack sudo[88547]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:28 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0efc8bbb-9de2-4857-8981-958d8efd2d02 tempest-CreateVolumesFromImageTest-1065198505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.650s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:28 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-0efc8bbb-9de2-4857-8981-958d8efd2d02 tempest-CreateVolumesFromImageTest-1065198505 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:27:28 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-0efc8bbb-9de2-4857-8981-958d8efd2d02 tempest-CreateVolumesFromImageTest-1065198505 None] Deleted volume successfully.
Feb 27 01:27:28 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-0efc8bbb-9de2-4857-8981-958d8efd2d02 tempest-CreateVolumesFromImageTest-1065198505 None] Lock "cinder-40b54d2b-75be-43ac-9fd8-53cfeba760ce-delete_volume" released by "delete_volume" :: held 2.339s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:28 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-c53d8def-3894-4abc-a6dd-4e8c6993a3aa tempest-CreateVolumesFromImageTest-1065198505 None] Acquiring lock "cinder-c7639162-97ad-4b17-9752-4de21ad83458-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:28 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-c53d8def-3894-4abc-a6dd-4e8c6993a3aa tempest-CreateVolumesFromImageTest-1065198505 None] Lock "cinder-c7639162-97ad-4b17-9752-4de21ad83458-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:28 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-c53d8def-3894-4abc-a6dd-4e8c6993a3aa tempest-CreateVolumesFromImageTest-1065198505 None] Acquiring lock "cinder-quobyte-c7639162-97ad-4b17-9752-4de21ad83458" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:28 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-c53d8def-3894-4abc-a6dd-4e8c6993a3aa tempest-CreateVolumesFromImageTest-1065198505 None] Lock "cinder-quobyte-c7639162-97ad-4b17-9752-4de21ad83458" acquired by "delete_volume" :: waited 0.009s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:28 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d85160-29d0-43c2-a0c2-1e398c436f60]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:28 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c53d8def-3894-4abc-a6dd-4e8c6993a3aa tempest-CreateVolumesFromImageTest-1065198505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c7639162-97ad-4b17-9752-4de21ad83458 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:28 devstack sudo[88553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c7639162-97ad-4b17-9752-4de21ad83458
Feb 27 01:27:28 devstack sudo[88553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:28 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-e5a4b21f-ab24-4edb-94e4-f049a711f372 tempest-VolumesSnapshotTestJSON-708792780 None] Acquiring lock "cinder-e56102f5-8063-4d7e-b138-3c2ef979160e-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:28 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-e5a4b21f-ab24-4edb-94e4-f049a711f372 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "cinder-e56102f5-8063-4d7e-b138-3c2ef979160e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:28 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-e5a4b21f-ab24-4edb-94e4-f049a711f372 tempest-VolumesSnapshotTestJSON-708792780 None] Acquiring lock "cinder-quobyte-e56102f5-8063-4d7e-b138-3c2ef979160e" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:28 devstack sudo[88550]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:28 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-e5a4b21f-ab24-4edb-94e4-f049a711f372 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "cinder-quobyte-e56102f5-8063-4d7e-b138-3c2ef979160e" acquired by "delete_volume" :: waited 0.015s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:28 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-60ffd6a5-c7f5-461c-b343-d2e555f1620e tempest-VolumesActionsTest-1945194074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-53d4d29e-8a59-491d-8708-c02b479bee89 1073741824" returned: 0 in 0.793s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:28 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[7edd743f-51d3-45db-81f1-b5734662cc78]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:28 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-e5a4b21f-ab24-4edb-94e4-f049a711f372 tempest-VolumesSnapshotTestJSON-708792780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e56102f5-8063-4d7e-b138-3c2ef979160e {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:28 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-60ffd6a5-c7f5-461c-b343-d2e555f1620e tempest-VolumesActionsTest-1945194074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-53d4d29e-8a59-491d-8708-c02b479bee89 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:28 devstack sudo[88559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-53d4d29e-8a59-491d-8708-c02b479bee89
Feb 27 01:27:28 devstack sudo[88559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:28 devstack sudo[88558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e56102f5-8063-4d7e-b138-3c2ef979160e
Feb 27 01:27:28 devstack sudo[88558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:29 devstack sudo[88553]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:29 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c53d8def-3894-4abc-a6dd-4e8c6993a3aa tempest-CreateVolumesFromImageTest-1065198505 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c7639162-97ad-4b17-9752-4de21ad83458" returned: 0 in 0.778s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:29 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c53d8def-3894-4abc-a6dd-4e8c6993a3aa tempest-CreateVolumesFromImageTest-1065198505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c7639162-97ad-4b17-9752-4de21ad83458 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:29 devstack sudo[88565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c7639162-97ad-4b17-9752-4de21ad83458
Feb 27 01:27:29 devstack sudo[88565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:29 devstack sudo[88559]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:29 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-60ffd6a5-c7f5-461c-b343-d2e555f1620e tempest-VolumesActionsTest-1945194074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-53d4d29e-8a59-491d-8708-c02b479bee89" returned: 0 in 0.563s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:29 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-60ffd6a5-c7f5-461c-b343-d2e555f1620e tempest-VolumesActionsTest-1945194074 None] <== create_volume: return (1431ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:27:29 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-60ffd6a5-c7f5-461c-b343-d2e555f1620e tempest-VolumesActionsTest-1945194074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.436s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:29 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-60ffd6a5-c7f5-461c-b343-d2e555f1620e tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ac21607-ca7c-47b0-a4f1-13cf13e4261b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53d4d29e-8a59-491d-8708-c02b479bee89', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:29 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-60ffd6a5-c7f5-461c-b343-d2e555f1620e tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d698058c-45c9-43c9-9d9d-aaa6c8090fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:29 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-60ffd6a5-c7f5-461c-b343-d2e555f1620e tempest-VolumesActionsTest-1945194074 None] Volume volume-53d4d29e-8a59-491d-8708-c02b479bee89 (53d4d29e-8a59-491d-8708-c02b479bee89): created successfully
Feb 27 01:27:29 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-60ffd6a5-c7f5-461c-b343-d2e555f1620e tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d698058c-45c9-43c9-9d9d-aaa6c8090fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:29 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-60ffd6a5-c7f5-461c-b343-d2e555f1620e tempest-VolumesActionsTest-1945194074 None] Flow 'volume_create_manager' (3139d0ca-42e1-4b52-94ef-4d3221b8f08f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:29 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-60ffd6a5-c7f5-461c-b343-d2e555f1620e tempest-VolumesActionsTest-1945194074 None] Created volume successfully.
Feb 27 01:27:29 devstack sudo[88558]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:29 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-e5a4b21f-ab24-4edb-94e4-f049a711f372 tempest-VolumesSnapshotTestJSON-708792780 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e56102f5-8063-4d7e-b138-3c2ef979160e" returned: 0 in 0.728s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:29 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-e5a4b21f-ab24-4edb-94e4-f049a711f372 tempest-VolumesSnapshotTestJSON-708792780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e56102f5-8063-4d7e-b138-3c2ef979160e {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:29 devstack sudo[88571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e56102f5-8063-4d7e-b138-3c2ef979160e
Feb 27 01:27:29 devstack sudo[88571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:29 devstack sudo[88565]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:29 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c53d8def-3894-4abc-a6dd-4e8c6993a3aa tempest-CreateVolumesFromImageTest-1065198505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c7639162-97ad-4b17-9752-4de21ad83458" returned: 0 in 0.502s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:29 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-c53d8def-3894-4abc-a6dd-4e8c6993a3aa tempest-CreateVolumesFromImageTest-1065198505 None] Lock "cinder-quobyte-c7639162-97ad-4b17-9752-4de21ad83458" released by "delete_volume" :: held 1.325s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:29 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-c53d8def-3894-4abc-a6dd-4e8c6993a3aa tempest-CreateVolumesFromImageTest-1065198505 None] Created reservations ['6be37270-b817-49ce-ace0-8854ff2b8d6d', '2c680425-a7f6-4d0f-a3cc-4053d387857e', '8e0039f9-bfe9-486b-8b09-b11ca4f61449', '29deb5cb-6679-4b97-a71e-e85b32ace9d3'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:27:29 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-c53d8def-3894-4abc-a6dd-4e8c6993a3aa tempest-CreateVolumesFromImageTest-1065198505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:29 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-c53d8def-3894-4abc-a6dd-4e8c6993a3aa tempest-CreateVolumesFromImageTest-1065198505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:29 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-c53d8def-3894-4abc-a6dd-4e8c6993a3aa tempest-CreateVolumesFromImageTest-1065198505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:29 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-c53d8def-3894-4abc-a6dd-4e8c6993a3aa tempest-CreateVolumesFromImageTest-1065198505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:29 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-c53d8def-3894-4abc-a6dd-4e8c6993a3aa tempest-CreateVolumesFromImageTest-1065198505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:29 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c53d8def-3894-4abc-a6dd-4e8c6993a3aa tempest-CreateVolumesFromImageTest-1065198505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:29 devstack sudo[88574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:27:29 devstack sudo[88574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:29 devstack sudo[88571]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:29 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-e5a4b21f-ab24-4edb-94e4-f049a711f372 tempest-VolumesSnapshotTestJSON-708792780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e56102f5-8063-4d7e-b138-3c2ef979160e" returned: 0 in 0.645s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:30 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-289d7ef5-15d4-440a-bfd6-725c7b85c424 tempest-VolumesActionsTest-1938141483 None] Acquiring lock "cinder-53d4d29e-8a59-491d-8708-c02b479bee89-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:30 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-e5a4b21f-ab24-4edb-94e4-f049a711f372 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "cinder-quobyte-e56102f5-8063-4d7e-b138-3c2ef979160e" released by "delete_volume" :: held 1.427s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:30 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-289d7ef5-15d4-440a-bfd6-725c7b85c424 tempest-VolumesActionsTest-1938141483 None] Lock "cinder-53d4d29e-8a59-491d-8708-c02b479bee89-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:30 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-289d7ef5-15d4-440a-bfd6-725c7b85c424 tempest-VolumesActionsTest-1938141483 None] Acquiring lock "cinder-quobyte-53d4d29e-8a59-491d-8708-c02b479bee89" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:30 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-e5a4b21f-ab24-4edb-94e4-f049a711f372 tempest-VolumesSnapshotTestJSON-708792780 None] Created reservations ['9ee1b978-07a0-491b-8a92-cba4120fa5ba', '5f09b303-6f61-44cf-9c3a-fa2ad2badaca', 'f0f28b9c-2c6c-4027-b9ae-02a26778fb2e', 'de5bbd0d-8083-4efe-badf-8648e80b9047'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:27:30 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-289d7ef5-15d4-440a-bfd6-725c7b85c424 tempest-VolumesActionsTest-1938141483 None] Lock "cinder-quobyte-53d4d29e-8a59-491d-8708-c02b479bee89" acquired by "delete_volume" :: waited 0.032s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:30 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc6ed76-6699-462d-bbdf-3c74a0bd4437]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:30 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-289d7ef5-15d4-440a-bfd6-725c7b85c424 tempest-VolumesActionsTest-1938141483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-53d4d29e-8a59-491d-8708-c02b479bee89 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:30 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-e5a4b21f-ab24-4edb-94e4-f049a711f372 tempest-VolumesSnapshotTestJSON-708792780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:30 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-e5a4b21f-ab24-4edb-94e4-f049a711f372 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:30 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-e5a4b21f-ab24-4edb-94e4-f049a711f372 tempest-VolumesSnapshotTestJSON-708792780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:30 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-e5a4b21f-ab24-4edb-94e4-f049a711f372 tempest-VolumesSnapshotTestJSON-708792780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:30 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-e5a4b21f-ab24-4edb-94e4-f049a711f372 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:30 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-e5a4b21f-ab24-4edb-94e4-f049a711f372 tempest-VolumesSnapshotTestJSON-708792780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:30 devstack sudo[88578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:27:30 devstack sudo[88578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:30 devstack sudo[88577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-53d4d29e-8a59-491d-8708-c02b479bee89
Feb 27 01:27:30 devstack sudo[88577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:30 devstack sudo[88574]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:30 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c53d8def-3894-4abc-a6dd-4e8c6993a3aa tempest-CreateVolumesFromImageTest-1065198505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.659s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:30 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-c53d8def-3894-4abc-a6dd-4e8c6993a3aa tempest-CreateVolumesFromImageTest-1065198505 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:27:30 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-c53d8def-3894-4abc-a6dd-4e8c6993a3aa tempest-CreateVolumesFromImageTest-1065198505 None] Deleted volume successfully.
Feb 27 01:27:30 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-c53d8def-3894-4abc-a6dd-4e8c6993a3aa tempest-CreateVolumesFromImageTest-1065198505 None] Lock "cinder-c7639162-97ad-4b17-9752-4de21ad83458-delete_volume" released by "delete_volume" :: held 2.236s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:30 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-8bce2030-4295-4d71-9d4c-5ec2eec29565 tempest-CreateVolumesFromImageTest-1065198505 None] Acquiring lock "cinder-18dbf232-1084-44c6-974a-0b5b2c3234a0-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:30 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-8bce2030-4295-4d71-9d4c-5ec2eec29565 tempest-CreateVolumesFromImageTest-1065198505 None] Lock "cinder-18dbf232-1084-44c6-974a-0b5b2c3234a0-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:30 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-8bce2030-4295-4d71-9d4c-5ec2eec29565 tempest-CreateVolumesFromImageTest-1065198505 None] Acquiring lock "cinder-quobyte-18dbf232-1084-44c6-974a-0b5b2c3234a0" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:30 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-8bce2030-4295-4d71-9d4c-5ec2eec29565 tempest-CreateVolumesFromImageTest-1065198505 None] Lock "cinder-quobyte-18dbf232-1084-44c6-974a-0b5b2c3234a0" acquired by "delete_volume" :: waited 0.011s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:30 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[735cc1f4-c616-4abc-906a-5cab5ffb8c02]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:30 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-8bce2030-4295-4d71-9d4c-5ec2eec29565 tempest-CreateVolumesFromImageTest-1065198505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-18dbf232-1084-44c6-974a-0b5b2c3234a0 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:30 devstack sudo[88582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-18dbf232-1084-44c6-974a-0b5b2c3234a0
Feb 27 01:27:30 devstack sudo[88582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:30 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-74fa4253-0157-40c5-9c05-ef72ae7a29d3 tempest-VolumesSnapshotTestJSON-708792780 None] Acquiring lock "cinder-74ae11bb-fe6a-48a5-aeba-dcbd7e915c64-delete_snapshot" by "delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:30 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-74fa4253-0157-40c5-9c05-ef72ae7a29d3 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "cinder-74ae11bb-fe6a-48a5-aeba-dcbd7e915c64-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:30 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-74fa4253-0157-40c5-9c05-ef72ae7a29d3 tempest-VolumesSnapshotTestJSON-708792780 None] Acquiring lock "cinder-quobyte-cdfef233-6041-4768-b97d-9b716d1bf479" by "delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:30 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-74fa4253-0157-40c5-9c05-ef72ae7a29d3 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "cinder-quobyte-cdfef233-6041-4768-b97d-9b716d1bf479" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:30 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-74fa4253-0157-40c5-9c05-ef72ae7a29d3 tempest-VolumesSnapshotTestJSON-708792780 None] Acquiring lock "cinder-quobyte-74ae11bb-fe6a-48a5-aeba-dcbd7e915c64" by "_delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:30 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-74fa4253-0157-40c5-9c05-ef72ae7a29d3 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "cinder-quobyte-74ae11bb-fe6a-48a5-aeba-dcbd7e915c64" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:30 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-74fa4253-0157-40c5-9c05-ef72ae7a29d3 tempest-VolumesSnapshotTestJSON-708792780 None] Deleting offline snapshot 74ae11bb-fe6a-48a5-aeba-dcbd7e915c64 of volume cdfef233-6041-4768-b97d-9b716d1bf479 {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:27:30 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-74fa4253-0157-40c5-9c05-ef72ae7a29d3 tempest-VolumesSnapshotTestJSON-708792780 None] snapshot_file for this snap is: volume-cdfef233-6041-4768-b97d-9b716d1bf479.74ae11bb-fe6a-48a5-aeba-dcbd7e915c64 {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:27:30 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[2368f010-85f4-415c-a364-1130def3e5dd]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:30 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-74fa4253-0157-40c5-9c05-ef72ae7a29d3 tempest-VolumesSnapshotTestJSON-708792780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-cdfef233-6041-4768-b97d-9b716d1bf479.74ae11bb-fe6a-48a5-aeba-dcbd7e915c64 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:31 devstack sudo[88578]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:31 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-e5a4b21f-ab24-4edb-94e4-f049a711f372 tempest-VolumesSnapshotTestJSON-708792780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.829s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:31 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-e5a4b21f-ab24-4edb-94e4-f049a711f372 tempest-VolumesSnapshotTestJSON-708792780 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:27:31 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-e5a4b21f-ab24-4edb-94e4-f049a711f372 tempest-VolumesSnapshotTestJSON-708792780 None] Deleted volume successfully.
Feb 27 01:27:31 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-e5a4b21f-ab24-4edb-94e4-f049a711f372 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "cinder-e56102f5-8063-4d7e-b138-3c2ef979160e-delete_volume" released by "delete_volume" :: held 2.557s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:31 devstack sudo[88577]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:31 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-289d7ef5-15d4-440a-bfd6-725c7b85c424 tempest-VolumesActionsTest-1938141483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-53d4d29e-8a59-491d-8708-c02b479bee89" returned: 0 in 0.978s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:31 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-289d7ef5-15d4-440a-bfd6-725c7b85c424 tempest-VolumesActionsTest-1938141483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-53d4d29e-8a59-491d-8708-c02b479bee89 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:31 devstack sudo[88588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-cdfef233-6041-4768-b97d-9b716d1bf479.74ae11bb-fe6a-48a5-aeba-dcbd7e915c64
Feb 27 01:27:31 devstack sudo[88588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:31 devstack sudo[88589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-53d4d29e-8a59-491d-8708-c02b479bee89
Feb 27 01:27:31 devstack sudo[88589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:31 devstack sudo[88582]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:31 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-8bce2030-4295-4d71-9d4c-5ec2eec29565 tempest-CreateVolumesFromImageTest-1065198505 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-18dbf232-1084-44c6-974a-0b5b2c3234a0" returned: 0 in 1.008s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:31 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-8bce2030-4295-4d71-9d4c-5ec2eec29565 tempest-CreateVolumesFromImageTest-1065198505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-18dbf232-1084-44c6-974a-0b5b2c3234a0 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:31 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-74fcd639-eaa2-4bfa-a09c-08812d45bdb3 tempest-VolumesActionsTest-1196644426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:27:31 devstack sudo[88598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-18dbf232-1084-44c6-974a-0b5b2c3234a0
Feb 27 01:27:31 devstack sudo[88598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:31 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-74fcd639-eaa2-4bfa-a09c-08812d45bdb3 tempest-VolumesActionsTest-1196644426 None] Flow 'volume_create_manager' (1a4074cd-2eab-4cc0-b8e5-27ed9ad05036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:31 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-74fcd639-eaa2-4bfa-a09c-08812d45bdb3 tempest-VolumesActionsTest-1196644426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49ce50a0-5398-4f76-895e-d16271cc148a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:31 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-74fcd639-eaa2-4bfa-a09c-08812d45bdb3 tempest-VolumesActionsTest-1196644426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49ce50a0-5398-4f76-895e-d16271cc148a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-483169980',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b66dc01-1c7a-427d-b771-a85154916559,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dd439f7751a4ef5939a471dfe0cb7c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:32Z,use_quota=True,user_id='9e8273161a904800a56283e590dcb045',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:31 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-74fcd639-eaa2-4bfa-a09c-08812d45bdb3 tempest-VolumesActionsTest-1196644426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a19a2236-541f-4d22-837b-965683a7c45e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:31 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-74fcd639-eaa2-4bfa-a09c-08812d45bdb3 tempest-VolumesActionsTest-1196644426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a19a2236-541f-4d22-837b-965683a7c45e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:31 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-74fcd639-eaa2-4bfa-a09c-08812d45bdb3 tempest-VolumesActionsTest-1196644426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4c8673d-7075-481e-a2a7-0c23148f2da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:31 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-74fcd639-eaa2-4bfa-a09c-08812d45bdb3 tempest-VolumesActionsTest-1196644426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4c8673d-7075-481e-a2a7-0c23148f2da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b66dc01-1c7a-427d-b771-a85154916559', 'volume_name': 'volume-0b66dc01-1c7a-427d-b771-a85154916559', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:31 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-74fcd639-eaa2-4bfa-a09c-08812d45bdb3 tempest-VolumesActionsTest-1196644426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeb58086-2fd8-40c3-add6-e3effd2423fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:31 devstack sudo[88588]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:31 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-74fcd639-eaa2-4bfa-a09c-08812d45bdb3 tempest-VolumesActionsTest-1196644426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeb58086-2fd8-40c3-add6-e3effd2423fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:31 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-74fcd639-eaa2-4bfa-a09c-08812d45bdb3 tempest-VolumesActionsTest-1196644426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f1615a4-0e19-456e-a2d4-63c4405ec29f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:31 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-74fcd639-eaa2-4bfa-a09c-08812d45bdb3 tempest-VolumesActionsTest-1196644426 None] Volume 0b66dc01-1c7a-427d-b771-a85154916559: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b66dc01-1c7a-427d-b771-a85154916559', 'volume_size': 1}
Feb 27 01:27:31 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-74fcd639-eaa2-4bfa-a09c-08812d45bdb3 tempest-VolumesActionsTest-1196644426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:31 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-74fcd639-eaa2-4bfa-a09c-08812d45bdb3 tempest-VolumesActionsTest-1196644426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:31 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-74fcd639-eaa2-4bfa-a09c-08812d45bdb3 tempest-VolumesActionsTest-1196644426 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-483169980',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b66dc01-1c7a-427d-b771-a85154916559,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dd439f7751a4ef5939a471dfe0cb7c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:32Z,use_quota=True,user_id='9e8273161a904800a56283e590dcb045',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:27:31 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-74fcd639-eaa2-4bfa-a09c-08812d45bdb3 tempest-VolumesActionsTest-1196644426 None] Creating volume 0b66dc01-1c7a-427d-b771-a85154916559 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:27:31 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-74fcd639-eaa2-4bfa-a09c-08812d45bdb3 tempest-VolumesActionsTest-1196644426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:31 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-74fcd639-eaa2-4bfa-a09c-08812d45bdb3 tempest-VolumesActionsTest-1196644426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:31 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-74fcd639-eaa2-4bfa-a09c-08812d45bdb3 tempest-VolumesActionsTest-1196644426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:31 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-74fcd639-eaa2-4bfa-a09c-08812d45bdb3 tempest-VolumesActionsTest-1196644426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:31 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-74fcd639-eaa2-4bfa-a09c-08812d45bdb3 tempest-VolumesActionsTest-1196644426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:31 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-74fcd639-eaa2-4bfa-a09c-08812d45bdb3 tempest-VolumesActionsTest-1196644426 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:27:31 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-74fcd639-eaa2-4bfa-a09c-08812d45bdb3 tempest-VolumesActionsTest-1196644426 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:27:31 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-74fcd639-eaa2-4bfa-a09c-08812d45bdb3 tempest-VolumesActionsTest-1196644426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0b66dc01-1c7a-427d-b771-a85154916559 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:31 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-74fa4253-0157-40c5-9c05-ef72ae7a29d3 tempest-VolumesSnapshotTestJSON-708792780 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-cdfef233-6041-4768-b97d-9b716d1bf479.74ae11bb-fe6a-48a5-aeba-dcbd7e915c64" returned: 0 in 0.733s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:31 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-74fa4253-0157-40c5-9c05-ef72ae7a29d3 tempest-VolumesSnapshotTestJSON-708792780 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cdfef233-6041-4768-b97d-9b716d1bf479(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83106) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:27:31 devstack sudo[88601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0b66dc01-1c7a-427d-b771-a85154916559 1073741824
Feb 27 01:27:31 devstack sudo[88601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:31 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[f653404d-5677-4772-8e29-b745e0070b61]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:31 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-74fa4253-0157-40c5-9c05-ef72ae7a29d3 tempest-VolumesSnapshotTestJSON-708792780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-cdfef233-6041-4768-b97d-9b716d1bf479 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:31 devstack sudo[88603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-cdfef233-6041-4768-b97d-9b716d1bf479
Feb 27 01:27:31 devstack sudo[88603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:31 devstack sudo[88589]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:31 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-289d7ef5-15d4-440a-bfd6-725c7b85c424 tempest-VolumesActionsTest-1938141483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-53d4d29e-8a59-491d-8708-c02b479bee89" returned: 0 in 0.771s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:31 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-289d7ef5-15d4-440a-bfd6-725c7b85c424 tempest-VolumesActionsTest-1938141483 None] Lock "cinder-quobyte-53d4d29e-8a59-491d-8708-c02b479bee89" released by "delete_volume" :: held 1.782s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:31 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-289d7ef5-15d4-440a-bfd6-725c7b85c424 tempest-VolumesActionsTest-1938141483 None] Created reservations ['04c8dda6-d296-49c1-ac5c-09f28608f224', '9a00aff3-ba0e-4a0e-9ea1-dcf2f04409ca', 'c529c41a-3c00-4a54-8010-7253897f9860', 'cdcc54c9-4155-4d6b-ab1a-f25817b713d9'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:27:31 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-289d7ef5-15d4-440a-bfd6-725c7b85c424 tempest-VolumesActionsTest-1938141483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:32 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-289d7ef5-15d4-440a-bfd6-725c7b85c424 tempest-VolumesActionsTest-1938141483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:32 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-289d7ef5-15d4-440a-bfd6-725c7b85c424 tempest-VolumesActionsTest-1938141483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:32 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-289d7ef5-15d4-440a-bfd6-725c7b85c424 tempest-VolumesActionsTest-1938141483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:32 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-289d7ef5-15d4-440a-bfd6-725c7b85c424 tempest-VolumesActionsTest-1938141483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:32 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-289d7ef5-15d4-440a-bfd6-725c7b85c424 tempest-VolumesActionsTest-1938141483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:32 devstack sudo[88605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:27:32 devstack sudo[88605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:32 devstack sudo[88598]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:32 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-8bce2030-4295-4d71-9d4c-5ec2eec29565 tempest-CreateVolumesFromImageTest-1065198505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-18dbf232-1084-44c6-974a-0b5b2c3234a0" returned: 0 in 0.521s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:32 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-8bce2030-4295-4d71-9d4c-5ec2eec29565 tempest-CreateVolumesFromImageTest-1065198505 None] Lock "cinder-quobyte-18dbf232-1084-44c6-974a-0b5b2c3234a0" released by "delete_volume" :: held 1.575s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:32 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-8bce2030-4295-4d71-9d4c-5ec2eec29565 tempest-CreateVolumesFromImageTest-1065198505 None] Created reservations ['ba9b5ae5-5dfe-4065-8a4f-23dd0c382e97', 'a81eb647-0228-46ee-9a1c-e8cd3277633a', '5239fc07-219c-4f32-9351-974e7d7e801e', 'a7770e87-9e5f-4321-a5eb-999e6cb08afd'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:27:32 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-8bce2030-4295-4d71-9d4c-5ec2eec29565 tempest-CreateVolumesFromImageTest-1065198505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:32 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-8bce2030-4295-4d71-9d4c-5ec2eec29565 tempest-CreateVolumesFromImageTest-1065198505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:32 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-8bce2030-4295-4d71-9d4c-5ec2eec29565 tempest-CreateVolumesFromImageTest-1065198505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:32 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-8bce2030-4295-4d71-9d4c-5ec2eec29565 tempest-CreateVolumesFromImageTest-1065198505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:32 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-8bce2030-4295-4d71-9d4c-5ec2eec29565 tempest-CreateVolumesFromImageTest-1065198505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:32 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-8bce2030-4295-4d71-9d4c-5ec2eec29565 tempest-CreateVolumesFromImageTest-1065198505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:32 devstack sudo[88611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:27:32 devstack sudo[88611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:32 devstack sudo[88601]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:32 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-74fcd639-eaa2-4bfa-a09c-08812d45bdb3 tempest-VolumesActionsTest-1196644426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0b66dc01-1c7a-427d-b771-a85154916559 1073741824" returned: 0 in 0.630s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:32 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-74fcd639-eaa2-4bfa-a09c-08812d45bdb3 tempest-VolumesActionsTest-1196644426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0b66dc01-1c7a-427d-b771-a85154916559 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:32 devstack sudo[88613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0b66dc01-1c7a-427d-b771-a85154916559
Feb 27 01:27:32 devstack sudo[88613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:32 devstack sudo[88603]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:32 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-a305bc90-f7a3-407b-a628-5b4d1a0fd1c6 tempest-VolumesActionsTest-1945194074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:27:32 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a305bc90-f7a3-407b-a628-5b4d1a0fd1c6 tempest-VolumesActionsTest-1945194074 None] Flow 'volume_create_manager' (cedb2cc6-f22a-4065-977a-eaf5c3802d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:32 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a305bc90-f7a3-407b-a628-5b4d1a0fd1c6 tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3551b9b6-9ebf-4cee-834d-23b3413d7e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:32 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-74fa4253-0157-40c5-9c05-ef72ae7a29d3 tempest-VolumesSnapshotTestJSON-708792780 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-cdfef233-6041-4768-b97d-9b716d1bf479" returned: 0 in 0.966s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:32 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-74fa4253-0157-40c5-9c05-ef72ae7a29d3 tempest-VolumesSnapshotTestJSON-708792780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-cdfef233-6041-4768-b97d-9b716d1bf479.74ae11bb-fe6a-48a5-aeba-dcbd7e915c64 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:32 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-ad7120c4-0dde-4d17-abeb-ef660227632d tempest-CreateVolumesFromImageTest-1065198505 None] Acquiring lock "cinder-c50fdf17-0a30-488c-a529-b5e7aff93e25-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:32 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a305bc90-f7a3-407b-a628-5b4d1a0fd1c6 tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3551b9b6-9ebf-4cee-834d-23b3413d7e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1185916719',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=672c53ca-ee2d-473f-8337-152832729e00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be9dc0daf3794a089ad1aff6cd82e870',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:33Z,use_quota=True,user_id='c3f639f013f94fea9ca5469ad886c89b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:32 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a305bc90-f7a3-407b-a628-5b4d1a0fd1c6 tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fb658ce-7140-4919-b9e7-6f384a958d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:32 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a305bc90-f7a3-407b-a628-5b4d1a0fd1c6 tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fb658ce-7140-4919-b9e7-6f384a958d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:32 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a305bc90-f7a3-407b-a628-5b4d1a0fd1c6 tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48b34012-0924-4d5e-9389-9aa20b2068ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:32 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a305bc90-f7a3-407b-a628-5b4d1a0fd1c6 tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48b34012-0924-4d5e-9389-9aa20b2068ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '672c53ca-ee2d-473f-8337-152832729e00', 'volume_name': 'volume-672c53ca-ee2d-473f-8337-152832729e00', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:32 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a305bc90-f7a3-407b-a628-5b4d1a0fd1c6 tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cf026e0-01ce-40ed-9237-20589bf095c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:32 devstack sudo[88619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-cdfef233-6041-4768-b97d-9b716d1bf479.74ae11bb-fe6a-48a5-aeba-dcbd7e915c64
Feb 27 01:27:32 devstack sudo[88619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:32 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a305bc90-f7a3-407b-a628-5b4d1a0fd1c6 tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cf026e0-01ce-40ed-9237-20589bf095c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:32 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a305bc90-f7a3-407b-a628-5b4d1a0fd1c6 tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50907932-1b7f-4b75-b72f-adf99bdc748b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:32 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-a305bc90-f7a3-407b-a628-5b4d1a0fd1c6 tempest-VolumesActionsTest-1945194074 None] Volume 672c53ca-ee2d-473f-8337-152832729e00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-672c53ca-ee2d-473f-8337-152832729e00', 'volume_size': 1}
Feb 27 01:27:32 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-a305bc90-f7a3-407b-a628-5b4d1a0fd1c6 tempest-VolumesActionsTest-1945194074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:32 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-ad7120c4-0dde-4d17-abeb-ef660227632d tempest-CreateVolumesFromImageTest-1065198505 None] Lock "cinder-c50fdf17-0a30-488c-a529-b5e7aff93e25-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:32 devstack sudo[88605]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:32 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-289d7ef5-15d4-440a-bfd6-725c7b85c424 tempest-VolumesActionsTest-1938141483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.861s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:32 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-289d7ef5-15d4-440a-bfd6-725c7b85c424 tempest-VolumesActionsTest-1938141483 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:27:32 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-ad7120c4-0dde-4d17-abeb-ef660227632d tempest-CreateVolumesFromImageTest-1065198505 None] Acquiring lock "cinder-quobyte-c50fdf17-0a30-488c-a529-b5e7aff93e25" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:32 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-289d7ef5-15d4-440a-bfd6-725c7b85c424 tempest-VolumesActionsTest-1938141483 None] Deleted volume successfully.
Feb 27 01:27:32 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-ad7120c4-0dde-4d17-abeb-ef660227632d tempest-CreateVolumesFromImageTest-1065198505 None] Lock "cinder-quobyte-c50fdf17-0a30-488c-a529-b5e7aff93e25" acquired by "delete_volume" :: waited 0.017s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:32 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-289d7ef5-15d4-440a-bfd6-725c7b85c424 tempest-VolumesActionsTest-1938141483 None] Lock "cinder-53d4d29e-8a59-491d-8708-c02b479bee89-delete_volume" released by "delete_volume" :: held 2.871s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:32 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c203d18-0928-43c2-9a31-149f480a7714]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:32 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ad7120c4-0dde-4d17-abeb-ef660227632d tempest-CreateVolumesFromImageTest-1065198505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c50fdf17-0a30-488c-a529-b5e7aff93e25 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:33 devstack sudo[88622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c50fdf17-0a30-488c-a529-b5e7aff93e25
Feb 27 01:27:33 devstack sudo[88622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:33 devstack sudo[88611]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:33 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-8bce2030-4295-4d71-9d4c-5ec2eec29565 tempest-CreateVolumesFromImageTest-1065198505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.749s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:33 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-8bce2030-4295-4d71-9d4c-5ec2eec29565 tempest-CreateVolumesFromImageTest-1065198505 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:27:33 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-8bce2030-4295-4d71-9d4c-5ec2eec29565 tempest-CreateVolumesFromImageTest-1065198505 None] Deleted volume successfully.
Feb 27 01:27:33 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-8bce2030-4295-4d71-9d4c-5ec2eec29565 tempest-CreateVolumesFromImageTest-1065198505 None] Lock "cinder-18dbf232-1084-44c6-974a-0b5b2c3234a0-delete_volume" released by "delete_volume" :: held 2.574s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:33 devstack sudo[88613]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:33 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-74fcd639-eaa2-4bfa-a09c-08812d45bdb3 tempest-VolumesActionsTest-1196644426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0b66dc01-1c7a-427d-b771-a85154916559" returned: 0 in 0.703s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:33 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-74fcd639-eaa2-4bfa-a09c-08812d45bdb3 tempest-VolumesActionsTest-1196644426 None] <== create_volume: return (1391ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:27:33 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-74fcd639-eaa2-4bfa-a09c-08812d45bdb3 tempest-VolumesActionsTest-1196644426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.394s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:33 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-a305bc90-f7a3-407b-a628-5b4d1a0fd1c6 tempest-VolumesActionsTest-1945194074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.280s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:33 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-a305bc90-f7a3-407b-a628-5b4d1a0fd1c6 tempest-VolumesActionsTest-1945194074 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1185916719',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=672c53ca-ee2d-473f-8337-152832729e00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be9dc0daf3794a089ad1aff6cd82e870',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:33Z,use_quota=True,user_id='c3f639f013f94fea9ca5469ad886c89b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:27:33 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-a305bc90-f7a3-407b-a628-5b4d1a0fd1c6 tempest-VolumesActionsTest-1945194074 None] Creating volume 672c53ca-ee2d-473f-8337-152832729e00 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:27:33 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-a305bc90-f7a3-407b-a628-5b4d1a0fd1c6 tempest-VolumesActionsTest-1945194074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:33 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-a305bc90-f7a3-407b-a628-5b4d1a0fd1c6 tempest-VolumesActionsTest-1945194074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:33 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-a305bc90-f7a3-407b-a628-5b4d1a0fd1c6 tempest-VolumesActionsTest-1945194074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:33 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-a305bc90-f7a3-407b-a628-5b4d1a0fd1c6 tempest-VolumesActionsTest-1945194074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:33 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-a305bc90-f7a3-407b-a628-5b4d1a0fd1c6 tempest-VolumesActionsTest-1945194074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:33 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-a305bc90-f7a3-407b-a628-5b4d1a0fd1c6 tempest-VolumesActionsTest-1945194074 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:27:33 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-a305bc90-f7a3-407b-a628-5b4d1a0fd1c6 tempest-VolumesActionsTest-1945194074 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:27:33 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a305bc90-f7a3-407b-a628-5b4d1a0fd1c6 tempest-VolumesActionsTest-1945194074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-672c53ca-ee2d-473f-8337-152832729e00 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:33 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-74fcd639-eaa2-4bfa-a09c-08812d45bdb3 tempest-VolumesActionsTest-1196644426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f1615a4-0e19-456e-a2d4-63c4405ec29f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b66dc01-1c7a-427d-b771-a85154916559', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:33 devstack sudo[88626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-672c53ca-ee2d-473f-8337-152832729e00 1073741824
Feb 27 01:27:33 devstack sudo[88626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:33 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-74fcd639-eaa2-4bfa-a09c-08812d45bdb3 tempest-VolumesActionsTest-1196644426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2b12b40-623c-495b-9b82-4100fbf8c15c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:33 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-74fcd639-eaa2-4bfa-a09c-08812d45bdb3 tempest-VolumesActionsTest-1196644426 None] Volume volume-0b66dc01-1c7a-427d-b771-a85154916559 (0b66dc01-1c7a-427d-b771-a85154916559): created successfully
Feb 27 01:27:33 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-74fcd639-eaa2-4bfa-a09c-08812d45bdb3 tempest-VolumesActionsTest-1196644426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2b12b40-623c-495b-9b82-4100fbf8c15c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:33 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-74fcd639-eaa2-4bfa-a09c-08812d45bdb3 tempest-VolumesActionsTest-1196644426 None] Flow 'volume_create_manager' (1a4074cd-2eab-4cc0-b8e5-27ed9ad05036) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:33 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-74fcd639-eaa2-4bfa-a09c-08812d45bdb3 tempest-VolumesActionsTest-1196644426 None] Created volume successfully.
Feb 27 01:27:33 devstack sudo[88619]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:33 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-74fa4253-0157-40c5-9c05-ef72ae7a29d3 tempest-VolumesSnapshotTestJSON-708792780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-cdfef233-6041-4768-b97d-9b716d1bf479.74ae11bb-fe6a-48a5-aeba-dcbd7e915c64" returned: 0 in 0.699s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:33 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-74fa4253-0157-40c5-9c05-ef72ae7a29d3 tempest-VolumesSnapshotTestJSON-708792780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-cdfef233-6041-4768-b97d-9b716d1bf479.74ae11bb-fe6a-48a5-aeba-dcbd7e915c64 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:33 devstack sudo[88634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-cdfef233-6041-4768-b97d-9b716d1bf479.74ae11bb-fe6a-48a5-aeba-dcbd7e915c64
Feb 27 01:27:33 devstack sudo[88634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:33 devstack sudo[88622]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:33 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ad7120c4-0dde-4d17-abeb-ef660227632d tempest-CreateVolumesFromImageTest-1065198505 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c50fdf17-0a30-488c-a529-b5e7aff93e25" returned: 0 in 0.571s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:33 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ad7120c4-0dde-4d17-abeb-ef660227632d tempest-CreateVolumesFromImageTest-1065198505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c50fdf17-0a30-488c-a529-b5e7aff93e25 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:33 devstack sudo[88636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c50fdf17-0a30-488c-a529-b5e7aff93e25
Feb 27 01:27:33 devstack sudo[88636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:33 devstack sudo[88626]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:33 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a305bc90-f7a3-407b-a628-5b4d1a0fd1c6 tempest-VolumesActionsTest-1945194074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-672c53ca-ee2d-473f-8337-152832729e00 1073741824" returned: 0 in 0.614s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:33 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a305bc90-f7a3-407b-a628-5b4d1a0fd1c6 tempest-VolumesActionsTest-1945194074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-672c53ca-ee2d-473f-8337-152832729e00 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:33 devstack sudo[88641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-672c53ca-ee2d-473f-8337-152832729e00
Feb 27 01:27:33 devstack sudo[88641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:34 devstack sudo[88636]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:34 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ad7120c4-0dde-4d17-abeb-ef660227632d tempest-CreateVolumesFromImageTest-1065198505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c50fdf17-0a30-488c-a529-b5e7aff93e25" returned: 0 in 0.634s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:34 devstack sudo[88634]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:34 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-74fa4253-0157-40c5-9c05-ef72ae7a29d3 tempest-VolumesSnapshotTestJSON-708792780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-cdfef233-6041-4768-b97d-9b716d1bf479.74ae11bb-fe6a-48a5-aeba-dcbd7e915c64" returned: 0 in 0.713s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:34 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-ad7120c4-0dde-4d17-abeb-ef660227632d tempest-CreateVolumesFromImageTest-1065198505 None] Lock "cinder-quobyte-c50fdf17-0a30-488c-a529-b5e7aff93e25" released by "delete_volume" :: held 1.247s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:34 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-74fa4253-0157-40c5-9c05-ef72ae7a29d3 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "cinder-quobyte-74ae11bb-fe6a-48a5-aeba-dcbd7e915c64" released by "_delete_snapshot" :: held 3.256s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:34 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-74fa4253-0157-40c5-9c05-ef72ae7a29d3 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "cinder-quobyte-cdfef233-6041-4768-b97d-9b716d1bf479" released by "delete_snapshot" :: held 3.296s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:34 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-ad7120c4-0dde-4d17-abeb-ef660227632d tempest-CreateVolumesFromImageTest-1065198505 None] Created reservations ['21da27be-5c5a-4599-9aec-e855055dac99', 'be549089-21b5-4e01-8b51-649770f129fe', 'c2cf815b-e102-4d3a-a0da-4fa69a3dcbc8', 'b706674c-e9d9-4d56-9c99-3d96bba68e76'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:27:34 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-74fa4253-0157-40c5-9c05-ef72ae7a29d3 tempest-VolumesSnapshotTestJSON-708792780 None] Created reservations ['795a22e5-153c-4a52-9253-b8274dce565c', '6f3a4941-fc1d-4db9-818b-c38dc2f4c7be', 'ac7a619f-bf40-45a4-a21d-86d6b3e4bdad', '3ab37154-d5a6-4fdc-9691-7ac456cf94eb'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:27:34 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-ad7120c4-0dde-4d17-abeb-ef660227632d tempest-CreateVolumesFromImageTest-1065198505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:34 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-ad7120c4-0dde-4d17-abeb-ef660227632d tempest-CreateVolumesFromImageTest-1065198505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:34 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-ad7120c4-0dde-4d17-abeb-ef660227632d tempest-CreateVolumesFromImageTest-1065198505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:34 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-ad7120c4-0dde-4d17-abeb-ef660227632d tempest-CreateVolumesFromImageTest-1065198505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:34 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-ad7120c4-0dde-4d17-abeb-ef660227632d tempest-CreateVolumesFromImageTest-1065198505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:34 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ad7120c4-0dde-4d17-abeb-ef660227632d tempest-CreateVolumesFromImageTest-1065198505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:34 devstack sudo[88641]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:34 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a305bc90-f7a3-407b-a628-5b4d1a0fd1c6 tempest-VolumesActionsTest-1945194074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-672c53ca-ee2d-473f-8337-152832729e00" returned: 0 in 0.641s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:34 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-a305bc90-f7a3-407b-a628-5b4d1a0fd1c6 tempest-VolumesActionsTest-1945194074 None] <== create_volume: return (1301ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:27:34 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-a305bc90-f7a3-407b-a628-5b4d1a0fd1c6 tempest-VolumesActionsTest-1945194074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.305s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:34 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-74fa4253-0157-40c5-9c05-ef72ae7a29d3 tempest-VolumesSnapshotTestJSON-708792780 None] Delete snapshot completed successfully.
Feb 27 01:27:34 devstack sudo[88646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:27:34 devstack sudo[88646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:34 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a305bc90-f7a3-407b-a628-5b4d1a0fd1c6 tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50907932-1b7f-4b75-b72f-adf99bdc748b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-672c53ca-ee2d-473f-8337-152832729e00', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:34 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a305bc90-f7a3-407b-a628-5b4d1a0fd1c6 tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48beee5f-3578-41b0-a3ae-07f72d713a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:34 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-74fa4253-0157-40c5-9c05-ef72ae7a29d3 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "cinder-74ae11bb-fe6a-48a5-aeba-dcbd7e915c64-delete_snapshot" released by "delete_snapshot" :: held 3.543s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:34 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-a305bc90-f7a3-407b-a628-5b4d1a0fd1c6 tempest-VolumesActionsTest-1945194074 None] Volume volume-672c53ca-ee2d-473f-8337-152832729e00 (672c53ca-ee2d-473f-8337-152832729e00): created successfully
Feb 27 01:27:34 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a305bc90-f7a3-407b-a628-5b4d1a0fd1c6 tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48beee5f-3578-41b0-a3ae-07f72d713a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:34 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a305bc90-f7a3-407b-a628-5b4d1a0fd1c6 tempest-VolumesActionsTest-1945194074 None] Flow 'volume_create_manager' (cedb2cc6-f22a-4065-977a-eaf5c3802d73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:34 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-a305bc90-f7a3-407b-a628-5b4d1a0fd1c6 tempest-VolumesActionsTest-1945194074 None] Created volume successfully.
Feb 27 01:27:34 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-9dbfcd7c-7685-4096-b195-958665b033fb tempest-VolumesActionsTest-1938141483 None] Acquiring lock "cinder-672c53ca-ee2d-473f-8337-152832729e00-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:34 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-9dbfcd7c-7685-4096-b195-958665b033fb tempest-VolumesActionsTest-1938141483 None] Lock "cinder-672c53ca-ee2d-473f-8337-152832729e00-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:34 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-9dbfcd7c-7685-4096-b195-958665b033fb tempest-VolumesActionsTest-1938141483 None] Acquiring lock "cinder-quobyte-672c53ca-ee2d-473f-8337-152832729e00" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:34 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-9dbfcd7c-7685-4096-b195-958665b033fb tempest-VolumesActionsTest-1938141483 None] Lock "cinder-quobyte-672c53ca-ee2d-473f-8337-152832729e00" acquired by "delete_volume" :: waited 0.008s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:34 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[511025f9-28bf-4909-aec9-f9c2873c149f]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:34 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9dbfcd7c-7685-4096-b195-958665b033fb tempest-VolumesActionsTest-1938141483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-672c53ca-ee2d-473f-8337-152832729e00 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:35 devstack sudo[88646]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:35 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ad7120c4-0dde-4d17-abeb-ef660227632d tempest-CreateVolumesFromImageTest-1065198505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.647s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:35 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-ad7120c4-0dde-4d17-abeb-ef660227632d tempest-CreateVolumesFromImageTest-1065198505 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:27:35 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-ad7120c4-0dde-4d17-abeb-ef660227632d tempest-CreateVolumesFromImageTest-1065198505 None] Deleted volume successfully.
Feb 27 01:27:35 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-ad7120c4-0dde-4d17-abeb-ef660227632d tempest-CreateVolumesFromImageTest-1065198505 None] Lock "cinder-c50fdf17-0a30-488c-a529-b5e7aff93e25-delete_volume" released by "delete_volume" :: held 2.239s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:35 devstack sudo[88651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-672c53ca-ee2d-473f-8337-152832729e00
Feb 27 01:27:35 devstack sudo[88651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:35 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5d1288ec-7444-49f9-9ad9-d0ec546777a7 tempest-VolumesSnapshotTestJSON-708792780 None] Acquiring lock "cinder-cdfef233-6041-4768-b97d-9b716d1bf479-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:35 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5d1288ec-7444-49f9-9ad9-d0ec546777a7 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "cinder-cdfef233-6041-4768-b97d-9b716d1bf479-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:35 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5d1288ec-7444-49f9-9ad9-d0ec546777a7 tempest-VolumesSnapshotTestJSON-708792780 None] Acquiring lock "cinder-quobyte-cdfef233-6041-4768-b97d-9b716d1bf479" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:35 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5d1288ec-7444-49f9-9ad9-d0ec546777a7 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "cinder-quobyte-cdfef233-6041-4768-b97d-9b716d1bf479" acquired by "delete_volume" :: waited 0.014s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:35 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6fd239d-ba53-4b19-b045-001727da07bb]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:35 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5d1288ec-7444-49f9-9ad9-d0ec546777a7 tempest-VolumesSnapshotTestJSON-708792780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-cdfef233-6041-4768-b97d-9b716d1bf479 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:35 devstack sudo[88653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-cdfef233-6041-4768-b97d-9b716d1bf479
Feb 27 01:27:35 devstack sudo[88653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:35 devstack sudo[88651]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:35 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9dbfcd7c-7685-4096-b195-958665b033fb tempest-VolumesActionsTest-1938141483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-672c53ca-ee2d-473f-8337-152832729e00" returned: 0 in 0.661s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:35 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9dbfcd7c-7685-4096-b195-958665b033fb tempest-VolumesActionsTest-1938141483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-672c53ca-ee2d-473f-8337-152832729e00 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:35 devstack sudo[88658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-672c53ca-ee2d-473f-8337-152832729e00
Feb 27 01:27:35 devstack sudo[88658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:36 devstack sudo[88653]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:36 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5d1288ec-7444-49f9-9ad9-d0ec546777a7 tempest-VolumesSnapshotTestJSON-708792780 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-cdfef233-6041-4768-b97d-9b716d1bf479" returned: 0 in 0.744s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:36 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5d1288ec-7444-49f9-9ad9-d0ec546777a7 tempest-VolumesSnapshotTestJSON-708792780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-cdfef233-6041-4768-b97d-9b716d1bf479 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:36 devstack sudo[88664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-cdfef233-6041-4768-b97d-9b716d1bf479
Feb 27 01:27:36 devstack sudo[88664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:36 devstack sudo[88658]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:36 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9dbfcd7c-7685-4096-b195-958665b033fb tempest-VolumesActionsTest-1938141483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-672c53ca-ee2d-473f-8337-152832729e00" returned: 0 in 0.529s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:36 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-9dbfcd7c-7685-4096-b195-958665b033fb tempest-VolumesActionsTest-1938141483 None] Lock "cinder-quobyte-672c53ca-ee2d-473f-8337-152832729e00" released by "delete_volume" :: held 1.230s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:36 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-9dbfcd7c-7685-4096-b195-958665b033fb tempest-VolumesActionsTest-1938141483 None] Created reservations ['a401b8c5-183a-4b97-aee4-c2a78189856d', 'c0d928b8-a867-4728-825a-339f85c53999', 'b65fd138-25c3-4fbb-be0e-bb518770cad2', 'b5f08be2-5f71-4d11-9f3d-17d9f94e0521'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:27:36 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-9dbfcd7c-7685-4096-b195-958665b033fb tempest-VolumesActionsTest-1938141483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:36 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-9dbfcd7c-7685-4096-b195-958665b033fb tempest-VolumesActionsTest-1938141483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:36 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-9dbfcd7c-7685-4096-b195-958665b033fb tempest-VolumesActionsTest-1938141483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:36 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-9dbfcd7c-7685-4096-b195-958665b033fb tempest-VolumesActionsTest-1938141483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:36 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-9dbfcd7c-7685-4096-b195-958665b033fb tempest-VolumesActionsTest-1938141483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:36 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9dbfcd7c-7685-4096-b195-958665b033fb tempest-VolumesActionsTest-1938141483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:36 devstack sudo[88666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:27:36 devstack sudo[88666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:36 devstack sudo[88664]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:36 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5d1288ec-7444-49f9-9ad9-d0ec546777a7 tempest-VolumesSnapshotTestJSON-708792780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-cdfef233-6041-4768-b97d-9b716d1bf479" returned: 0 in 0.531s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:36 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5d1288ec-7444-49f9-9ad9-d0ec546777a7 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "cinder-quobyte-cdfef233-6041-4768-b97d-9b716d1bf479" released by "delete_volume" :: held 1.321s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:36 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-5d1288ec-7444-49f9-9ad9-d0ec546777a7 tempest-VolumesSnapshotTestJSON-708792780 None] Created reservations ['ae20548d-31ff-4148-aaed-768b7f9f2b9d', '9eed7864-6405-4efd-bae5-cb6f0a323055', '60a710f6-9061-4640-b953-0f1a77d64203', '4fa96cd1-f937-40a8-9509-98bd8cf3f1af'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:27:36 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-5d1288ec-7444-49f9-9ad9-d0ec546777a7 tempest-VolumesSnapshotTestJSON-708792780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:36 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-5d1288ec-7444-49f9-9ad9-d0ec546777a7 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:36 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-5d1288ec-7444-49f9-9ad9-d0ec546777a7 tempest-VolumesSnapshotTestJSON-708792780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:36 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-5d1288ec-7444-49f9-9ad9-d0ec546777a7 tempest-VolumesSnapshotTestJSON-708792780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:36 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-5d1288ec-7444-49f9-9ad9-d0ec546777a7 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:36 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5d1288ec-7444-49f9-9ad9-d0ec546777a7 tempest-VolumesSnapshotTestJSON-708792780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:36 devstack sudo[88669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:27:36 devstack sudo[88669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:36 devstack sudo[88666]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:36 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9dbfcd7c-7685-4096-b195-958665b033fb tempest-VolumesActionsTest-1938141483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.587s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:36 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-9dbfcd7c-7685-4096-b195-958665b033fb tempest-VolumesActionsTest-1938141483 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:27:36 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-9dbfcd7c-7685-4096-b195-958665b033fb tempest-VolumesActionsTest-1938141483 None] Deleted volume successfully.
Feb 27 01:27:36 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-9dbfcd7c-7685-4096-b195-958665b033fb tempest-VolumesActionsTest-1938141483 None] Lock "cinder-672c53ca-ee2d-473f-8337-152832729e00-delete_volume" released by "delete_volume" :: held 2.039s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:37 devstack sudo[88669]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5d1288ec-7444-49f9-9ad9-d0ec546777a7 tempest-VolumesSnapshotTestJSON-708792780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.558s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:37 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-5d1288ec-7444-49f9-9ad9-d0ec546777a7 tempest-VolumesSnapshotTestJSON-708792780 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:27:37 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-5d1288ec-7444-49f9-9ad9-d0ec546777a7 tempest-VolumesSnapshotTestJSON-708792780 None] Deleted volume successfully.
Feb 27 01:27:37 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5d1288ec-7444-49f9-9ad9-d0ec546777a7 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "cinder-cdfef233-6041-4768-b97d-9b716d1bf479-delete_volume" released by "delete_volume" :: held 2.037s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:37 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-c601c902-d349-4766-bfbe-5a3945717a76 tempest-VolumesActionsTest-1945194074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:27:37 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c601c902-d349-4766-bfbe-5a3945717a76 tempest-VolumesActionsTest-1945194074 None] Flow 'volume_create_manager' (209423c1-0221-49d3-9e2f-ba6bd1405f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:37 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c601c902-d349-4766-bfbe-5a3945717a76 tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bc8de98-46ad-48d1-8537-9d1ddf3784d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:37 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c601c902-d349-4766-bfbe-5a3945717a76 tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bc8de98-46ad-48d1-8537-9d1ddf3784d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1505869421',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=011412d3-a1e7-4791-9d7d-d6d534546796,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be9dc0daf3794a089ad1aff6cd82e870',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:38Z,use_quota=True,user_id='c3f639f013f94fea9ca5469ad886c89b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:37 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c601c902-d349-4766-bfbe-5a3945717a76 tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (366ed71f-045c-4083-83c9-05cb17879e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:37 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c601c902-d349-4766-bfbe-5a3945717a76 tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (366ed71f-045c-4083-83c9-05cb17879e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:37 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c601c902-d349-4766-bfbe-5a3945717a76 tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (facf9f8c-65d6-4a5a-850f-9499526f9677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:37 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c601c902-d349-4766-bfbe-5a3945717a76 tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (facf9f8c-65d6-4a5a-850f-9499526f9677) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '011412d3-a1e7-4791-9d7d-d6d534546796', 'volume_name': 'volume-011412d3-a1e7-4791-9d7d-d6d534546796', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:37 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c601c902-d349-4766-bfbe-5a3945717a76 tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d78d697-11f9-4b14-8a3d-b0e8b07b3dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:37 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c601c902-d349-4766-bfbe-5a3945717a76 tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d78d697-11f9-4b14-8a3d-b0e8b07b3dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:37 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c601c902-d349-4766-bfbe-5a3945717a76 tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d13e9a9e-7af7-444e-84e1-5743133c827b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:37 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-c601c902-d349-4766-bfbe-5a3945717a76 tempest-VolumesActionsTest-1945194074 None] Volume 011412d3-a1e7-4791-9d7d-d6d534546796: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-011412d3-a1e7-4791-9d7d-d6d534546796', 'volume_size': 1}
Feb 27 01:27:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-c601c902-d349-4766-bfbe-5a3945717a76 tempest-VolumesActionsTest-1945194074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-c601c902-d349-4766-bfbe-5a3945717a76 tempest-VolumesActionsTest-1945194074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:37 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-c601c902-d349-4766-bfbe-5a3945717a76 tempest-VolumesActionsTest-1945194074 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1505869421',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=011412d3-a1e7-4791-9d7d-d6d534546796,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be9dc0daf3794a089ad1aff6cd82e870',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:38Z,use_quota=True,user_id='c3f639f013f94fea9ca5469ad886c89b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:27:37 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-c601c902-d349-4766-bfbe-5a3945717a76 tempest-VolumesActionsTest-1945194074 None] Creating volume 011412d3-a1e7-4791-9d7d-d6d534546796 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:27:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-c601c902-d349-4766-bfbe-5a3945717a76 tempest-VolumesActionsTest-1945194074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-c601c902-d349-4766-bfbe-5a3945717a76 tempest-VolumesActionsTest-1945194074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:37 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-c601c902-d349-4766-bfbe-5a3945717a76 tempest-VolumesActionsTest-1945194074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:37 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-c601c902-d349-4766-bfbe-5a3945717a76 tempest-VolumesActionsTest-1945194074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-c601c902-d349-4766-bfbe-5a3945717a76 tempest-VolumesActionsTest-1945194074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.071s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:37 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-c601c902-d349-4766-bfbe-5a3945717a76 tempest-VolumesActionsTest-1945194074 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:27:37 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-c601c902-d349-4766-bfbe-5a3945717a76 tempest-VolumesActionsTest-1945194074 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:27:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c601c902-d349-4766-bfbe-5a3945717a76 tempest-VolumesActionsTest-1945194074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-011412d3-a1e7-4791-9d7d-d6d534546796 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:37 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6cba75d-22a4-42bc-9414-a19a4b913ff3 tempest-CinderUnicodeTest-34250104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:27:37 devstack sudo[88673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-011412d3-a1e7-4791-9d7d-d6d534546796 1073741824
Feb 27 01:27:37 devstack sudo[88673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:37 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c6cba75d-22a4-42bc-9414-a19a4b913ff3 tempest-CinderUnicodeTest-34250104 None] Flow 'volume_create_manager' (52873acb-293d-402b-ad2b-9985a4c6f8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:37 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c6cba75d-22a4-42bc-9414-a19a4b913ff3 tempest-CinderUnicodeTest-34250104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9b2b676-d5c7-4459-a575-59bb2821b6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:37 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c6cba75d-22a4-42bc-9414-a19a4b913ff3 tempest-CinderUnicodeTest-34250104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9b2b676-d5c7-4459-a575-59bb2821b6c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:37Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=950ebe74-d2b9-4046-9d64-5eb7f9c8ef19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e2578f0100a4164a7fe966cbce5d53a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:38Z,use_quota=True,user_id='44ecdbfdc96741fcae0d64c4c6884fed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:37 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c6cba75d-22a4-42bc-9414-a19a4b913ff3 tempest-CinderUnicodeTest-34250104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d9524b7-6957-4dfd-90ea-b24acaadf004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:37 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c6cba75d-22a4-42bc-9414-a19a4b913ff3 tempest-CinderUnicodeTest-34250104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d9524b7-6957-4dfd-90ea-b24acaadf004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:37 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c6cba75d-22a4-42bc-9414-a19a4b913ff3 tempest-CinderUnicodeTest-34250104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ba0b755-81ca-4ed1-923f-12b37d708cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:37 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c6cba75d-22a4-42bc-9414-a19a4b913ff3 tempest-CinderUnicodeTest-34250104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ba0b755-81ca-4ed1-923f-12b37d708cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '950ebe74-d2b9-4046-9d64-5eb7f9c8ef19', 'volume_name': 'volume-950ebe74-d2b9-4046-9d64-5eb7f9c8ef19', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:37 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c6cba75d-22a4-42bc-9414-a19a4b913ff3 tempest-CinderUnicodeTest-34250104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79c4a190-87de-4bf7-a448-a9919f6e14ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:37 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c6cba75d-22a4-42bc-9414-a19a4b913ff3 tempest-CinderUnicodeTest-34250104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79c4a190-87de-4bf7-a448-a9919f6e14ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:37 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c6cba75d-22a4-42bc-9414-a19a4b913ff3 tempest-CinderUnicodeTest-34250104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ccbcd67-2b0b-41e9-8900-f9743cbb7ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:37 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-c6cba75d-22a4-42bc-9414-a19a4b913ff3 tempest-CinderUnicodeTest-34250104 None] Volume 950ebe74-d2b9-4046-9d64-5eb7f9c8ef19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-950ebe74-d2b9-4046-9d64-5eb7f9c8ef19', 'volume_size': 1}
Feb 27 01:27:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-c6cba75d-22a4-42bc-9414-a19a4b913ff3 tempest-CinderUnicodeTest-34250104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:37 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfeac573-a5d8-4b8d-9041-af9b49407154 tempest-VolumesSnapshotTestJSON-708792780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:27:37 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-cfeac573-a5d8-4b8d-9041-af9b49407154 tempest-VolumesSnapshotTestJSON-708792780 None] Flow 'volume_create_manager' (16da9129-0e38-473b-8e2e-e0ba96520e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:37 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-cfeac573-a5d8-4b8d-9041-af9b49407154 tempest-VolumesSnapshotTestJSON-708792780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c0c0ee3-11a2-4567-b967-c0c2af3e8084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:37 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-cfeac573-a5d8-4b8d-9041-af9b49407154 tempest-VolumesSnapshotTestJSON-708792780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c0c0ee3-11a2-4567-b967-c0c2af3e8084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-847161792',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a3ca527-905e-4193-9b56-3fff1c0a77c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fba5f3accb0d428597d9c1a212708a1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:38Z,use_quota=True,user_id='4b8cb8c9a1344b09921d38d6e27d2878',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:37 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-cfeac573-a5d8-4b8d-9041-af9b49407154 tempest-VolumesSnapshotTestJSON-708792780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7ca0f40-dc37-4f71-bb2c-e2719ba14b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:37 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-cfeac573-a5d8-4b8d-9041-af9b49407154 tempest-VolumesSnapshotTestJSON-708792780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7ca0f40-dc37-4f71-bb2c-e2719ba14b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:37 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-cfeac573-a5d8-4b8d-9041-af9b49407154 tempest-VolumesSnapshotTestJSON-708792780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (719dae1b-abbf-4ddf-afe1-7c03f78999d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:37 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-cfeac573-a5d8-4b8d-9041-af9b49407154 tempest-VolumesSnapshotTestJSON-708792780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (719dae1b-abbf-4ddf-afe1-7c03f78999d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a3ca527-905e-4193-9b56-3fff1c0a77c3', 'volume_name': 'volume-8a3ca527-905e-4193-9b56-3fff1c0a77c3', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:37 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-cfeac573-a5d8-4b8d-9041-af9b49407154 tempest-VolumesSnapshotTestJSON-708792780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e5afa98-8c62-409d-9b8c-b56fd9034ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:37 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-cfeac573-a5d8-4b8d-9041-af9b49407154 tempest-VolumesSnapshotTestJSON-708792780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e5afa98-8c62-409d-9b8c-b56fd9034ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:37 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-cfeac573-a5d8-4b8d-9041-af9b49407154 tempest-VolumesSnapshotTestJSON-708792780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10fec569-6a57-4a60-ac9b-321444c0c495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:37 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-cfeac573-a5d8-4b8d-9041-af9b49407154 tempest-VolumesSnapshotTestJSON-708792780 None] Volume 8a3ca527-905e-4193-9b56-3fff1c0a77c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a3ca527-905e-4193-9b56-3fff1c0a77c3', 'volume_size': 1}
Feb 27 01:27:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-cfeac573-a5d8-4b8d-9041-af9b49407154 tempest-VolumesSnapshotTestJSON-708792780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:38 devstack sudo[88673]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:38 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c601c902-d349-4766-bfbe-5a3945717a76 tempest-VolumesActionsTest-1945194074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-011412d3-a1e7-4791-9d7d-d6d534546796 1073741824" returned: 0 in 0.543s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:38 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c601c902-d349-4766-bfbe-5a3945717a76 tempest-VolumesActionsTest-1945194074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-011412d3-a1e7-4791-9d7d-d6d534546796 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:38 devstack sudo[88678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-011412d3-a1e7-4791-9d7d-d6d534546796
Feb 27 01:27:38 devstack sudo[88678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:38 devstack sudo[88678]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:38 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c601c902-d349-4766-bfbe-5a3945717a76 tempest-VolumesActionsTest-1945194074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-011412d3-a1e7-4791-9d7d-d6d534546796" returned: 0 in 0.416s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:38 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-c601c902-d349-4766-bfbe-5a3945717a76 tempest-VolumesActionsTest-1945194074 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:27:38 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-c601c902-d349-4766-bfbe-5a3945717a76 tempest-VolumesActionsTest-1945194074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:38 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-c6cba75d-22a4-42bc-9414-a19a4b913ff3 tempest-CinderUnicodeTest-34250104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.882s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:38 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-c6cba75d-22a4-42bc-9414-a19a4b913ff3 tempest-CinderUnicodeTest-34250104 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:37Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=950ebe74-d2b9-4046-9d64-5eb7f9c8ef19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e2578f0100a4164a7fe966cbce5d53a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:38Z,use_quota=True,user_id='44ecdbfdc96741fcae0d64c4c6884fed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:27:38 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-c6cba75d-22a4-42bc-9414-a19a4b913ff3 tempest-CinderUnicodeTest-34250104 None] Creating volume 950ebe74-d2b9-4046-9d64-5eb7f9c8ef19 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:27:38 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-c6cba75d-22a4-42bc-9414-a19a4b913ff3 tempest-CinderUnicodeTest-34250104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:38 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-c6cba75d-22a4-42bc-9414-a19a4b913ff3 tempest-CinderUnicodeTest-34250104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:38 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-c6cba75d-22a4-42bc-9414-a19a4b913ff3 tempest-CinderUnicodeTest-34250104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:38 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-c6cba75d-22a4-42bc-9414-a19a4b913ff3 tempest-CinderUnicodeTest-34250104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:38 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-c6cba75d-22a4-42bc-9414-a19a4b913ff3 tempest-CinderUnicodeTest-34250104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:38 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-c6cba75d-22a4-42bc-9414-a19a4b913ff3 tempest-CinderUnicodeTest-34250104 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:27:38 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-c6cba75d-22a4-42bc-9414-a19a4b913ff3 tempest-CinderUnicodeTest-34250104 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:27:38 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c6cba75d-22a4-42bc-9414-a19a4b913ff3 tempest-CinderUnicodeTest-34250104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-950ebe74-d2b9-4046-9d64-5eb7f9c8ef19 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:38 devstack sudo[88681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-950ebe74-d2b9-4046-9d64-5eb7f9c8ef19 1073741824
Feb 27 01:27:38 devstack sudo[88681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:38 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c601c902-d349-4766-bfbe-5a3945717a76 tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d13e9a9e-7af7-444e-84e1-5743133c827b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-011412d3-a1e7-4791-9d7d-d6d534546796', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:38 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c601c902-d349-4766-bfbe-5a3945717a76 tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a25abc6-e76f-4b3e-8730-273cc6f1f02d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:38 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-c601c902-d349-4766-bfbe-5a3945717a76 tempest-VolumesActionsTest-1945194074 None] Volume volume-011412d3-a1e7-4791-9d7d-d6d534546796 (011412d3-a1e7-4791-9d7d-d6d534546796): created successfully
Feb 27 01:27:38 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c601c902-d349-4766-bfbe-5a3945717a76 tempest-VolumesActionsTest-1945194074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a25abc6-e76f-4b3e-8730-273cc6f1f02d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:38 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c601c902-d349-4766-bfbe-5a3945717a76 tempest-VolumesActionsTest-1945194074 None] Flow 'volume_create_manager' (209423c1-0221-49d3-9e2f-ba6bd1405f04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:38 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-c601c902-d349-4766-bfbe-5a3945717a76 tempest-VolumesActionsTest-1945194074 None] Created volume successfully.
Feb 27 01:27:39 devstack sudo[88681]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c6cba75d-22a4-42bc-9414-a19a4b913ff3 tempest-CinderUnicodeTest-34250104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-950ebe74-d2b9-4046-9d64-5eb7f9c8ef19 1073741824" returned: 0 in 0.537s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c6cba75d-22a4-42bc-9414-a19a4b913ff3 tempest-CinderUnicodeTest-34250104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-950ebe74-d2b9-4046-9d64-5eb7f9c8ef19 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:39 devstack sudo[88686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-950ebe74-d2b9-4046-9d64-5eb7f9c8ef19
Feb 27 01:27:39 devstack sudo[88686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:39 devstack sudo[88686]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c6cba75d-22a4-42bc-9414-a19a4b913ff3 tempest-CinderUnicodeTest-34250104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-950ebe74-d2b9-4046-9d64-5eb7f9c8ef19" returned: 0 in 0.475s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:39 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-c6cba75d-22a4-42bc-9414-a19a4b913ff3 tempest-CinderUnicodeTest-34250104 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:27:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-c6cba75d-22a4-42bc-9414-a19a4b913ff3 tempest-CinderUnicodeTest-34250104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-cfeac573-a5d8-4b8d-9041-af9b49407154 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.859s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:39 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-cfeac573-a5d8-4b8d-9041-af9b49407154 tempest-VolumesSnapshotTestJSON-708792780 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-847161792',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a3ca527-905e-4193-9b56-3fff1c0a77c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fba5f3accb0d428597d9c1a212708a1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:38Z,use_quota=True,user_id='4b8cb8c9a1344b09921d38d6e27d2878',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:27:39 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-cfeac573-a5d8-4b8d-9041-af9b49407154 tempest-VolumesSnapshotTestJSON-708792780 None] Creating volume 8a3ca527-905e-4193-9b56-3fff1c0a77c3 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:27:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-cfeac573-a5d8-4b8d-9041-af9b49407154 tempest-VolumesSnapshotTestJSON-708792780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-cfeac573-a5d8-4b8d-9041-af9b49407154 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:39 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-cfeac573-a5d8-4b8d-9041-af9b49407154 tempest-VolumesSnapshotTestJSON-708792780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:39 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-cfeac573-a5d8-4b8d-9041-af9b49407154 tempest-VolumesSnapshotTestJSON-708792780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-cfeac573-a5d8-4b8d-9041-af9b49407154 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:39 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-cfeac573-a5d8-4b8d-9041-af9b49407154 tempest-VolumesSnapshotTestJSON-708792780 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:27:39 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-cfeac573-a5d8-4b8d-9041-af9b49407154 tempest-VolumesSnapshotTestJSON-708792780 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:27:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-cfeac573-a5d8-4b8d-9041-af9b49407154 tempest-VolumesSnapshotTestJSON-708792780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8a3ca527-905e-4193-9b56-3fff1c0a77c3 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:39 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c6cba75d-22a4-42bc-9414-a19a4b913ff3 tempest-CinderUnicodeTest-34250104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ccbcd67-2b0b-41e9-8900-f9743cbb7ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-950ebe74-d2b9-4046-9d64-5eb7f9c8ef19', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:39 devstack sudo[88689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8a3ca527-905e-4193-9b56-3fff1c0a77c3 1073741824
Feb 27 01:27:39 devstack sudo[88689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:39 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c6cba75d-22a4-42bc-9414-a19a4b913ff3 tempest-CinderUnicodeTest-34250104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3133a48-6818-4dbc-8539-b29352bff953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:39 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-c6cba75d-22a4-42bc-9414-a19a4b913ff3 tempest-CinderUnicodeTest-34250104 None] Volume volume-950ebe74-d2b9-4046-9d64-5eb7f9c8ef19 (950ebe74-d2b9-4046-9d64-5eb7f9c8ef19): created successfully
Feb 27 01:27:39 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c6cba75d-22a4-42bc-9414-a19a4b913ff3 tempest-CinderUnicodeTest-34250104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3133a48-6818-4dbc-8539-b29352bff953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:39 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c6cba75d-22a4-42bc-9414-a19a4b913ff3 tempest-CinderUnicodeTest-34250104 None] Flow 'volume_create_manager' (52873acb-293d-402b-ad2b-9985a4c6f8db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:39 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-c6cba75d-22a4-42bc-9414-a19a4b913ff3 tempest-CinderUnicodeTest-34250104 None] Created volume successfully.
Feb 27 01:27:40 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-b52d6e59-a107-4cc8-8500-10d96a33e6b9 tempest-VolumesActionsTest-1945194074 None] Acquiring lock "cinder-011412d3-a1e7-4791-9d7d-d6d534546796-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:40 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-b52d6e59-a107-4cc8-8500-10d96a33e6b9 tempest-VolumesActionsTest-1945194074 None] Lock "cinder-011412d3-a1e7-4791-9d7d-d6d534546796-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:40 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-b52d6e59-a107-4cc8-8500-10d96a33e6b9 tempest-VolumesActionsTest-1945194074 None] Acquiring lock "cinder-quobyte-011412d3-a1e7-4791-9d7d-d6d534546796" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:40 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-b52d6e59-a107-4cc8-8500-10d96a33e6b9 tempest-VolumesActionsTest-1945194074 None] Lock "cinder-quobyte-011412d3-a1e7-4791-9d7d-d6d534546796" acquired by "delete_volume" :: waited 0.018s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:40 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f53a09-067c-4636-be30-ed47912e7f1e]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:40 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b52d6e59-a107-4cc8-8500-10d96a33e6b9 tempest-VolumesActionsTest-1945194074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-011412d3-a1e7-4791-9d7d-d6d534546796 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:40 devstack sudo[88694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-011412d3-a1e7-4791-9d7d-d6d534546796
Feb 27 01:27:40 devstack sudo[88694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:40 devstack sudo[88689]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:40 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-cfeac573-a5d8-4b8d-9041-af9b49407154 tempest-VolumesSnapshotTestJSON-708792780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8a3ca527-905e-4193-9b56-3fff1c0a77c3 1073741824" returned: 0 in 0.706s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:40 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-cfeac573-a5d8-4b8d-9041-af9b49407154 tempest-VolumesSnapshotTestJSON-708792780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8a3ca527-905e-4193-9b56-3fff1c0a77c3 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:40 devstack sudo[88696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8a3ca527-905e-4193-9b56-3fff1c0a77c3
Feb 27 01:27:40 devstack sudo[88696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:40 devstack sudo[88694]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:40 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b52d6e59-a107-4cc8-8500-10d96a33e6b9 tempest-VolumesActionsTest-1945194074 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-011412d3-a1e7-4791-9d7d-d6d534546796" returned: 0 in 0.592s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:40 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b52d6e59-a107-4cc8-8500-10d96a33e6b9 tempest-VolumesActionsTest-1945194074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-011412d3-a1e7-4791-9d7d-d6d534546796 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:40 devstack sudo[88703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-011412d3-a1e7-4791-9d7d-d6d534546796
Feb 27 01:27:40 devstack sudo[88703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:40 devstack sudo[88696]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:40 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-cfeac573-a5d8-4b8d-9041-af9b49407154 tempest-VolumesSnapshotTestJSON-708792780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8a3ca527-905e-4193-9b56-3fff1c0a77c3" returned: 0 in 0.459s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:40 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-cfeac573-a5d8-4b8d-9041-af9b49407154 tempest-VolumesSnapshotTestJSON-708792780 None] <== create_volume: return (1203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:27:40 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-cfeac573-a5d8-4b8d-9041-af9b49407154 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.205s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:40 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-cfeac573-a5d8-4b8d-9041-af9b49407154 tempest-VolumesSnapshotTestJSON-708792780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10fec569-6a57-4a60-ac9b-321444c0c495) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a3ca527-905e-4193-9b56-3fff1c0a77c3', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:41 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-cfeac573-a5d8-4b8d-9041-af9b49407154 tempest-VolumesSnapshotTestJSON-708792780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (568ce789-aea1-459e-9c2e-a1286a57c563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:41 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-cfeac573-a5d8-4b8d-9041-af9b49407154 tempest-VolumesSnapshotTestJSON-708792780 None] Volume volume-8a3ca527-905e-4193-9b56-3fff1c0a77c3 (8a3ca527-905e-4193-9b56-3fff1c0a77c3): created successfully
Feb 27 01:27:41 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-cfeac573-a5d8-4b8d-9041-af9b49407154 tempest-VolumesSnapshotTestJSON-708792780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (568ce789-aea1-459e-9c2e-a1286a57c563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:41 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-cfeac573-a5d8-4b8d-9041-af9b49407154 tempest-VolumesSnapshotTestJSON-708792780 None] Flow 'volume_create_manager' (16da9129-0e38-473b-8e2e-e0ba96520e0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:41 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-cfeac573-a5d8-4b8d-9041-af9b49407154 tempest-VolumesSnapshotTestJSON-708792780 None] Created volume successfully.
Feb 27 01:27:41 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-5700cde3-33b2-4847-bb99-de067ab9df2e tempest-CinderUnicodeTest-34250104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:27:41 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-5700cde3-33b2-4847-bb99-de067ab9df2e tempest-CinderUnicodeTest-34250104 None] Flow 'volume_create_manager' (fc4b57d9-adec-4b07-bca4-de5171b4a963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:41 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-5700cde3-33b2-4847-bb99-de067ab9df2e tempest-CinderUnicodeTest-34250104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3047595e-7c0d-40df-b900-42c24ddaabd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:41 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-5700cde3-33b2-4847-bb99-de067ab9df2e tempest-CinderUnicodeTest-34250104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3047595e-7c0d-40df-b900-42c24ddaabd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:41Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-700121559',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f023cbfe-5379-4436-b30f-ff43f21ffc99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e2578f0100a4164a7fe966cbce5d53a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:41Z,use_quota=True,user_id='44ecdbfdc96741fcae0d64c4c6884fed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:41 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-5700cde3-33b2-4847-bb99-de067ab9df2e tempest-CinderUnicodeTest-34250104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69e807f3-b29e-42be-ae7d-da335b39b62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:41 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-5700cde3-33b2-4847-bb99-de067ab9df2e tempest-CinderUnicodeTest-34250104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69e807f3-b29e-42be-ae7d-da335b39b62c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:41 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-5700cde3-33b2-4847-bb99-de067ab9df2e tempest-CinderUnicodeTest-34250104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (704ccec9-f1bd-4fb1-a2c0-393dd42e0634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:41 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-5700cde3-33b2-4847-bb99-de067ab9df2e tempest-CinderUnicodeTest-34250104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (704ccec9-f1bd-4fb1-a2c0-393dd42e0634) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f023cbfe-5379-4436-b30f-ff43f21ffc99', 'volume_name': 'volume-f023cbfe-5379-4436-b30f-ff43f21ffc99', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:41 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-5700cde3-33b2-4847-bb99-de067ab9df2e tempest-CinderUnicodeTest-34250104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c519fd0f-e68b-4b40-b704-4fcb9039aa83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:41 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-5700cde3-33b2-4847-bb99-de067ab9df2e tempest-CinderUnicodeTest-34250104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c519fd0f-e68b-4b40-b704-4fcb9039aa83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:41 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-5700cde3-33b2-4847-bb99-de067ab9df2e tempest-CinderUnicodeTest-34250104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a5536e5-ba12-41cd-862d-f3a00662191a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:41 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-5700cde3-33b2-4847-bb99-de067ab9df2e tempest-CinderUnicodeTest-34250104 None] Volume f023cbfe-5379-4436-b30f-ff43f21ffc99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f023cbfe-5379-4436-b30f-ff43f21ffc99', 'volume_size': 1}
Feb 27 01:27:41 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-5700cde3-33b2-4847-bb99-de067ab9df2e tempest-CinderUnicodeTest-34250104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:41 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-5700cde3-33b2-4847-bb99-de067ab9df2e tempest-CinderUnicodeTest-34250104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:41 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-5700cde3-33b2-4847-bb99-de067ab9df2e tempest-CinderUnicodeTest-34250104 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:41Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-700121559',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f023cbfe-5379-4436-b30f-ff43f21ffc99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e2578f0100a4164a7fe966cbce5d53a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:41Z,use_quota=True,user_id='44ecdbfdc96741fcae0d64c4c6884fed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:27:41 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-5700cde3-33b2-4847-bb99-de067ab9df2e tempest-CinderUnicodeTest-34250104 None] Creating volume f023cbfe-5379-4436-b30f-ff43f21ffc99 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:27:41 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-5700cde3-33b2-4847-bb99-de067ab9df2e tempest-CinderUnicodeTest-34250104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:41 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-5700cde3-33b2-4847-bb99-de067ab9df2e tempest-CinderUnicodeTest-34250104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:41 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-5700cde3-33b2-4847-bb99-de067ab9df2e tempest-CinderUnicodeTest-34250104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:41 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-5700cde3-33b2-4847-bb99-de067ab9df2e tempest-CinderUnicodeTest-34250104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:41 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-5700cde3-33b2-4847-bb99-de067ab9df2e tempest-CinderUnicodeTest-34250104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:41 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-5700cde3-33b2-4847-bb99-de067ab9df2e tempest-CinderUnicodeTest-34250104 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:27:41 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-5700cde3-33b2-4847-bb99-de067ab9df2e tempest-CinderUnicodeTest-34250104 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:27:41 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5700cde3-33b2-4847-bb99-de067ab9df2e tempest-CinderUnicodeTest-34250104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f023cbfe-5379-4436-b30f-ff43f21ffc99 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:41 devstack sudo[88706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f023cbfe-5379-4436-b30f-ff43f21ffc99 1073741824
Feb 27 01:27:41 devstack sudo[88706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:41 devstack sudo[88703]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:41 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b52d6e59-a107-4cc8-8500-10d96a33e6b9 tempest-VolumesActionsTest-1945194074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-011412d3-a1e7-4791-9d7d-d6d534546796" returned: 0 in 0.467s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:41 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-b52d6e59-a107-4cc8-8500-10d96a33e6b9 tempest-VolumesActionsTest-1945194074 None] Lock "cinder-quobyte-011412d3-a1e7-4791-9d7d-d6d534546796" released by "delete_volume" :: held 1.085s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:41 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-b52d6e59-a107-4cc8-8500-10d96a33e6b9 tempest-VolumesActionsTest-1945194074 None] Created reservations ['3dbcd7d5-d694-4f92-b93b-7e1e3e87e1f2', 'e6bb628a-7b21-400d-a570-5887cf68a38e', 'a4b8732f-cc41-4536-8923-e1cd6980c19e', '78677b4f-2e2d-4197-992f-8a3e2cc2e003'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:27:41 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-b52d6e59-a107-4cc8-8500-10d96a33e6b9 tempest-VolumesActionsTest-1945194074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:41 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-b52d6e59-a107-4cc8-8500-10d96a33e6b9 tempest-VolumesActionsTest-1945194074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:41 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-b52d6e59-a107-4cc8-8500-10d96a33e6b9 tempest-VolumesActionsTest-1945194074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:41 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-b52d6e59-a107-4cc8-8500-10d96a33e6b9 tempest-VolumesActionsTest-1945194074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:41 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-b52d6e59-a107-4cc8-8500-10d96a33e6b9 tempest-VolumesActionsTest-1945194074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:41 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b52d6e59-a107-4cc8-8500-10d96a33e6b9 tempest-VolumesActionsTest-1945194074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:41 devstack sudo[88721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:27:41 devstack sudo[88721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:41 devstack sudo[88706]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:41 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5700cde3-33b2-4847-bb99-de067ab9df2e tempest-CinderUnicodeTest-34250104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f023cbfe-5379-4436-b30f-ff43f21ffc99 1073741824" returned: 0 in 0.597s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:41 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5700cde3-33b2-4847-bb99-de067ab9df2e tempest-CinderUnicodeTest-34250104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f023cbfe-5379-4436-b30f-ff43f21ffc99 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:41 devstack sudo[88728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f023cbfe-5379-4436-b30f-ff43f21ffc99
Feb 27 01:27:41 devstack sudo[88728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:42 devstack sudo[88721]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:42 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b52d6e59-a107-4cc8-8500-10d96a33e6b9 tempest-VolumesActionsTest-1945194074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.487s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:42 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-b52d6e59-a107-4cc8-8500-10d96a33e6b9 tempest-VolumesActionsTest-1945194074 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:27:42 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-b52d6e59-a107-4cc8-8500-10d96a33e6b9 tempest-VolumesActionsTest-1945194074 None] Deleted volume successfully.
Feb 27 01:27:42 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-b52d6e59-a107-4cc8-8500-10d96a33e6b9 tempest-VolumesActionsTest-1945194074 None] Lock "cinder-011412d3-a1e7-4791-9d7d-d6d534546796-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:42 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-ce2b4b94-ae75-4183-8350-b9c7c5f15cb6 tempest-VolumesSnapshotTestJSON-708792780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:42 devstack sudo[88728]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:42 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5700cde3-33b2-4847-bb99-de067ab9df2e tempest-CinderUnicodeTest-34250104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f023cbfe-5379-4436-b30f-ff43f21ffc99" returned: 0 in 0.477s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:42 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-5700cde3-33b2-4847-bb99-de067ab9df2e tempest-CinderUnicodeTest-34250104 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:27:42 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-5700cde3-33b2-4847-bb99-de067ab9df2e tempest-CinderUnicodeTest-34250104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:42 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-ce2b4b94-ae75-4183-8350-b9c7c5f15cb6 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.086s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:42 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-5700cde3-33b2-4847-bb99-de067ab9df2e tempest-CinderUnicodeTest-34250104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a5536e5-ba12-41cd-862d-f3a00662191a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f023cbfe-5379-4436-b30f-ff43f21ffc99', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:42 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-5700cde3-33b2-4847-bb99-de067ab9df2e tempest-CinderUnicodeTest-34250104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa3f2784-a3a8-4074-9407-ee8121604c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:42 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-5700cde3-33b2-4847-bb99-de067ab9df2e tempest-CinderUnicodeTest-34250104 None] Volume volume-f023cbfe-5379-4436-b30f-ff43f21ffc99 (f023cbfe-5379-4436-b30f-ff43f21ffc99): created successfully
Feb 27 01:27:42 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-5700cde3-33b2-4847-bb99-de067ab9df2e tempest-CinderUnicodeTest-34250104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa3f2784-a3a8-4074-9407-ee8121604c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:42 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-5700cde3-33b2-4847-bb99-de067ab9df2e tempest-CinderUnicodeTest-34250104 None] Flow 'volume_create_manager' (fc4b57d9-adec-4b07-bca4-de5171b4a963) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:42 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-ce2b4b94-ae75-4183-8350-b9c7c5f15cb6 tempest-VolumesSnapshotTestJSON-708792780 None] Creating offline snapshot 65b7c4c6-1bae-46db-80b2-89374522f68d of volume 8a3ca527-905e-4193-9b56-3fff1c0a77c3 {{(pid=83106) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:27:42 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-5700cde3-33b2-4847-bb99-de067ab9df2e tempest-CinderUnicodeTest-34250104 None] Created volume successfully.
Feb 27 01:27:42 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[dadc83d2-5add-46fb-89ec-96e51a4a8916]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:42 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ce2b4b94-ae75-4183-8350-b9c7c5f15cb6 tempest-VolumesSnapshotTestJSON-708792780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8a3ca527-905e-4193-9b56-3fff1c0a77c3 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:42 devstack sudo[88732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8a3ca527-905e-4193-9b56-3fff1c0a77c3
Feb 27 01:27:42 devstack sudo[88732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:42 devstack sudo[88732]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:42 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ce2b4b94-ae75-4183-8350-b9c7c5f15cb6 tempest-VolumesSnapshotTestJSON-708792780 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8a3ca527-905e-4193-9b56-3fff1c0a77c3" returned: 0 in 0.552s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:42 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ce2b4b94-ae75-4183-8350-b9c7c5f15cb6 tempest-VolumesSnapshotTestJSON-708792780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8a3ca527-905e-4193-9b56-3fff1c0a77c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8a3ca527-905e-4193-9b56-3fff1c0a77c3.65b7c4c6-1bae-46db-80b2-89374522f68d 1G {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:42 devstack sudo[88738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8a3ca527-905e-4193-9b56-3fff1c0a77c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8a3ca527-905e-4193-9b56-3fff1c0a77c3.65b7c4c6-1bae-46db-80b2-89374522f68d 1G
Feb 27 01:27:42 devstack sudo[88738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:43 devstack sudo[88738]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:43 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ce2b4b94-ae75-4183-8350-b9c7c5f15cb6 tempest-VolumesSnapshotTestJSON-708792780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8a3ca527-905e-4193-9b56-3fff1c0a77c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8a3ca527-905e-4193-9b56-3fff1c0a77c3.65b7c4c6-1bae-46db-80b2-89374522f68d 1G" returned: 0 in 0.578s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:43 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ce2b4b94-ae75-4183-8350-b9c7c5f15cb6 tempest-VolumesSnapshotTestJSON-708792780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a3ca527-905e-4193-9b56-3fff1c0a77c3 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8a3ca527-905e-4193-9b56-3fff1c0a77c3.65b7c4c6-1bae-46db-80b2-89374522f68d {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:43 devstack sudo[88743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a3ca527-905e-4193-9b56-3fff1c0a77c3 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8a3ca527-905e-4193-9b56-3fff1c0a77c3.65b7c4c6-1bae-46db-80b2-89374522f68d
Feb 27 01:27:43 devstack sudo[88743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:43 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-83eb5f5f-4c2b-47cb-81b8-0494d7639833 tempest-CinderUnicodeTest-34250104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:43 devstack sudo[88743]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:43 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ce2b4b94-ae75-4183-8350-b9c7c5f15cb6 tempest-VolumesSnapshotTestJSON-708792780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a3ca527-905e-4193-9b56-3fff1c0a77c3 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8a3ca527-905e-4193-9b56-3fff1c0a77c3.65b7c4c6-1bae-46db-80b2-89374522f68d" returned: 0 in 0.503s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:43 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-ce2b4b94-ae75-4183-8350-b9c7c5f15cb6 tempest-VolumesSnapshotTestJSON-708792780 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8a3ca527-905e-4193-9b56-3fff1c0a77c3.65b7c4c6-1bae-46db-80b2-89374522f68d is being set with open permissions: ugo+rw
Feb 27 01:27:43 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ce2b4b94-ae75-4183-8350-b9c7c5f15cb6 tempest-VolumesSnapshotTestJSON-708792780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8a3ca527-905e-4193-9b56-3fff1c0a77c3.65b7c4c6-1bae-46db-80b2-89374522f68d {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:43 devstack sudo[88752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8a3ca527-905e-4193-9b56-3fff1c0a77c3.65b7c4c6-1bae-46db-80b2-89374522f68d
Feb 27 01:27:43 devstack sudo[88752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:44 devstack sudo[88752]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:44 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ce2b4b94-ae75-4183-8350-b9c7c5f15cb6 tempest-VolumesSnapshotTestJSON-708792780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8a3ca527-905e-4193-9b56-3fff1c0a77c3.65b7c4c6-1bae-46db-80b2-89374522f68d" returned: 0 in 0.503s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:44 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ce2b4b94-ae75-4183-8350-b9c7c5f15cb6 tempest-VolumesSnapshotTestJSON-708792780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8a3ca527-905e-4193-9b56-3fff1c0a77c3.info {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:44 devstack sudo[88755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8a3ca527-905e-4193-9b56-3fff1c0a77c3.info
Feb 27 01:27:44 devstack sudo[88755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:44 devstack sudo[88755]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:44 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ce2b4b94-ae75-4183-8350-b9c7c5f15cb6 tempest-VolumesSnapshotTestJSON-708792780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8a3ca527-905e-4193-9b56-3fff1c0a77c3.info" returned: 0 in 0.473s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:44 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-ce2b4b94-ae75-4183-8350-b9c7c5f15cb6 tempest-VolumesSnapshotTestJSON-708792780 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8a3ca527-905e-4193-9b56-3fff1c0a77c3.info is being set with open permissions: ugo+rw
Feb 27 01:27:44 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ce2b4b94-ae75-4183-8350-b9c7c5f15cb6 tempest-VolumesSnapshotTestJSON-708792780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8a3ca527-905e-4193-9b56-3fff1c0a77c3.info {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:44 devstack sudo[88758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8a3ca527-905e-4193-9b56-3fff1c0a77c3.info
Feb 27 01:27:44 devstack sudo[88758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:45 devstack sudo[88758]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:45 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ce2b4b94-ae75-4183-8350-b9c7c5f15cb6 tempest-VolumesSnapshotTestJSON-708792780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8a3ca527-905e-4193-9b56-3fff1c0a77c3.info" returned: 0 in 0.496s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:45 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-ce2b4b94-ae75-4183-8350-b9c7c5f15cb6 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.236s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:45 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-83eb5f5f-4c2b-47cb-81b8-0494d7639833 tempest-CinderUnicodeTest-34250104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.031s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:45 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-83eb5f5f-4c2b-47cb-81b8-0494d7639833 tempest-CinderUnicodeTest-34250104 None] Creating offline snapshot a4a59c62-b1f4-418a-90bb-40c987bc6ed3 of volume f023cbfe-5379-4436-b30f-ff43f21ffc99 {{(pid=83106) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:27:45 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-ce2b4b94-ae75-4183-8350-b9c7c5f15cb6 tempest-VolumesSnapshotTestJSON-708792780 None] Create snapshot completed successfully
Feb 27 01:27:45 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2a6b6e-a534-4d57-be4a-4aa3b10da220]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:45 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-83eb5f5f-4c2b-47cb-81b8-0494d7639833 tempest-CinderUnicodeTest-34250104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f023cbfe-5379-4436-b30f-ff43f21ffc99 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:45 devstack sudo[88786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f023cbfe-5379-4436-b30f-ff43f21ffc99
Feb 27 01:27:45 devstack sudo[88786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:46 devstack sudo[88786]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:46 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-83eb5f5f-4c2b-47cb-81b8-0494d7639833 tempest-CinderUnicodeTest-34250104 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f023cbfe-5379-4436-b30f-ff43f21ffc99" returned: 0 in 0.718s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:46 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-83eb5f5f-4c2b-47cb-81b8-0494d7639833 tempest-CinderUnicodeTest-34250104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f023cbfe-5379-4436-b30f-ff43f21ffc99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f023cbfe-5379-4436-b30f-ff43f21ffc99.a4a59c62-b1f4-418a-90bb-40c987bc6ed3 1G {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:46 devstack sudo[88794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f023cbfe-5379-4436-b30f-ff43f21ffc99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f023cbfe-5379-4436-b30f-ff43f21ffc99.a4a59c62-b1f4-418a-90bb-40c987bc6ed3 1G
Feb 27 01:27:46 devstack sudo[88794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:46 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc30f850-1ff7-487a-82e4-4e436d509717 tempest-VolumesSnapshotTestJSON-708792780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:27:46 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-cc30f850-1ff7-487a-82e4-4e436d509717 tempest-VolumesSnapshotTestJSON-708792780 None] Flow 'volume_create_manager' (5377b59e-b80f-4676-8b55-335af6c39c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:46 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-cc30f850-1ff7-487a-82e4-4e436d509717 tempest-VolumesSnapshotTestJSON-708792780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb123801-45ca-4f79-b821-9b051f8bbf49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:46 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-cc30f850-1ff7-487a-82e4-4e436d509717 tempest-VolumesSnapshotTestJSON-708792780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb123801-45ca-4f79-b821-9b051f8bbf49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-374237298',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d3157ab-0bfc-4bdd-b72b-2f2f3345b35f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fba5f3accb0d428597d9c1a212708a1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=65b7c4c6-1bae-46db-80b2-89374522f68d,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:47Z,use_quota=True,user_id='4b8cb8c9a1344b09921d38d6e27d2878',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:46 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-cc30f850-1ff7-487a-82e4-4e436d509717 tempest-VolumesSnapshotTestJSON-708792780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03ee06a3-6c0f-447d-b694-21efb91e856b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:46 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-cc30f850-1ff7-487a-82e4-4e436d509717 tempest-VolumesSnapshotTestJSON-708792780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03ee06a3-6c0f-447d-b694-21efb91e856b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:46 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-cc30f850-1ff7-487a-82e4-4e436d509717 tempest-VolumesSnapshotTestJSON-708792780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97c94be6-06a9-4664-9903-527d00312510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:46 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-cc30f850-1ff7-487a-82e4-4e436d509717 tempest-VolumesSnapshotTestJSON-708792780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97c94be6-06a9-4664-9903-527d00312510) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2d3157ab-0bfc-4bdd-b72b-2f2f3345b35f', 'volume_name': 'volume-2d3157ab-0bfc-4bdd-b72b-2f2f3345b35f', 'volume_size': 1, 'snapshot_id': '65b7c4c6-1bae-46db-80b2-89374522f68d'}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:46 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-cc30f850-1ff7-487a-82e4-4e436d509717 tempest-VolumesSnapshotTestJSON-708792780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (459bc039-3b05-4774-8ba1-0839371d31f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:46 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-cc30f850-1ff7-487a-82e4-4e436d509717 tempest-VolumesSnapshotTestJSON-708792780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (459bc039-3b05-4774-8ba1-0839371d31f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:46 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-cc30f850-1ff7-487a-82e4-4e436d509717 tempest-VolumesSnapshotTestJSON-708792780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1ad4fe4-bbbd-404f-b72d-e05fe98be27e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:46 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-cc30f850-1ff7-487a-82e4-4e436d509717 tempest-VolumesSnapshotTestJSON-708792780 None] Volume 2d3157ab-0bfc-4bdd-b72b-2f2f3345b35f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2d3157ab-0bfc-4bdd-b72b-2f2f3345b35f', 'volume_size': 1, 'snapshot_id': '65b7c4c6-1bae-46db-80b2-89374522f68d'}
Feb 27 01:27:46 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-cc30f850-1ff7-487a-82e4-4e436d509717 tempest-VolumesSnapshotTestJSON-708792780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:47 devstack sudo[88794]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:47 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-83eb5f5f-4c2b-47cb-81b8-0494d7639833 tempest-CinderUnicodeTest-34250104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f023cbfe-5379-4436-b30f-ff43f21ffc99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f023cbfe-5379-4436-b30f-ff43f21ffc99.a4a59c62-b1f4-418a-90bb-40c987bc6ed3 1G" returned: 0 in 0.895s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:47 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-83eb5f5f-4c2b-47cb-81b8-0494d7639833 tempest-CinderUnicodeTest-34250104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f023cbfe-5379-4436-b30f-ff43f21ffc99 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f023cbfe-5379-4436-b30f-ff43f21ffc99.a4a59c62-b1f4-418a-90bb-40c987bc6ed3 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:47 devstack sudo[88800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f023cbfe-5379-4436-b30f-ff43f21ffc99 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f023cbfe-5379-4436-b30f-ff43f21ffc99.a4a59c62-b1f4-418a-90bb-40c987bc6ed3
Feb 27 01:27:47 devstack sudo[88800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:47 devstack sudo[88800]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:47 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-83eb5f5f-4c2b-47cb-81b8-0494d7639833 tempest-CinderUnicodeTest-34250104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f023cbfe-5379-4436-b30f-ff43f21ffc99 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f023cbfe-5379-4436-b30f-ff43f21ffc99.a4a59c62-b1f4-418a-90bb-40c987bc6ed3" returned: 0 in 0.558s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:47 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-83eb5f5f-4c2b-47cb-81b8-0494d7639833 tempest-CinderUnicodeTest-34250104 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f023cbfe-5379-4436-b30f-ff43f21ffc99.a4a59c62-b1f4-418a-90bb-40c987bc6ed3 is being set with open permissions: ugo+rw
Feb 27 01:27:47 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-83eb5f5f-4c2b-47cb-81b8-0494d7639833 tempest-CinderUnicodeTest-34250104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f023cbfe-5379-4436-b30f-ff43f21ffc99.a4a59c62-b1f4-418a-90bb-40c987bc6ed3 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:47 devstack sudo[88805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f023cbfe-5379-4436-b30f-ff43f21ffc99.a4a59c62-b1f4-418a-90bb-40c987bc6ed3
Feb 27 01:27:47 devstack sudo[88805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:48 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-e9c48bd5-f4de-49cf-b7ad-eff55ca8bb0a tempest-VolumesActionsTest-1196644426 None] Acquiring lock "cinder-0b66dc01-1c7a-427d-b771-a85154916559" by "attach_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:48 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-e9c48bd5-f4de-49cf-b7ad-eff55ca8bb0a tempest-VolumesActionsTest-1196644426 None] Lock "cinder-0b66dc01-1c7a-427d-b771-a85154916559" acquired by "attach_volume" :: waited 0.016s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:48 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-e9c48bd5-f4de-49cf-b7ad-eff55ca8bb0a tempest-VolumesActionsTest-1196644426 None] Attaching volume 0b66dc01-1c7a-427d-b771-a85154916559 to instance 3c92f35b-0348-482f-bafb-7a7e16a3a7a4 at mountpoint /dev/vdb on host None.
Feb 27 01:27:48 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-e9c48bd5-f4de-49cf-b7ad-eff55ca8bb0a tempest-VolumesActionsTest-1196644426 None] Attach volume completed successfully.
Feb 27 01:27:48 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-e9c48bd5-f4de-49cf-b7ad-eff55ca8bb0a tempest-VolumesActionsTest-1196644426 None] Lock "cinder-0b66dc01-1c7a-427d-b771-a85154916559" released by "attach_volume" :: held 0.090s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:48 devstack sudo[88805]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:48 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-83eb5f5f-4c2b-47cb-81b8-0494d7639833 tempest-CinderUnicodeTest-34250104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f023cbfe-5379-4436-b30f-ff43f21ffc99.a4a59c62-b1f4-418a-90bb-40c987bc6ed3" returned: 0 in 0.719s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:48 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-83eb5f5f-4c2b-47cb-81b8-0494d7639833 tempest-CinderUnicodeTest-34250104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f023cbfe-5379-4436-b30f-ff43f21ffc99.info {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:48 devstack sudo[88808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f023cbfe-5379-4436-b30f-ff43f21ffc99.info
Feb 27 01:27:48 devstack sudo[88808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:48 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-68ef0c1a-eb3a-4e50-a15f-cabd653ae815 tempest-VolumesActionsTest-1196644426 None] Acquiring lock "cinder-0b66dc01-1c7a-427d-b771-a85154916559-detach_volume" by "detach_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:48 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-68ef0c1a-eb3a-4e50-a15f-cabd653ae815 tempest-VolumesActionsTest-1196644426 None] Lock "cinder-0b66dc01-1c7a-427d-b771-a85154916559-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:48 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-68ef0c1a-eb3a-4e50-a15f-cabd653ae815 tempest-VolumesActionsTest-1196644426 None] Detaching volume 0b66dc01-1c7a-427d-b771-a85154916559 from instance 3c92f35b-0348-482f-bafb-7a7e16a3a7a4.
Feb 27 01:27:48 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-68ef0c1a-eb3a-4e50-a15f-cabd653ae815 tempest-VolumesActionsTest-1196644426 None] Detach volume completed successfully.
Feb 27 01:27:48 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-68ef0c1a-eb3a-4e50-a15f-cabd653ae815 tempest-VolumesActionsTest-1196644426 None] Lock "cinder-0b66dc01-1c7a-427d-b771-a85154916559-detach_volume" released by "detach_volume" :: held 0.093s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:49 devstack sudo[88808]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-83eb5f5f-4c2b-47cb-81b8-0494d7639833 tempest-CinderUnicodeTest-34250104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f023cbfe-5379-4436-b30f-ff43f21ffc99.info" returned: 0 in 0.620s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:49 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-83eb5f5f-4c2b-47cb-81b8-0494d7639833 tempest-CinderUnicodeTest-34250104 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f023cbfe-5379-4436-b30f-ff43f21ffc99.info is being set with open permissions: ugo+rw
Feb 27 01:27:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-83eb5f5f-4c2b-47cb-81b8-0494d7639833 tempest-CinderUnicodeTest-34250104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f023cbfe-5379-4436-b30f-ff43f21ffc99.info {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:49 devstack sudo[88812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f023cbfe-5379-4436-b30f-ff43f21ffc99.info
Feb 27 01:27:49 devstack sudo[88812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:49 devstack sudo[88812]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-83eb5f5f-4c2b-47cb-81b8-0494d7639833 tempest-CinderUnicodeTest-34250104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f023cbfe-5379-4436-b30f-ff43f21ffc99.info" returned: 0 in 0.511s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-83eb5f5f-4c2b-47cb-81b8-0494d7639833 tempest-CinderUnicodeTest-34250104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.116s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-cc30f850-1ff7-487a-82e4-4e436d509717 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.686s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:49 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-cc30f850-1ff7-487a-82e4-4e436d509717 tempest-VolumesSnapshotTestJSON-708792780 None] Acquiring lock "cinder-quobyte-65b7c4c6-1bae-46db-80b2-89374522f68d-2d3157ab-0bfc-4bdd-b72b-2f2f3345b35f" by "_create_volume_from_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:49 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-cc30f850-1ff7-487a-82e4-4e436d509717 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "cinder-quobyte-65b7c4c6-1bae-46db-80b2-89374522f68d-2d3157ab-0bfc-4bdd-b72b-2f2f3345b35f" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:49 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-cc30f850-1ff7-487a-82e4-4e436d509717 tempest-VolumesSnapshotTestJSON-708792780 None] Creating volume 2d3157ab-0bfc-4bdd-b72b-2f2f3345b35f from snapshot 65b7c4c6-1bae-46db-80b2-89374522f68d {{(pid=83106) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Feb 27 01:27:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-cc30f850-1ff7-487a-82e4-4e436d509717 tempest-VolumesSnapshotTestJSON-708792780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-cc30f850-1ff7-487a-82e4-4e436d509717 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:49 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-cc30f850-1ff7-487a-82e4-4e436d509717 tempest-VolumesSnapshotTestJSON-708792780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:49 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-cc30f850-1ff7-487a-82e4-4e436d509717 tempest-VolumesSnapshotTestJSON-708792780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-cc30f850-1ff7-487a-82e4-4e436d509717 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:49 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-cc30f850-1ff7-487a-82e4-4e436d509717 tempest-VolumesSnapshotTestJSON-708792780 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:27:49 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-cc30f850-1ff7-487a-82e4-4e436d509717 tempest-VolumesSnapshotTestJSON-708792780 None] Acquiring lock "cinder-quobyte-2d3157ab-0bfc-4bdd-b72b-2f2f3345b35f" by "_copy_volume_from_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:49 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-83eb5f5f-4c2b-47cb-81b8-0494d7639833 tempest-CinderUnicodeTest-34250104 None] Create snapshot completed successfully
Feb 27 01:27:49 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-cc30f850-1ff7-487a-82e4-4e436d509717 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "cinder-quobyte-2d3157ab-0bfc-4bdd-b72b-2f2f3345b35f" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:49 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-cc30f850-1ff7-487a-82e4-4e436d509717 tempest-VolumesSnapshotTestJSON-708792780 None] snapshot: 65b7c4c6-1bae-46db-80b2-89374522f68d, volume: 2d3157ab-0bfc-4bdd-b72b-2f2f3345b35f,  {{(pid=83106) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Feb 27 01:27:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-cc30f850-1ff7-487a-82e4-4e436d509717 tempest-VolumesSnapshotTestJSON-708792780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-cc30f850-1ff7-487a-82e4-4e436d509717 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:49 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-cc30f850-1ff7-487a-82e4-4e436d509717 tempest-VolumesSnapshotTestJSON-708792780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:49 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-cc30f850-1ff7-487a-82e4-4e436d509717 tempest-VolumesSnapshotTestJSON-708792780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-cc30f850-1ff7-487a-82e4-4e436d509717 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:49 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[6969d693-1dc2-4232-921a-587ca030e82d]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-cc30f850-1ff7-487a-82e4-4e436d509717 tempest-VolumesSnapshotTestJSON-708792780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8a3ca527-905e-4193-9b56-3fff1c0a77c3.65b7c4c6-1bae-46db-80b2-89374522f68d {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:49 devstack sudo[88815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8a3ca527-905e-4193-9b56-3fff1c0a77c3.65b7c4c6-1bae-46db-80b2-89374522f68d
Feb 27 01:27:49 devstack sudo[88815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:49 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-0a8aed7b-efd0-47c3-8833-7d8f1d5c2a87 tempest-CinderUnicodeTest-34250104 None] Acquiring lock "cinder-a4a59c62-b1f4-418a-90bb-40c987bc6ed3-delete_snapshot" by "delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:49 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-0a8aed7b-efd0-47c3-8833-7d8f1d5c2a87 tempest-CinderUnicodeTest-34250104 None] Lock "cinder-a4a59c62-b1f4-418a-90bb-40c987bc6ed3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:49 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-0a8aed7b-efd0-47c3-8833-7d8f1d5c2a87 tempest-CinderUnicodeTest-34250104 None] Acquiring lock "cinder-quobyte-f023cbfe-5379-4436-b30f-ff43f21ffc99" by "delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:49 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-0a8aed7b-efd0-47c3-8833-7d8f1d5c2a87 tempest-CinderUnicodeTest-34250104 None] Lock "cinder-quobyte-f023cbfe-5379-4436-b30f-ff43f21ffc99" acquired by "delete_snapshot" :: waited 0.022s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:49 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-0a8aed7b-efd0-47c3-8833-7d8f1d5c2a87 tempest-CinderUnicodeTest-34250104 None] Acquiring lock "cinder-quobyte-a4a59c62-b1f4-418a-90bb-40c987bc6ed3" by "_delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:49 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-0a8aed7b-efd0-47c3-8833-7d8f1d5c2a87 tempest-CinderUnicodeTest-34250104 None] Lock "cinder-quobyte-a4a59c62-b1f4-418a-90bb-40c987bc6ed3" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:49 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-0a8aed7b-efd0-47c3-8833-7d8f1d5c2a87 tempest-CinderUnicodeTest-34250104 None] Deleting offline snapshot a4a59c62-b1f4-418a-90bb-40c987bc6ed3 of volume f023cbfe-5379-4436-b30f-ff43f21ffc99 {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:27:49 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-0a8aed7b-efd0-47c3-8833-7d8f1d5c2a87 tempest-CinderUnicodeTest-34250104 None] snapshot_file for this snap is: volume-f023cbfe-5379-4436-b30f-ff43f21ffc99.a4a59c62-b1f4-418a-90bb-40c987bc6ed3 {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:27:49 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[60df84f9-fe61-4968-88bc-27b222c37552]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0a8aed7b-efd0-47c3-8833-7d8f1d5c2a87 tempest-CinderUnicodeTest-34250104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f023cbfe-5379-4436-b30f-ff43f21ffc99.a4a59c62-b1f4-418a-90bb-40c987bc6ed3 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:50 devstack sudo[88817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f023cbfe-5379-4436-b30f-ff43f21ffc99.a4a59c62-b1f4-418a-90bb-40c987bc6ed3
Feb 27 01:27:50 devstack sudo[88817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:50 devstack sudo[88815]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:50 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-cc30f850-1ff7-487a-82e4-4e436d509717 tempest-VolumesSnapshotTestJSON-708792780 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8a3ca527-905e-4193-9b56-3fff1c0a77c3.65b7c4c6-1bae-46db-80b2-89374522f68d" returned: 0 in 0.697s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:50 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-cc30f850-1ff7-487a-82e4-4e436d509717 tempest-VolumesSnapshotTestJSON-708792780 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a3ca527-905e-4193-9b56-3fff1c0a77c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83106) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:27:50 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-cc30f850-1ff7-487a-82e4-4e436d509717 tempest-VolumesSnapshotTestJSON-708792780 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8a3ca527-905e-4193-9b56-3fff1c0a77c3 {{(pid=83106) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Feb 27 01:27:50 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-cc30f850-1ff7-487a-82e4-4e436d509717 tempest-VolumesSnapshotTestJSON-708792780 None] Creating direct copy from snapshot {{(pid=83106) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Feb 27 01:27:50 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[545293c6-61f5-47bc-ac80-be4a8d551514]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:50 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-cc30f850-1ff7-487a-82e4-4e436d509717 tempest-VolumesSnapshotTestJSON-708792780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8a3ca527-905e-4193-9b56-3fff1c0a77c3 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:50 devstack sudo[88822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8a3ca527-905e-4193-9b56-3fff1c0a77c3
Feb 27 01:27:50 devstack sudo[88822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:50 devstack sudo[88817]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:50 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0a8aed7b-efd0-47c3-8833-7d8f1d5c2a87 tempest-CinderUnicodeTest-34250104 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f023cbfe-5379-4436-b30f-ff43f21ffc99.a4a59c62-b1f4-418a-90bb-40c987bc6ed3" returned: 0 in 0.730s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:50 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-0a8aed7b-efd0-47c3-8833-7d8f1d5c2a87 tempest-CinderUnicodeTest-34250104 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f023cbfe-5379-4436-b30f-ff43f21ffc99(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83106) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:27:50 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[600507b8-5368-455b-b6d4-02aae03cd07d]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:50 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0a8aed7b-efd0-47c3-8833-7d8f1d5c2a87 tempest-CinderUnicodeTest-34250104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f023cbfe-5379-4436-b30f-ff43f21ffc99 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:50 devstack sudo[88837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f023cbfe-5379-4436-b30f-ff43f21ffc99
Feb 27 01:27:50 devstack sudo[88837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:51 devstack sudo[88822]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:51 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-cc30f850-1ff7-487a-82e4-4e436d509717 tempest-VolumesSnapshotTestJSON-708792780 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8a3ca527-905e-4193-9b56-3fff1c0a77c3" returned: 0 in 0.704s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:51 devstack cinder-volume[83106]: DEBUG cinder.utils [None req-cc30f850-1ff7-487a-82e4-4e436d509717 tempest-VolumesSnapshotTestJSON-708792780 None] Path /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-2d3157ab-0bfc-4bdd-b72b-2f2f3345b35f not found in is_blk_device check {{(pid=83106) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Feb 27 01:27:51 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-cc30f850-1ff7-487a-82e4-4e436d509717 tempest-VolumesSnapshotTestJSON-708792780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8a3ca527-905e-4193-9b56-3fff1c0a77c3 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-2d3157ab-0bfc-4bdd-b72b-2f2f3345b35f {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:51 devstack sudo[88859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8a3ca527-905e-4193-9b56-3fff1c0a77c3 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-2d3157ab-0bfc-4bdd-b72b-2f2f3345b35f
Feb 27 01:27:51 devstack sudo[88859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:51 devstack sudo[88837]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:51 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0a8aed7b-efd0-47c3-8833-7d8f1d5c2a87 tempest-CinderUnicodeTest-34250104 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f023cbfe-5379-4436-b30f-ff43f21ffc99" returned: 0 in 0.748s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:51 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0a8aed7b-efd0-47c3-8833-7d8f1d5c2a87 tempest-CinderUnicodeTest-34250104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f023cbfe-5379-4436-b30f-ff43f21ffc99.a4a59c62-b1f4-418a-90bb-40c987bc6ed3 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:51 devstack sudo[88865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f023cbfe-5379-4436-b30f-ff43f21ffc99.a4a59c62-b1f4-418a-90bb-40c987bc6ed3
Feb 27 01:27:51 devstack sudo[88865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:52 devstack sudo[88865]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:52 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0a8aed7b-efd0-47c3-8833-7d8f1d5c2a87 tempest-CinderUnicodeTest-34250104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f023cbfe-5379-4436-b30f-ff43f21ffc99.a4a59c62-b1f4-418a-90bb-40c987bc6ed3" returned: 0 in 1.175s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:52 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0a8aed7b-efd0-47c3-8833-7d8f1d5c2a87 tempest-CinderUnicodeTest-34250104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f023cbfe-5379-4436-b30f-ff43f21ffc99.a4a59c62-b1f4-418a-90bb-40c987bc6ed3 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:52 devstack sudo[88886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f023cbfe-5379-4436-b30f-ff43f21ffc99.a4a59c62-b1f4-418a-90bb-40c987bc6ed3
Feb 27 01:27:52 devstack sudo[88886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:53 devstack sudo[88886]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:53 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0a8aed7b-efd0-47c3-8833-7d8f1d5c2a87 tempest-CinderUnicodeTest-34250104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f023cbfe-5379-4436-b30f-ff43f21ffc99.a4a59c62-b1f4-418a-90bb-40c987bc6ed3" returned: 0 in 1.361s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:54 devstack sudo[88859]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:54 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-cc30f850-1ff7-487a-82e4-4e436d509717 tempest-VolumesSnapshotTestJSON-708792780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8a3ca527-905e-4193-9b56-3fff1c0a77c3 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-2d3157ab-0bfc-4bdd-b72b-2f2f3345b35f" returned: 0 in 2.895s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:54 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-0a8aed7b-efd0-47c3-8833-7d8f1d5c2a87 tempest-CinderUnicodeTest-34250104 None] Lock "cinder-quobyte-a4a59c62-b1f4-418a-90bb-40c987bc6ed3" released by "_delete_snapshot" :: held 4.122s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:54 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[35acbe24-479d-4ad0-82ff-d79d563d922e]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:54 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-cc30f850-1ff7-487a-82e4-4e436d509717 tempest-VolumesSnapshotTestJSON-708792780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8a3ca527-905e-4193-9b56-3fff1c0a77c3 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:54 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-0a8aed7b-efd0-47c3-8833-7d8f1d5c2a87 tempest-CinderUnicodeTest-34250104 None] Lock "cinder-quobyte-f023cbfe-5379-4436-b30f-ff43f21ffc99" released by "delete_snapshot" :: held 4.158s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:54 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-0a8aed7b-efd0-47c3-8833-7d8f1d5c2a87 tempest-CinderUnicodeTest-34250104 None] Created reservations ['a25415df-c651-4abc-8891-e6c0dfb86c9a', '11626070-21b8-4c26-b64e-3c675142bbed', '55824152-7660-4136-bdd9-a15cf0a249f0', '8274853d-efa6-4da0-8b29-a8af16cf9e61'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:27:54 devstack sudo[88891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8a3ca527-905e-4193-9b56-3fff1c0a77c3
Feb 27 01:27:54 devstack sudo[88891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:54 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-0a8aed7b-efd0-47c3-8833-7d8f1d5c2a87 tempest-CinderUnicodeTest-34250104 None] Delete snapshot completed successfully.
Feb 27 01:27:54 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-0a8aed7b-efd0-47c3-8833-7d8f1d5c2a87 tempest-CinderUnicodeTest-34250104 None] Lock "cinder-a4a59c62-b1f4-418a-90bb-40c987bc6ed3-delete_snapshot" released by "delete_snapshot" :: held 4.330s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:54 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec15eeb0-4949-4d07-8dea-00ce6a7f4682 tempest-VolumesListAdminTestJSON-1634395798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:27:54 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-ec15eeb0-4949-4d07-8dea-00ce6a7f4682 tempest-VolumesListAdminTestJSON-1634395798 None] Flow 'volume_create_manager' (b057bf4e-0cc0-46cf-85b0-f940fda5df1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:54 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-ec15eeb0-4949-4d07-8dea-00ce6a7f4682 tempest-VolumesListAdminTestJSON-1634395798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0db2035-ea8f-4185-aab8-40442730a3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:54 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-e6ef225c-825d-480f-915f-b8fd78f59a7e tempest-CinderUnicodeTest-34250104 None] Acquiring lock "cinder-f023cbfe-5379-4436-b30f-ff43f21ffc99-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:54 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-ec15eeb0-4949-4d07-8dea-00ce6a7f4682 tempest-VolumesListAdminTestJSON-1634395798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0db2035-ea8f-4185-aab8-40442730a3ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1321444758',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14fa7b80-3616-4294-9e83-90d9eb398326,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f09c0bdc5d15465ba16bfd72f3b8d745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:54Z,use_quota=True,user_id='73ee082947f64841a47605c12bd6b3d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:54 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-ec15eeb0-4949-4d07-8dea-00ce6a7f4682 tempest-VolumesListAdminTestJSON-1634395798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3288d06-92ec-45e2-a740-2eff2af5cf43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:54 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-ec15eeb0-4949-4d07-8dea-00ce6a7f4682 tempest-VolumesListAdminTestJSON-1634395798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3288d06-92ec-45e2-a740-2eff2af5cf43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:54 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-ec15eeb0-4949-4d07-8dea-00ce6a7f4682 tempest-VolumesListAdminTestJSON-1634395798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (692e6fe4-6fa9-495a-bbdb-cc9aadddc460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:54 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-ec15eeb0-4949-4d07-8dea-00ce6a7f4682 tempest-VolumesListAdminTestJSON-1634395798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (692e6fe4-6fa9-495a-bbdb-cc9aadddc460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14fa7b80-3616-4294-9e83-90d9eb398326', 'volume_name': 'volume-14fa7b80-3616-4294-9e83-90d9eb398326', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:54 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-ec15eeb0-4949-4d07-8dea-00ce6a7f4682 tempest-VolumesListAdminTestJSON-1634395798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c89b20b8-13be-48ba-baa6-76842beb547d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:54 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-ec15eeb0-4949-4d07-8dea-00ce6a7f4682 tempest-VolumesListAdminTestJSON-1634395798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c89b20b8-13be-48ba-baa6-76842beb547d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:54 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-ec15eeb0-4949-4d07-8dea-00ce6a7f4682 tempest-VolumesListAdminTestJSON-1634395798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e1b593e-faff-4e9a-b1a0-0e2237f2bae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:54 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-ec15eeb0-4949-4d07-8dea-00ce6a7f4682 tempest-VolumesListAdminTestJSON-1634395798 None] Volume 14fa7b80-3616-4294-9e83-90d9eb398326: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14fa7b80-3616-4294-9e83-90d9eb398326', 'volume_size': 1}
Feb 27 01:27:54 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-ec15eeb0-4949-4d07-8dea-00ce6a7f4682 tempest-VolumesListAdminTestJSON-1634395798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:54 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-e6ef225c-825d-480f-915f-b8fd78f59a7e tempest-CinderUnicodeTest-34250104 None] Lock "cinder-f023cbfe-5379-4436-b30f-ff43f21ffc99-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:54 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-e6ef225c-825d-480f-915f-b8fd78f59a7e tempest-CinderUnicodeTest-34250104 None] Acquiring lock "cinder-quobyte-f023cbfe-5379-4436-b30f-ff43f21ffc99" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:54 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-e6ef225c-825d-480f-915f-b8fd78f59a7e tempest-CinderUnicodeTest-34250104 None] Lock "cinder-quobyte-f023cbfe-5379-4436-b30f-ff43f21ffc99" acquired by "delete_volume" :: waited 0.009s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:54 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aba7703-7da1-4500-a602-fe80a692f41f]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:54 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-e6ef225c-825d-480f-915f-b8fd78f59a7e tempest-CinderUnicodeTest-34250104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f023cbfe-5379-4436-b30f-ff43f21ffc99 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:54 devstack sudo[88893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f023cbfe-5379-4436-b30f-ff43f21ffc99
Feb 27 01:27:54 devstack sudo[88893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:54 devstack sudo[88891]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:54 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-cc30f850-1ff7-487a-82e4-4e436d509717 tempest-VolumesSnapshotTestJSON-708792780 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8a3ca527-905e-4193-9b56-3fff1c0a77c3" returned: 0 in 0.818s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:54 devstack cinder-volume[83106]: DEBUG cinder.image.image_utils [None req-cc30f850-1ff7-487a-82e4-4e436d509717 tempest-VolumesSnapshotTestJSON-708792780 None] Image conversion details: src /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8a3ca527-905e-4193-9b56-3fff1c0a77c3, size 1024.00 MB, duration 2.90 sec, destination /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-2d3157ab-0bfc-4bdd-b72b-2f2f3345b35f {{(pid=83106) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 27 01:27:54 devstack cinder-volume[83106]: INFO cinder.image.image_utils [None req-cc30f850-1ff7-487a-82e4-4e436d509717 tempest-VolumesSnapshotTestJSON-708792780 None] Converted 1024.00 MB image at 353.53 MB/s
Feb 27 01:27:54 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-cc30f850-1ff7-487a-82e4-4e436d509717 tempest-VolumesSnapshotTestJSON-708792780 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-2d3157ab-0bfc-4bdd-b72b-2f2f3345b35f is being set with open permissions: ugo+rw
Feb 27 01:27:54 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-cc30f850-1ff7-487a-82e4-4e436d509717 tempest-VolumesSnapshotTestJSON-708792780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-2d3157ab-0bfc-4bdd-b72b-2f2f3345b35f {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:54 devstack sudo[88898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-2d3157ab-0bfc-4bdd-b72b-2f2f3345b35f
Feb 27 01:27:54 devstack sudo[88898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:55 devstack sudo[88893]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-e6ef225c-825d-480f-915f-b8fd78f59a7e tempest-CinderUnicodeTest-34250104 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f023cbfe-5379-4436-b30f-ff43f21ffc99" returned: 0 in 0.632s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-e6ef225c-825d-480f-915f-b8fd78f59a7e tempest-CinderUnicodeTest-34250104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f023cbfe-5379-4436-b30f-ff43f21ffc99 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:55 devstack sudo[88903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f023cbfe-5379-4436-b30f-ff43f21ffc99
Feb 27 01:27:55 devstack sudo[88903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:55 devstack sudo[88898]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-cc30f850-1ff7-487a-82e4-4e436d509717 tempest-VolumesSnapshotTestJSON-708792780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-2d3157ab-0bfc-4bdd-b72b-2f2f3345b35f" returned: 0 in 0.554s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:55 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-cc30f850-1ff7-487a-82e4-4e436d509717 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "cinder-quobyte-2d3157ab-0bfc-4bdd-b72b-2f2f3345b35f" released by "_copy_volume_from_snapshot" :: held 5.744s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:55 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-cc30f850-1ff7-487a-82e4-4e436d509717 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "cinder-quobyte-65b7c4c6-1bae-46db-80b2-89374522f68d-2d3157ab-0bfc-4bdd-b72b-2f2f3345b35f" released by "_create_volume_from_snapshot" :: held 5.769s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-cc30f850-1ff7-487a-82e4-4e436d509717 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.789s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-ec15eeb0-4949-4d07-8dea-00ce6a7f4682 tempest-VolumesListAdminTestJSON-1634395798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.018s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:55 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-ec15eeb0-4949-4d07-8dea-00ce6a7f4682 tempest-VolumesListAdminTestJSON-1634395798 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1321444758',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14fa7b80-3616-4294-9e83-90d9eb398326,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f09c0bdc5d15465ba16bfd72f3b8d745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:54Z,use_quota=True,user_id='73ee082947f64841a47605c12bd6b3d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:27:55 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-ec15eeb0-4949-4d07-8dea-00ce6a7f4682 tempest-VolumesListAdminTestJSON-1634395798 None] Creating volume 14fa7b80-3616-4294-9e83-90d9eb398326 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:27:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-ec15eeb0-4949-4d07-8dea-00ce6a7f4682 tempest-VolumesListAdminTestJSON-1634395798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-ec15eeb0-4949-4d07-8dea-00ce6a7f4682 tempest-VolumesListAdminTestJSON-1634395798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:55 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-ec15eeb0-4949-4d07-8dea-00ce6a7f4682 tempest-VolumesListAdminTestJSON-1634395798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:55 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-ec15eeb0-4949-4d07-8dea-00ce6a7f4682 tempest-VolumesListAdminTestJSON-1634395798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-ec15eeb0-4949-4d07-8dea-00ce6a7f4682 tempest-VolumesListAdminTestJSON-1634395798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:55 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-ec15eeb0-4949-4d07-8dea-00ce6a7f4682 tempest-VolumesListAdminTestJSON-1634395798 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:27:55 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-ec15eeb0-4949-4d07-8dea-00ce6a7f4682 tempest-VolumesListAdminTestJSON-1634395798 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:27:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ec15eeb0-4949-4d07-8dea-00ce6a7f4682 tempest-VolumesListAdminTestJSON-1634395798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-14fa7b80-3616-4294-9e83-90d9eb398326 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:55 devstack sudo[88906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-14fa7b80-3616-4294-9e83-90d9eb398326 1073741824
Feb 27 01:27:55 devstack sudo[88906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:55 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-cc30f850-1ff7-487a-82e4-4e436d509717 tempest-VolumesSnapshotTestJSON-708792780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1ad4fe4-bbbd-404f-b72d-e05fe98be27e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d3157ab-0bfc-4bdd-b72b-2f2f3345b35f', 'volume_size': 1, 'snapshot_id': '65b7c4c6-1bae-46db-80b2-89374522f68d'}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:55 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-cc30f850-1ff7-487a-82e4-4e436d509717 tempest-VolumesSnapshotTestJSON-708792780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e673abbc-e38f-476c-b1cd-4f008666b165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:55 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-cc30f850-1ff7-487a-82e4-4e436d509717 tempest-VolumesSnapshotTestJSON-708792780 None] Volume volume-2d3157ab-0bfc-4bdd-b72b-2f2f3345b35f (2d3157ab-0bfc-4bdd-b72b-2f2f3345b35f): created successfully
Feb 27 01:27:55 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-cc30f850-1ff7-487a-82e4-4e436d509717 tempest-VolumesSnapshotTestJSON-708792780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e673abbc-e38f-476c-b1cd-4f008666b165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:55 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-cc30f850-1ff7-487a-82e4-4e436d509717 tempest-VolumesSnapshotTestJSON-708792780 None] Flow 'volume_create_manager' (5377b59e-b80f-4676-8b55-335af6c39c82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:55 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-cc30f850-1ff7-487a-82e4-4e436d509717 tempest-VolumesSnapshotTestJSON-708792780 None] Created volume successfully.
Feb 27 01:27:55 devstack sudo[88903]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-e6ef225c-825d-480f-915f-b8fd78f59a7e tempest-CinderUnicodeTest-34250104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f023cbfe-5379-4436-b30f-ff43f21ffc99" returned: 0 in 0.612s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:55 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-e6ef225c-825d-480f-915f-b8fd78f59a7e tempest-CinderUnicodeTest-34250104 None] Lock "cinder-quobyte-f023cbfe-5379-4436-b30f-ff43f21ffc99" released by "delete_volume" :: held 1.281s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:55 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-7dff66c3-e1c2-456f-b8a3-727ac047c9d8 tempest-VolumesSnapshotTestJSON-708792780 None] Acquiring lock "cinder-2d3157ab-0bfc-4bdd-b72b-2f2f3345b35f-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:55 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-7dff66c3-e1c2-456f-b8a3-727ac047c9d8 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "cinder-2d3157ab-0bfc-4bdd-b72b-2f2f3345b35f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:55 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-7dff66c3-e1c2-456f-b8a3-727ac047c9d8 tempest-VolumesSnapshotTestJSON-708792780 None] Acquiring lock "cinder-quobyte-2d3157ab-0bfc-4bdd-b72b-2f2f3345b35f" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:55 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-e6ef225c-825d-480f-915f-b8fd78f59a7e tempest-CinderUnicodeTest-34250104 None] Created reservations ['43439aaa-88b6-4886-8a61-9b4ce0497c38', '2b59144f-59fc-4d79-b4dc-066b3273f508', '60bc7eac-1870-4141-885d-d2d1167d7dd9', 'df36e186-2125-4806-b103-1ba7b2328672'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:27:55 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-7dff66c3-e1c2-456f-b8a3-727ac047c9d8 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "cinder-quobyte-2d3157ab-0bfc-4bdd-b72b-2f2f3345b35f" acquired by "delete_volume" :: waited 0.024s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:55 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae5b818-bd5c-4122-9842-2c909ae22e08]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7dff66c3-e1c2-456f-b8a3-727ac047c9d8 tempest-VolumesSnapshotTestJSON-708792780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-2d3157ab-0bfc-4bdd-b72b-2f2f3345b35f {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-e6ef225c-825d-480f-915f-b8fd78f59a7e tempest-CinderUnicodeTest-34250104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-e6ef225c-825d-480f-915f-b8fd78f59a7e tempest-CinderUnicodeTest-34250104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:55 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-e6ef225c-825d-480f-915f-b8fd78f59a7e tempest-CinderUnicodeTest-34250104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:55 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-e6ef225c-825d-480f-915f-b8fd78f59a7e tempest-CinderUnicodeTest-34250104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-e6ef225c-825d-480f-915f-b8fd78f59a7e tempest-CinderUnicodeTest-34250104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-e6ef225c-825d-480f-915f-b8fd78f59a7e tempest-CinderUnicodeTest-34250104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:55 devstack sudo[88912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-2d3157ab-0bfc-4bdd-b72b-2f2f3345b35f
Feb 27 01:27:55 devstack sudo[88912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:56 devstack sudo[88913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:27:56 devstack sudo[88913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:56 devstack sudo[88906]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ec15eeb0-4949-4d07-8dea-00ce6a7f4682 tempest-VolumesListAdminTestJSON-1634395798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-14fa7b80-3616-4294-9e83-90d9eb398326 1073741824" returned: 0 in 0.603s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ec15eeb0-4949-4d07-8dea-00ce6a7f4682 tempest-VolumesListAdminTestJSON-1634395798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-14fa7b80-3616-4294-9e83-90d9eb398326 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:56 devstack sudo[88916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-14fa7b80-3616-4294-9e83-90d9eb398326
Feb 27 01:27:56 devstack sudo[88916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:56 devstack sudo[88912]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7dff66c3-e1c2-456f-b8a3-727ac047c9d8 tempest-VolumesSnapshotTestJSON-708792780 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-2d3157ab-0bfc-4bdd-b72b-2f2f3345b35f" returned: 0 in 0.628s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7dff66c3-e1c2-456f-b8a3-727ac047c9d8 tempest-VolumesSnapshotTestJSON-708792780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-2d3157ab-0bfc-4bdd-b72b-2f2f3345b35f {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:56 devstack sudo[88913]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-e6ef225c-825d-480f-915f-b8fd78f59a7e tempest-CinderUnicodeTest-34250104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.568s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:56 devstack sudo[88923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-2d3157ab-0bfc-4bdd-b72b-2f2f3345b35f
Feb 27 01:27:56 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-e6ef225c-825d-480f-915f-b8fd78f59a7e tempest-CinderUnicodeTest-34250104 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:27:56 devstack sudo[88923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:56 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-e6ef225c-825d-480f-915f-b8fd78f59a7e tempest-CinderUnicodeTest-34250104 None] Deleted volume successfully.
Feb 27 01:27:56 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-f7fc25f1-a883-41ca-93ad-0ff6e10dd9db tempest-CinderUnicodeTest-34250104 None] Acquiring lock "cinder-950ebe74-d2b9-4046-9d64-5eb7f9c8ef19-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:56 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-e6ef225c-825d-480f-915f-b8fd78f59a7e tempest-CinderUnicodeTest-34250104 None] Lock "cinder-f023cbfe-5379-4436-b30f-ff43f21ffc99-delete_volume" released by "delete_volume" :: held 2.181s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:56 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-f7fc25f1-a883-41ca-93ad-0ff6e10dd9db tempest-CinderUnicodeTest-34250104 None] Lock "cinder-950ebe74-d2b9-4046-9d64-5eb7f9c8ef19-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:56 devstack sudo[88916]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:56 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-f7fc25f1-a883-41ca-93ad-0ff6e10dd9db tempest-CinderUnicodeTest-34250104 None] Acquiring lock "cinder-quobyte-950ebe74-d2b9-4046-9d64-5eb7f9c8ef19" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ec15eeb0-4949-4d07-8dea-00ce6a7f4682 tempest-VolumesListAdminTestJSON-1634395798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-14fa7b80-3616-4294-9e83-90d9eb398326" returned: 0 in 0.559s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:56 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-ec15eeb0-4949-4d07-8dea-00ce6a7f4682 tempest-VolumesListAdminTestJSON-1634395798 None] <== create_volume: return (1197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:27:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-ec15eeb0-4949-4d07-8dea-00ce6a7f4682 tempest-VolumesListAdminTestJSON-1634395798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.201s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:56 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-f7fc25f1-a883-41ca-93ad-0ff6e10dd9db tempest-CinderUnicodeTest-34250104 None] Lock "cinder-quobyte-950ebe74-d2b9-4046-9d64-5eb7f9c8ef19" acquired by "delete_volume" :: waited 0.012s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:56 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-ec15eeb0-4949-4d07-8dea-00ce6a7f4682 tempest-VolumesListAdminTestJSON-1634395798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e1b593e-faff-4e9a-b1a0-0e2237f2bae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14fa7b80-3616-4294-9e83-90d9eb398326', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:56 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-ec15eeb0-4949-4d07-8dea-00ce6a7f4682 tempest-VolumesListAdminTestJSON-1634395798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (107e50ef-932f-40f8-831b-1abbd0575a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:56 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8ef38c-3024-4741-9b57-9f99eb5c6c20]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-f7fc25f1-a883-41ca-93ad-0ff6e10dd9db tempest-CinderUnicodeTest-34250104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-950ebe74-d2b9-4046-9d64-5eb7f9c8ef19 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:56 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-ec15eeb0-4949-4d07-8dea-00ce6a7f4682 tempest-VolumesListAdminTestJSON-1634395798 None] Volume volume-14fa7b80-3616-4294-9e83-90d9eb398326 (14fa7b80-3616-4294-9e83-90d9eb398326): created successfully
Feb 27 01:27:56 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-ec15eeb0-4949-4d07-8dea-00ce6a7f4682 tempest-VolumesListAdminTestJSON-1634395798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (107e50ef-932f-40f8-831b-1abbd0575a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:56 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-ec15eeb0-4949-4d07-8dea-00ce6a7f4682 tempest-VolumesListAdminTestJSON-1634395798 None] Flow 'volume_create_manager' (b057bf4e-0cc0-46cf-85b0-f940fda5df1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:56 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-ec15eeb0-4949-4d07-8dea-00ce6a7f4682 tempest-VolumesListAdminTestJSON-1634395798 None] Created volume successfully.
Feb 27 01:27:56 devstack sudo[88925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-950ebe74-d2b9-4046-9d64-5eb7f9c8ef19
Feb 27 01:27:56 devstack sudo[88925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:56 devstack cinder-volume[83106]: DEBUG oslo_service.periodic_task [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83106) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Feb 27 01:27:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:56 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:56 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:56 devstack sudo[88927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:27:56 devstack sudo[88927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:57 devstack sudo[88923]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7dff66c3-e1c2-456f-b8a3-727ac047c9d8 tempest-VolumesSnapshotTestJSON-708792780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-2d3157ab-0bfc-4bdd-b72b-2f2f3345b35f" returned: 0 in 0.612s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:57 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-7dff66c3-e1c2-456f-b8a3-727ac047c9d8 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "cinder-quobyte-2d3157ab-0bfc-4bdd-b72b-2f2f3345b35f" released by "delete_volume" :: held 1.270s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:57 devstack cinder-volume[83106]: DEBUG dbcounter [-] [83106] Writing DB stats cinder:UPDATE=250,cinder:DELETE=22,cinder:SELECT=209,cinder:INSERT=66 {{(pid=83106) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 01:27:57 devstack cinder-volume[83106]: DEBUG dbcounter [-] [83106] Writing DB stats cinder:SELECT=183,cinder:UPDATE=235,cinder:INSERT=52,cinder:DELETE=21 {{(pid=83106) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 01:27:57 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-7dff66c3-e1c2-456f-b8a3-727ac047c9d8 tempest-VolumesSnapshotTestJSON-708792780 None] Created reservations ['7df0551e-c1d2-4b8c-a1f1-d9f025a2c58d', 'f9f19161-90ce-4563-9a9b-5353a00ab923', '50e11fcc-d99c-4c24-97ff-30fd49414cc3', '053fc829-11f4-4593-8729-f97cf9e4633d'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:27:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-7dff66c3-e1c2-456f-b8a3-727ac047c9d8 tempest-VolumesSnapshotTestJSON-708792780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-7dff66c3-e1c2-456f-b8a3-727ac047c9d8 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:57 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-7dff66c3-e1c2-456f-b8a3-727ac047c9d8 tempest-VolumesSnapshotTestJSON-708792780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:57 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-7dff66c3-e1c2-456f-b8a3-727ac047c9d8 tempest-VolumesSnapshotTestJSON-708792780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-7dff66c3-e1c2-456f-b8a3-727ac047c9d8 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7dff66c3-e1c2-456f-b8a3-727ac047c9d8 tempest-VolumesSnapshotTestJSON-708792780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:57 devstack sudo[88925]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-f7fc25f1-a883-41ca-93ad-0ff6e10dd9db tempest-CinderUnicodeTest-34250104 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-950ebe74-d2b9-4046-9d64-5eb7f9c8ef19" returned: 0 in 0.594s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-f7fc25f1-a883-41ca-93ad-0ff6e10dd9db tempest-CinderUnicodeTest-34250104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-950ebe74-d2b9-4046-9d64-5eb7f9c8ef19 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:57 devstack sudo[88933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:27:57 devstack sudo[88933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:57 devstack sudo[88934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-950ebe74-d2b9-4046-9d64-5eb7f9c8ef19
Feb 27 01:27:57 devstack sudo[88934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:57 devstack sudo[88927]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.577s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:57 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:27:57 devstack sudo[88934]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-f7fc25f1-a883-41ca-93ad-0ff6e10dd9db tempest-CinderUnicodeTest-34250104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-950ebe74-d2b9-4046-9d64-5eb7f9c8ef19" returned: 0 in 0.531s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:57 devstack sudo[88933]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7dff66c3-e1c2-456f-b8a3-727ac047c9d8 tempest-VolumesSnapshotTestJSON-708792780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.554s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:57 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-7dff66c3-e1c2-456f-b8a3-727ac047c9d8 tempest-VolumesSnapshotTestJSON-708792780 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:27:57 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-f7fc25f1-a883-41ca-93ad-0ff6e10dd9db tempest-CinderUnicodeTest-34250104 None] Lock "cinder-quobyte-950ebe74-d2b9-4046-9d64-5eb7f9c8ef19" released by "delete_volume" :: held 1.184s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:57 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-7dff66c3-e1c2-456f-b8a3-727ac047c9d8 tempest-VolumesSnapshotTestJSON-708792780 None] Deleted volume successfully.
Feb 27 01:27:57 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-7dff66c3-e1c2-456f-b8a3-727ac047c9d8 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "cinder-2d3157ab-0bfc-4bdd-b72b-2f2f3345b35f-delete_volume" released by "delete_volume" :: held 2.109s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:57 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-d32ca283-f83e-493d-90a2-cf0e934a95fe tempest-VolumesListAdminTestJSON-1634395798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:27:57 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d32ca283-f83e-493d-90a2-cf0e934a95fe tempest-VolumesListAdminTestJSON-1634395798 None] Flow 'volume_create_manager' (773c70b5-2e6c-481f-be22-e457730d5281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:57 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d32ca283-f83e-493d-90a2-cf0e934a95fe tempest-VolumesListAdminTestJSON-1634395798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa789ae5-5135-4c55-8035-500bfdb07d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:57 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d32ca283-f83e-493d-90a2-cf0e934a95fe tempest-VolumesListAdminTestJSON-1634395798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa789ae5-5135-4c55-8035-500bfdb07d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1162348306',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50a673ca-af5c-4fec-b144-a80523c1c13c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f09c0bdc5d15465ba16bfd72f3b8d745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:58Z,use_quota=True,user_id='73ee082947f64841a47605c12bd6b3d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:57 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d32ca283-f83e-493d-90a2-cf0e934a95fe tempest-VolumesListAdminTestJSON-1634395798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebafdfd1-3cbe-40a9-a646-d59692c3c718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:57 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d32ca283-f83e-493d-90a2-cf0e934a95fe tempest-VolumesListAdminTestJSON-1634395798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebafdfd1-3cbe-40a9-a646-d59692c3c718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:57 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d32ca283-f83e-493d-90a2-cf0e934a95fe tempest-VolumesListAdminTestJSON-1634395798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3674872f-b904-41eb-8974-043c42d7c973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:57 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d32ca283-f83e-493d-90a2-cf0e934a95fe tempest-VolumesListAdminTestJSON-1634395798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3674872f-b904-41eb-8974-043c42d7c973) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50a673ca-af5c-4fec-b144-a80523c1c13c', 'volume_name': 'volume-50a673ca-af5c-4fec-b144-a80523c1c13c', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:57 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d32ca283-f83e-493d-90a2-cf0e934a95fe tempest-VolumesListAdminTestJSON-1634395798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (262162b6-fcc1-4c07-8db6-f4fc9b6616f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:57 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d32ca283-f83e-493d-90a2-cf0e934a95fe tempest-VolumesListAdminTestJSON-1634395798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (262162b6-fcc1-4c07-8db6-f4fc9b6616f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:57 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d32ca283-f83e-493d-90a2-cf0e934a95fe tempest-VolumesListAdminTestJSON-1634395798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (072b6aaf-a976-4c2e-840b-846121b1b6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:57 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-d32ca283-f83e-493d-90a2-cf0e934a95fe tempest-VolumesListAdminTestJSON-1634395798 None] Volume 50a673ca-af5c-4fec-b144-a80523c1c13c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50a673ca-af5c-4fec-b144-a80523c1c13c', 'volume_size': 1}
Feb 27 01:27:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-d32ca283-f83e-493d-90a2-cf0e934a95fe tempest-VolumesListAdminTestJSON-1634395798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-d32ca283-f83e-493d-90a2-cf0e934a95fe tempest-VolumesListAdminTestJSON-1634395798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:57 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-d32ca283-f83e-493d-90a2-cf0e934a95fe tempest-VolumesListAdminTestJSON-1634395798 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1162348306',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50a673ca-af5c-4fec-b144-a80523c1c13c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f09c0bdc5d15465ba16bfd72f3b8d745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:27:58Z,use_quota=True,user_id='73ee082947f64841a47605c12bd6b3d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:27:57 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-d32ca283-f83e-493d-90a2-cf0e934a95fe tempest-VolumesListAdminTestJSON-1634395798 None] Creating volume 50a673ca-af5c-4fec-b144-a80523c1c13c {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:27:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-d32ca283-f83e-493d-90a2-cf0e934a95fe tempest-VolumesListAdminTestJSON-1634395798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-d32ca283-f83e-493d-90a2-cf0e934a95fe tempest-VolumesListAdminTestJSON-1634395798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:57 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-d32ca283-f83e-493d-90a2-cf0e934a95fe tempest-VolumesListAdminTestJSON-1634395798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:57 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-d32ca283-f83e-493d-90a2-cf0e934a95fe tempest-VolumesListAdminTestJSON-1634395798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-d32ca283-f83e-493d-90a2-cf0e934a95fe tempest-VolumesListAdminTestJSON-1634395798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:57 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-d32ca283-f83e-493d-90a2-cf0e934a95fe tempest-VolumesListAdminTestJSON-1634395798 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:27:57 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-d32ca283-f83e-493d-90a2-cf0e934a95fe tempest-VolumesListAdminTestJSON-1634395798 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:27:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d32ca283-f83e-493d-90a2-cf0e934a95fe tempest-VolumesListAdminTestJSON-1634395798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-50a673ca-af5c-4fec-b144-a80523c1c13c 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:58 devstack sudo[88940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-50a673ca-af5c-4fec-b144-a80523c1c13c 1073741824
Feb 27 01:27:58 devstack sudo[88940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:58 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-2fcf2190-5161-40e5-9c8a-7c056d57f6a7 tempest-VolumesSnapshotTestJSON-708792780 None] Acquiring lock "cinder-65b7c4c6-1bae-46db-80b2-89374522f68d-delete_snapshot" by "delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:58 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-f7fc25f1-a883-41ca-93ad-0ff6e10dd9db tempest-CinderUnicodeTest-34250104 None] Created reservations ['9501f3ee-5134-43bd-bbd0-2d5486cee41b', '1f12bbae-437c-47f4-9783-eed1d63768a2', '4dbe76cb-349b-4a1d-9717-3b4740c29064', '5cfe9bda-c3cb-4173-927d-33c41a5aec6d'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:27:58 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-2fcf2190-5161-40e5-9c8a-7c056d57f6a7 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "cinder-65b7c4c6-1bae-46db-80b2-89374522f68d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:58 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-2fcf2190-5161-40e5-9c8a-7c056d57f6a7 tempest-VolumesSnapshotTestJSON-708792780 None] Acquiring lock "cinder-quobyte-8a3ca527-905e-4193-9b56-3fff1c0a77c3" by "delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:58 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-2fcf2190-5161-40e5-9c8a-7c056d57f6a7 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "cinder-quobyte-8a3ca527-905e-4193-9b56-3fff1c0a77c3" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:58 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-2fcf2190-5161-40e5-9c8a-7c056d57f6a7 tempest-VolumesSnapshotTestJSON-708792780 None] Acquiring lock "cinder-quobyte-65b7c4c6-1bae-46db-80b2-89374522f68d" by "_delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:27:58 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-2fcf2190-5161-40e5-9c8a-7c056d57f6a7 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "cinder-quobyte-65b7c4c6-1bae-46db-80b2-89374522f68d" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:27:58 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-2fcf2190-5161-40e5-9c8a-7c056d57f6a7 tempest-VolumesSnapshotTestJSON-708792780 None] Deleting offline snapshot 65b7c4c6-1bae-46db-80b2-89374522f68d of volume 8a3ca527-905e-4193-9b56-3fff1c0a77c3 {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:27:58 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-2fcf2190-5161-40e5-9c8a-7c056d57f6a7 tempest-VolumesSnapshotTestJSON-708792780 None] snapshot_file for this snap is: volume-8a3ca527-905e-4193-9b56-3fff1c0a77c3.65b7c4c6-1bae-46db-80b2-89374522f68d {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:27:58 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[685b84a4-b029-4c7f-aa02-c4f110970ab1]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:58 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-2fcf2190-5161-40e5-9c8a-7c056d57f6a7 tempest-VolumesSnapshotTestJSON-708792780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8a3ca527-905e-4193-9b56-3fff1c0a77c3.65b7c4c6-1bae-46db-80b2-89374522f68d {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:58 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-f7fc25f1-a883-41ca-93ad-0ff6e10dd9db tempest-CinderUnicodeTest-34250104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:27:58 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-f7fc25f1-a883-41ca-93ad-0ff6e10dd9db tempest-CinderUnicodeTest-34250104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:27:58 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-f7fc25f1-a883-41ca-93ad-0ff6e10dd9db tempest-CinderUnicodeTest-34250104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:27:58 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-f7fc25f1-a883-41ca-93ad-0ff6e10dd9db tempest-CinderUnicodeTest-34250104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:27:58 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-f7fc25f1-a883-41ca-93ad-0ff6e10dd9db tempest-CinderUnicodeTest-34250104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:58 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-f7fc25f1-a883-41ca-93ad-0ff6e10dd9db tempest-CinderUnicodeTest-34250104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:58 devstack sudo[88943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:27:58 devstack sudo[88943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:58 devstack sudo[88942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8a3ca527-905e-4193-9b56-3fff1c0a77c3.65b7c4c6-1bae-46db-80b2-89374522f68d
Feb 27 01:27:58 devstack sudo[88942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:58 devstack sudo[88940]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:58 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d32ca283-f83e-493d-90a2-cf0e934a95fe tempest-VolumesListAdminTestJSON-1634395798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-50a673ca-af5c-4fec-b144-a80523c1c13c 1073741824" returned: 0 in 0.688s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:58 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d32ca283-f83e-493d-90a2-cf0e934a95fe tempest-VolumesListAdminTestJSON-1634395798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-50a673ca-af5c-4fec-b144-a80523c1c13c {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:58 devstack sudo[88955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-50a673ca-af5c-4fec-b144-a80523c1c13c
Feb 27 01:27:58 devstack sudo[88955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:58 devstack sudo[88942]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:58 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-2fcf2190-5161-40e5-9c8a-7c056d57f6a7 tempest-VolumesSnapshotTestJSON-708792780 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8a3ca527-905e-4193-9b56-3fff1c0a77c3.65b7c4c6-1bae-46db-80b2-89374522f68d" returned: 0 in 0.664s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:58 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-2fcf2190-5161-40e5-9c8a-7c056d57f6a7 tempest-VolumesSnapshotTestJSON-708792780 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a3ca527-905e-4193-9b56-3fff1c0a77c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83106) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:27:58 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe76b6bd-6e95-475e-8ac7-3ae392220249]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:27:58 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-2fcf2190-5161-40e5-9c8a-7c056d57f6a7 tempest-VolumesSnapshotTestJSON-708792780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8a3ca527-905e-4193-9b56-3fff1c0a77c3 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:58 devstack sudo[88943]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:58 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-f7fc25f1-a883-41ca-93ad-0ff6e10dd9db tempest-CinderUnicodeTest-34250104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.728s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:58 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-f7fc25f1-a883-41ca-93ad-0ff6e10dd9db tempest-CinderUnicodeTest-34250104 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:27:58 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-f7fc25f1-a883-41ca-93ad-0ff6e10dd9db tempest-CinderUnicodeTest-34250104 None] Deleted volume successfully.
Feb 27 01:27:58 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-f7fc25f1-a883-41ca-93ad-0ff6e10dd9db tempest-CinderUnicodeTest-34250104 None] Lock "cinder-950ebe74-d2b9-4046-9d64-5eb7f9c8ef19-delete_volume" released by "delete_volume" :: held 2.336s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:27:58 devstack sudo[88957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8a3ca527-905e-4193-9b56-3fff1c0a77c3
Feb 27 01:27:58 devstack sudo[88957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:27:59 devstack sudo[88955]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:59 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d32ca283-f83e-493d-90a2-cf0e934a95fe tempest-VolumesListAdminTestJSON-1634395798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-50a673ca-af5c-4fec-b144-a80523c1c13c" returned: 0 in 0.646s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:59 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-d32ca283-f83e-493d-90a2-cf0e934a95fe tempest-VolumesListAdminTestJSON-1634395798 None] <== create_volume: return (1379ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:27:59 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-d32ca283-f83e-493d-90a2-cf0e934a95fe tempest-VolumesListAdminTestJSON-1634395798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.387s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:27:59 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d32ca283-f83e-493d-90a2-cf0e934a95fe tempest-VolumesListAdminTestJSON-1634395798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (072b6aaf-a976-4c2e-840b-846121b1b6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50a673ca-af5c-4fec-b144-a80523c1c13c', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:59 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d32ca283-f83e-493d-90a2-cf0e934a95fe tempest-VolumesListAdminTestJSON-1634395798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fb613b8-1e83-41d4-b546-edef191da1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:27:59 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-d32ca283-f83e-493d-90a2-cf0e934a95fe tempest-VolumesListAdminTestJSON-1634395798 None] Volume volume-50a673ca-af5c-4fec-b144-a80523c1c13c (50a673ca-af5c-4fec-b144-a80523c1c13c): created successfully
Feb 27 01:27:59 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d32ca283-f83e-493d-90a2-cf0e934a95fe tempest-VolumesListAdminTestJSON-1634395798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fb613b8-1e83-41d4-b546-edef191da1a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:27:59 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d32ca283-f83e-493d-90a2-cf0e934a95fe tempest-VolumesListAdminTestJSON-1634395798 None] Flow 'volume_create_manager' (773c70b5-2e6c-481f-be22-e457730d5281) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:27:59 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-d32ca283-f83e-493d-90a2-cf0e934a95fe tempest-VolumesListAdminTestJSON-1634395798 None] Created volume successfully.
Feb 27 01:27:59 devstack sudo[88957]: pam_unix(sudo:session): session closed for user root
Feb 27 01:27:59 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-2fcf2190-5161-40e5-9c8a-7c056d57f6a7 tempest-VolumesSnapshotTestJSON-708792780 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8a3ca527-905e-4193-9b56-3fff1c0a77c3" returned: 0 in 0.696s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:27:59 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-2fcf2190-5161-40e5-9c8a-7c056d57f6a7 tempest-VolumesSnapshotTestJSON-708792780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8a3ca527-905e-4193-9b56-3fff1c0a77c3.65b7c4c6-1bae-46db-80b2-89374522f68d {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:27:59 devstack sudo[88963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8a3ca527-905e-4193-9b56-3fff1c0a77c3.65b7c4c6-1bae-46db-80b2-89374522f68d
Feb 27 01:27:59 devstack sudo[88963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:00 devstack sudo[88963]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:00 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-2fcf2190-5161-40e5-9c8a-7c056d57f6a7 tempest-VolumesSnapshotTestJSON-708792780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8a3ca527-905e-4193-9b56-3fff1c0a77c3.65b7c4c6-1bae-46db-80b2-89374522f68d" returned: 0 in 0.688s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:00 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-2fcf2190-5161-40e5-9c8a-7c056d57f6a7 tempest-VolumesSnapshotTestJSON-708792780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8a3ca527-905e-4193-9b56-3fff1c0a77c3.65b7c4c6-1bae-46db-80b2-89374522f68d {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:00 devstack sudo[88968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8a3ca527-905e-4193-9b56-3fff1c0a77c3.65b7c4c6-1bae-46db-80b2-89374522f68d
Feb 27 01:28:00 devstack sudo[88968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:00 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-1366cf79-4be0-4fd0-9063-e62e22bfbc71 tempest-VolumesListAdminTestJSON-1634395798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:28:00 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1366cf79-4be0-4fd0-9063-e62e22bfbc71 tempest-VolumesListAdminTestJSON-1634395798 None] Flow 'volume_create_manager' (13eeb387-60db-4adf-996d-5fdcf5a4dbc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:28:00 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1366cf79-4be0-4fd0-9063-e62e22bfbc71 tempest-VolumesListAdminTestJSON-1634395798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c74f489-6f3b-4e27-8df6-3e85320cc05b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:00 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1366cf79-4be0-4fd0-9063-e62e22bfbc71 tempest-VolumesListAdminTestJSON-1634395798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c74f489-6f3b-4e27-8df6-3e85320cc05b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-765105559',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1b979cd-7543-4a0c-b320-0dad96c76a2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f09c0bdc5d15465ba16bfd72f3b8d745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:28:00Z,use_quota=True,user_id='73ee082947f64841a47605c12bd6b3d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:00 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1366cf79-4be0-4fd0-9063-e62e22bfbc71 tempest-VolumesListAdminTestJSON-1634395798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc054c99-7e2c-42f2-974d-f76b75f04646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:00 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1366cf79-4be0-4fd0-9063-e62e22bfbc71 tempest-VolumesListAdminTestJSON-1634395798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc054c99-7e2c-42f2-974d-f76b75f04646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:00 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1366cf79-4be0-4fd0-9063-e62e22bfbc71 tempest-VolumesListAdminTestJSON-1634395798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a45cbbf-b3ac-4d70-9c33-2863dd844d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:00 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1366cf79-4be0-4fd0-9063-e62e22bfbc71 tempest-VolumesListAdminTestJSON-1634395798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a45cbbf-b3ac-4d70-9c33-2863dd844d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1b979cd-7543-4a0c-b320-0dad96c76a2c', 'volume_name': 'volume-c1b979cd-7543-4a0c-b320-0dad96c76a2c', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:00 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1366cf79-4be0-4fd0-9063-e62e22bfbc71 tempest-VolumesListAdminTestJSON-1634395798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac9dc720-10b9-4639-b120-98a56abf590d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:00 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1366cf79-4be0-4fd0-9063-e62e22bfbc71 tempest-VolumesListAdminTestJSON-1634395798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac9dc720-10b9-4639-b120-98a56abf590d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:00 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1366cf79-4be0-4fd0-9063-e62e22bfbc71 tempest-VolumesListAdminTestJSON-1634395798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdc16cd9-72a7-4dbb-8095-0f40cd978553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:00 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-1366cf79-4be0-4fd0-9063-e62e22bfbc71 tempest-VolumesListAdminTestJSON-1634395798 None] Volume c1b979cd-7543-4a0c-b320-0dad96c76a2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1b979cd-7543-4a0c-b320-0dad96c76a2c', 'volume_size': 1}
Feb 27 01:28:00 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-1366cf79-4be0-4fd0-9063-e62e22bfbc71 tempest-VolumesListAdminTestJSON-1634395798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:28:00 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-1366cf79-4be0-4fd0-9063-e62e22bfbc71 tempest-VolumesListAdminTestJSON-1634395798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:28:00 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-1366cf79-4be0-4fd0-9063-e62e22bfbc71 tempest-VolumesListAdminTestJSON-1634395798 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-765105559',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1b979cd-7543-4a0c-b320-0dad96c76a2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f09c0bdc5d15465ba16bfd72f3b8d745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:28:00Z,use_quota=True,user_id='73ee082947f64841a47605c12bd6b3d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:28:00 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-1366cf79-4be0-4fd0-9063-e62e22bfbc71 tempest-VolumesListAdminTestJSON-1634395798 None] Creating volume c1b979cd-7543-4a0c-b320-0dad96c76a2c {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:28:00 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-1366cf79-4be0-4fd0-9063-e62e22bfbc71 tempest-VolumesListAdminTestJSON-1634395798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:28:00 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-1366cf79-4be0-4fd0-9063-e62e22bfbc71 tempest-VolumesListAdminTestJSON-1634395798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:28:00 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-1366cf79-4be0-4fd0-9063-e62e22bfbc71 tempest-VolumesListAdminTestJSON-1634395798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:28:00 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-1366cf79-4be0-4fd0-9063-e62e22bfbc71 tempest-VolumesListAdminTestJSON-1634395798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:28:00 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-1366cf79-4be0-4fd0-9063-e62e22bfbc71 tempest-VolumesListAdminTestJSON-1634395798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:28:00 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-1366cf79-4be0-4fd0-9063-e62e22bfbc71 tempest-VolumesListAdminTestJSON-1634395798 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:28:00 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-1366cf79-4be0-4fd0-9063-e62e22bfbc71 tempest-VolumesListAdminTestJSON-1634395798 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:28:00 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-1366cf79-4be0-4fd0-9063-e62e22bfbc71 tempest-VolumesListAdminTestJSON-1634395798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c1b979cd-7543-4a0c-b320-0dad96c76a2c 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:00 devstack sudo[88989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c1b979cd-7543-4a0c-b320-0dad96c76a2c 1073741824
Feb 27 01:28:00 devstack sudo[88989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:00 devstack sudo[88968]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:00 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-2fcf2190-5161-40e5-9c8a-7c056d57f6a7 tempest-VolumesSnapshotTestJSON-708792780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8a3ca527-905e-4193-9b56-3fff1c0a77c3.65b7c4c6-1bae-46db-80b2-89374522f68d" returned: 0 in 0.582s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:00 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-2fcf2190-5161-40e5-9c8a-7c056d57f6a7 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "cinder-quobyte-65b7c4c6-1bae-46db-80b2-89374522f68d" released by "_delete_snapshot" :: held 2.762s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:28:00 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-2fcf2190-5161-40e5-9c8a-7c056d57f6a7 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "cinder-quobyte-8a3ca527-905e-4193-9b56-3fff1c0a77c3" released by "delete_snapshot" :: held 2.805s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:28:00 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-2fcf2190-5161-40e5-9c8a-7c056d57f6a7 tempest-VolumesSnapshotTestJSON-708792780 None] Created reservations ['acbbbc87-ce72-40d4-889f-2a44d1f88e58', 'e141dc28-e414-4b6b-bde1-d2b9b504261a', 'e60fdccf-746b-43da-b55c-058c806d90e0', '656b9b86-2f72-475c-8a91-a11fc5f6888b'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:28:00 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-2fcf2190-5161-40e5-9c8a-7c056d57f6a7 tempest-VolumesSnapshotTestJSON-708792780 None] Delete snapshot completed successfully.
Feb 27 01:28:00 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-2fcf2190-5161-40e5-9c8a-7c056d57f6a7 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "cinder-65b7c4c6-1bae-46db-80b2-89374522f68d-delete_snapshot" released by "delete_snapshot" :: held 2.930s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:28:01 devstack sudo[88989]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:01 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-1366cf79-4be0-4fd0-9063-e62e22bfbc71 tempest-VolumesListAdminTestJSON-1634395798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c1b979cd-7543-4a0c-b320-0dad96c76a2c 1073741824" returned: 0 in 0.707s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:01 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-96515ebc-7b83-452a-97aa-5e96db88ded5 tempest-VolumesSnapshotTestJSON-708792780 None] Acquiring lock "cinder-8a3ca527-905e-4193-9b56-3fff1c0a77c3-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:28:01 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-96515ebc-7b83-452a-97aa-5e96db88ded5 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "cinder-8a3ca527-905e-4193-9b56-3fff1c0a77c3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:28:01 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-1366cf79-4be0-4fd0-9063-e62e22bfbc71 tempest-VolumesListAdminTestJSON-1634395798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c1b979cd-7543-4a0c-b320-0dad96c76a2c {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:01 devstack sudo[89017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c1b979cd-7543-4a0c-b320-0dad96c76a2c
Feb 27 01:28:01 devstack sudo[89017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:01 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-96515ebc-7b83-452a-97aa-5e96db88ded5 tempest-VolumesSnapshotTestJSON-708792780 None] Acquiring lock "cinder-quobyte-8a3ca527-905e-4193-9b56-3fff1c0a77c3" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:28:01 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-96515ebc-7b83-452a-97aa-5e96db88ded5 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "cinder-quobyte-8a3ca527-905e-4193-9b56-3fff1c0a77c3" acquired by "delete_volume" :: waited 0.010s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:28:01 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a2faf6-d4c9-41c1-8778-a6fe214f504b]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:28:01 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-96515ebc-7b83-452a-97aa-5e96db88ded5 tempest-VolumesSnapshotTestJSON-708792780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8a3ca527-905e-4193-9b56-3fff1c0a77c3 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:01 devstack sudo[89019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8a3ca527-905e-4193-9b56-3fff1c0a77c3
Feb 27 01:28:01 devstack sudo[89019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:01 devstack sudo[89017]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:01 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-1366cf79-4be0-4fd0-9063-e62e22bfbc71 tempest-VolumesListAdminTestJSON-1634395798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c1b979cd-7543-4a0c-b320-0dad96c76a2c" returned: 0 in 0.545s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:01 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-1366cf79-4be0-4fd0-9063-e62e22bfbc71 tempest-VolumesListAdminTestJSON-1634395798 None] <== create_volume: return (1306ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:28:01 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-1366cf79-4be0-4fd0-9063-e62e22bfbc71 tempest-VolumesListAdminTestJSON-1634395798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.309s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:28:01 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1366cf79-4be0-4fd0-9063-e62e22bfbc71 tempest-VolumesListAdminTestJSON-1634395798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdc16cd9-72a7-4dbb-8095-0f40cd978553) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1b979cd-7543-4a0c-b320-0dad96c76a2c', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:01 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1366cf79-4be0-4fd0-9063-e62e22bfbc71 tempest-VolumesListAdminTestJSON-1634395798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d37c7d2-b35e-4c17-a4d3-908bbb94db32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:01 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-1366cf79-4be0-4fd0-9063-e62e22bfbc71 tempest-VolumesListAdminTestJSON-1634395798 None] Volume volume-c1b979cd-7543-4a0c-b320-0dad96c76a2c (c1b979cd-7543-4a0c-b320-0dad96c76a2c): created successfully
Feb 27 01:28:01 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1366cf79-4be0-4fd0-9063-e62e22bfbc71 tempest-VolumesListAdminTestJSON-1634395798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d37c7d2-b35e-4c17-a4d3-908bbb94db32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:01 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1366cf79-4be0-4fd0-9063-e62e22bfbc71 tempest-VolumesListAdminTestJSON-1634395798 None] Flow 'volume_create_manager' (13eeb387-60db-4adf-996d-5fdcf5a4dbc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:28:01 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-1366cf79-4be0-4fd0-9063-e62e22bfbc71 tempest-VolumesListAdminTestJSON-1634395798 None] Created volume successfully.
Feb 27 01:28:02 devstack sudo[89019]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:02 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-96515ebc-7b83-452a-97aa-5e96db88ded5 tempest-VolumesSnapshotTestJSON-708792780 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8a3ca527-905e-4193-9b56-3fff1c0a77c3" returned: 0 in 0.652s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:02 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-96515ebc-7b83-452a-97aa-5e96db88ded5 tempest-VolumesSnapshotTestJSON-708792780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8a3ca527-905e-4193-9b56-3fff1c0a77c3 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:02 devstack sudo[89025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8a3ca527-905e-4193-9b56-3fff1c0a77c3
Feb 27 01:28:02 devstack sudo[89025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:02 devstack sudo[89025]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:02 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-96515ebc-7b83-452a-97aa-5e96db88ded5 tempest-VolumesSnapshotTestJSON-708792780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8a3ca527-905e-4193-9b56-3fff1c0a77c3" returned: 0 in 0.550s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:02 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-96515ebc-7b83-452a-97aa-5e96db88ded5 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "cinder-quobyte-8a3ca527-905e-4193-9b56-3fff1c0a77c3" released by "delete_volume" :: held 1.254s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:28:02 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-96515ebc-7b83-452a-97aa-5e96db88ded5 tempest-VolumesSnapshotTestJSON-708792780 None] Created reservations ['63986646-7266-4db2-b9b4-7d0ebb25303f', 'f48a437f-ab95-4d8b-8384-71fd293a2bbf', 'bf8fae00-8c46-4179-8a7d-1a0290cb5071', 'd9c42d95-e356-4dfe-ad4f-86539796c2ef'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:28:02 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-96515ebc-7b83-452a-97aa-5e96db88ded5 tempest-VolumesSnapshotTestJSON-708792780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:28:02 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-96515ebc-7b83-452a-97aa-5e96db88ded5 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:28:02 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-96515ebc-7b83-452a-97aa-5e96db88ded5 tempest-VolumesSnapshotTestJSON-708792780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:28:02 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-96515ebc-7b83-452a-97aa-5e96db88ded5 tempest-VolumesSnapshotTestJSON-708792780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:28:02 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-96515ebc-7b83-452a-97aa-5e96db88ded5 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:28:02 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-96515ebc-7b83-452a-97aa-5e96db88ded5 tempest-VolumesSnapshotTestJSON-708792780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:02 devstack sudo[89028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:28:02 devstack sudo[89028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:03 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a91fa38-5d9a-4f51-9b87-fa161485d1c1 tempest-VolumesListAdminTestJSON-1117250246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:28:03 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7a91fa38-5d9a-4f51-9b87-fa161485d1c1 tempest-VolumesListAdminTestJSON-1117250246 None] Flow 'volume_create_manager' (3775ccfb-9a87-4e92-9907-4f1f0f0c6003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:28:03 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7a91fa38-5d9a-4f51-9b87-fa161485d1c1 tempest-VolumesListAdminTestJSON-1117250246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdae371c-fda0-401b-be09-7397dfad207f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:03 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7a91fa38-5d9a-4f51-9b87-fa161485d1c1 tempest-VolumesListAdminTestJSON-1117250246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdae371c-fda0-401b-be09-7397dfad207f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e12cea7c-49e1-45d4-b7f5-791d45e86ea8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f4b5118cf3c42a19c91ab42abb05a25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:28:03Z,use_quota=True,user_id='b84ab2c93b984c78b2d305b22c38f6dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:03 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7a91fa38-5d9a-4f51-9b87-fa161485d1c1 tempest-VolumesListAdminTestJSON-1117250246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d97f9259-c077-47f7-a23c-048b47b4c366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:03 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7a91fa38-5d9a-4f51-9b87-fa161485d1c1 tempest-VolumesListAdminTestJSON-1117250246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d97f9259-c077-47f7-a23c-048b47b4c366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:03 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7a91fa38-5d9a-4f51-9b87-fa161485d1c1 tempest-VolumesListAdminTestJSON-1117250246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a65ab72e-4a62-4378-830e-9147757d9d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:03 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7a91fa38-5d9a-4f51-9b87-fa161485d1c1 tempest-VolumesListAdminTestJSON-1117250246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a65ab72e-4a62-4378-830e-9147757d9d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e12cea7c-49e1-45d4-b7f5-791d45e86ea8', 'volume_name': 'volume-e12cea7c-49e1-45d4-b7f5-791d45e86ea8', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:03 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7a91fa38-5d9a-4f51-9b87-fa161485d1c1 tempest-VolumesListAdminTestJSON-1117250246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf17c1f5-f376-4fc9-b7a7-4b670c049ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:03 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7a91fa38-5d9a-4f51-9b87-fa161485d1c1 tempest-VolumesListAdminTestJSON-1117250246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf17c1f5-f376-4fc9-b7a7-4b670c049ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:03 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7a91fa38-5d9a-4f51-9b87-fa161485d1c1 tempest-VolumesListAdminTestJSON-1117250246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6fa2c96-61f0-48d2-a6c6-09db85a2a233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:03 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-7a91fa38-5d9a-4f51-9b87-fa161485d1c1 tempest-VolumesListAdminTestJSON-1117250246 None] Volume e12cea7c-49e1-45d4-b7f5-791d45e86ea8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e12cea7c-49e1-45d4-b7f5-791d45e86ea8', 'volume_size': 1}
Feb 27 01:28:03 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-7a91fa38-5d9a-4f51-9b87-fa161485d1c1 tempest-VolumesListAdminTestJSON-1117250246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:28:03 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-7a91fa38-5d9a-4f51-9b87-fa161485d1c1 tempest-VolumesListAdminTestJSON-1117250246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:28:03 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-7a91fa38-5d9a-4f51-9b87-fa161485d1c1 tempest-VolumesListAdminTestJSON-1117250246 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e12cea7c-49e1-45d4-b7f5-791d45e86ea8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f4b5118cf3c42a19c91ab42abb05a25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:28:03Z,use_quota=True,user_id='b84ab2c93b984c78b2d305b22c38f6dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:28:03 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-7a91fa38-5d9a-4f51-9b87-fa161485d1c1 tempest-VolumesListAdminTestJSON-1117250246 None] Creating volume e12cea7c-49e1-45d4-b7f5-791d45e86ea8 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:28:03 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-7a91fa38-5d9a-4f51-9b87-fa161485d1c1 tempest-VolumesListAdminTestJSON-1117250246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:28:03 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-7a91fa38-5d9a-4f51-9b87-fa161485d1c1 tempest-VolumesListAdminTestJSON-1117250246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:28:03 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-7a91fa38-5d9a-4f51-9b87-fa161485d1c1 tempest-VolumesListAdminTestJSON-1117250246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:28:03 devstack sudo[89028]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:03 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-7a91fa38-5d9a-4f51-9b87-fa161485d1c1 tempest-VolumesListAdminTestJSON-1117250246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:28:03 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-7a91fa38-5d9a-4f51-9b87-fa161485d1c1 tempest-VolumesListAdminTestJSON-1117250246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:28:03 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-7a91fa38-5d9a-4f51-9b87-fa161485d1c1 tempest-VolumesListAdminTestJSON-1117250246 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:28:03 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-7a91fa38-5d9a-4f51-9b87-fa161485d1c1 tempest-VolumesListAdminTestJSON-1117250246 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:28:03 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7a91fa38-5d9a-4f51-9b87-fa161485d1c1 tempest-VolumesListAdminTestJSON-1117250246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e12cea7c-49e1-45d4-b7f5-791d45e86ea8 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:03 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-96515ebc-7b83-452a-97aa-5e96db88ded5 tempest-VolumesSnapshotTestJSON-708792780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.591s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:03 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-96515ebc-7b83-452a-97aa-5e96db88ded5 tempest-VolumesSnapshotTestJSON-708792780 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:28:03 devstack sudo[89032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e12cea7c-49e1-45d4-b7f5-791d45e86ea8 1073741824
Feb 27 01:28:03 devstack sudo[89032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:03 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-96515ebc-7b83-452a-97aa-5e96db88ded5 tempest-VolumesSnapshotTestJSON-708792780 None] Deleted volume successfully.
Feb 27 01:28:03 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-96515ebc-7b83-452a-97aa-5e96db88ded5 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "cinder-8a3ca527-905e-4193-9b56-3fff1c0a77c3-delete_volume" released by "delete_volume" :: held 2.051s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:28:03 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-132e68b0-d8aa-40e9-b4ed-362f25f5a878 tempest-VolumesSnapshotTestJSON-708792780 None] Acquiring lock "cinder-8077be60-e7c3-434b-876e-93ce60b85df5-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:28:03 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-132e68b0-d8aa-40e9-b4ed-362f25f5a878 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "cinder-8077be60-e7c3-434b-876e-93ce60b85df5-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:28:03 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-132e68b0-d8aa-40e9-b4ed-362f25f5a878 tempest-VolumesSnapshotTestJSON-708792780 None] Acquiring lock "cinder-quobyte-8077be60-e7c3-434b-876e-93ce60b85df5" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:28:03 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-132e68b0-d8aa-40e9-b4ed-362f25f5a878 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "cinder-quobyte-8077be60-e7c3-434b-876e-93ce60b85df5" acquired by "delete_volume" :: waited 0.029s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:28:03 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[347ffa35-1c69-4f7c-b626-1f13d4a909dc]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:28:03 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-132e68b0-d8aa-40e9-b4ed-362f25f5a878 tempest-VolumesSnapshotTestJSON-708792780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8077be60-e7c3-434b-876e-93ce60b85df5 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:03 devstack sudo[89034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8077be60-e7c3-434b-876e-93ce60b85df5
Feb 27 01:28:03 devstack sudo[89034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:04 devstack sudo[89032]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:04 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7a91fa38-5d9a-4f51-9b87-fa161485d1c1 tempest-VolumesListAdminTestJSON-1117250246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e12cea7c-49e1-45d4-b7f5-791d45e86ea8 1073741824" returned: 0 in 0.877s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:04 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7a91fa38-5d9a-4f51-9b87-fa161485d1c1 tempest-VolumesListAdminTestJSON-1117250246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e12cea7c-49e1-45d4-b7f5-791d45e86ea8 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:04 devstack sudo[89039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e12cea7c-49e1-45d4-b7f5-791d45e86ea8
Feb 27 01:28:04 devstack sudo[89039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:04 devstack sudo[89034]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:04 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-132e68b0-d8aa-40e9-b4ed-362f25f5a878 tempest-VolumesSnapshotTestJSON-708792780 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8077be60-e7c3-434b-876e-93ce60b85df5" returned: 0 in 0.754s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:04 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-132e68b0-d8aa-40e9-b4ed-362f25f5a878 tempest-VolumesSnapshotTestJSON-708792780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8077be60-e7c3-434b-876e-93ce60b85df5 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:04 devstack sudo[89044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8077be60-e7c3-434b-876e-93ce60b85df5
Feb 27 01:28:04 devstack sudo[89044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:04 devstack sudo[89039]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:04 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7a91fa38-5d9a-4f51-9b87-fa161485d1c1 tempest-VolumesListAdminTestJSON-1117250246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e12cea7c-49e1-45d4-b7f5-791d45e86ea8" returned: 0 in 0.620s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:04 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-7a91fa38-5d9a-4f51-9b87-fa161485d1c1 tempest-VolumesListAdminTestJSON-1117250246 None] <== create_volume: return (1543ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:28:04 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-7a91fa38-5d9a-4f51-9b87-fa161485d1c1 tempest-VolumesListAdminTestJSON-1117250246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.545s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:28:04 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7a91fa38-5d9a-4f51-9b87-fa161485d1c1 tempest-VolumesListAdminTestJSON-1117250246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6fa2c96-61f0-48d2-a6c6-09db85a2a233) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e12cea7c-49e1-45d4-b7f5-791d45e86ea8', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:04 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7a91fa38-5d9a-4f51-9b87-fa161485d1c1 tempest-VolumesListAdminTestJSON-1117250246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb72a1ca-f56d-42ca-8c08-e5d9cb0d3721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:04 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-7a91fa38-5d9a-4f51-9b87-fa161485d1c1 tempest-VolumesListAdminTestJSON-1117250246 None] Volume volume-e12cea7c-49e1-45d4-b7f5-791d45e86ea8 (e12cea7c-49e1-45d4-b7f5-791d45e86ea8): created successfully
Feb 27 01:28:04 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7a91fa38-5d9a-4f51-9b87-fa161485d1c1 tempest-VolumesListAdminTestJSON-1117250246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb72a1ca-f56d-42ca-8c08-e5d9cb0d3721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:04 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7a91fa38-5d9a-4f51-9b87-fa161485d1c1 tempest-VolumesListAdminTestJSON-1117250246 None] Flow 'volume_create_manager' (3775ccfb-9a87-4e92-9907-4f1f0f0c6003) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:28:04 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-7a91fa38-5d9a-4f51-9b87-fa161485d1c1 tempest-VolumesListAdminTestJSON-1117250246 None] Created volume successfully.
Feb 27 01:28:05 devstack sudo[89044]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:05 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-132e68b0-d8aa-40e9-b4ed-362f25f5a878 tempest-VolumesSnapshotTestJSON-708792780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8077be60-e7c3-434b-876e-93ce60b85df5" returned: 0 in 0.553s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:05 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-132e68b0-d8aa-40e9-b4ed-362f25f5a878 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "cinder-quobyte-8077be60-e7c3-434b-876e-93ce60b85df5" released by "delete_volume" :: held 1.353s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:28:05 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-132e68b0-d8aa-40e9-b4ed-362f25f5a878 tempest-VolumesSnapshotTestJSON-708792780 None] Created reservations ['649177a1-7e3e-473b-948d-42c64ea9714c', '5c25ad33-7417-41e3-9f8c-95d9392bcd07', 'dc845802-1f2a-450c-b447-06579b853016', '9fd348e2-16d0-4684-905a-f50d99a4397e'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:28:05 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-132e68b0-d8aa-40e9-b4ed-362f25f5a878 tempest-VolumesSnapshotTestJSON-708792780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:28:05 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-132e68b0-d8aa-40e9-b4ed-362f25f5a878 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:28:05 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-132e68b0-d8aa-40e9-b4ed-362f25f5a878 tempest-VolumesSnapshotTestJSON-708792780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:28:05 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-132e68b0-d8aa-40e9-b4ed-362f25f5a878 tempest-VolumesSnapshotTestJSON-708792780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:28:05 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-132e68b0-d8aa-40e9-b4ed-362f25f5a878 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:28:05 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-132e68b0-d8aa-40e9-b4ed-362f25f5a878 tempest-VolumesSnapshotTestJSON-708792780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:05 devstack sudo[89055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:28:05 devstack sudo[89055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:05 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-89d40dd3-da84-46d1-a323-7b1c1ef5f663 tempest-VolumesListAdminTestJSON-1117250246 None] Acquiring lock "cinder-e12cea7c-49e1-45d4-b7f5-791d45e86ea8-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:28:05 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-89d40dd3-da84-46d1-a323-7b1c1ef5f663 tempest-VolumesListAdminTestJSON-1117250246 None] Lock "cinder-e12cea7c-49e1-45d4-b7f5-791d45e86ea8-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:28:05 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-89d40dd3-da84-46d1-a323-7b1c1ef5f663 tempest-VolumesListAdminTestJSON-1117250246 None] Acquiring lock "cinder-quobyte-e12cea7c-49e1-45d4-b7f5-791d45e86ea8" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:28:05 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-89d40dd3-da84-46d1-a323-7b1c1ef5f663 tempest-VolumesListAdminTestJSON-1117250246 None] Lock "cinder-quobyte-e12cea7c-49e1-45d4-b7f5-791d45e86ea8" acquired by "delete_volume" :: waited 0.012s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:28:05 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-fea7563f-9d7b-4885-8193-995447bbe60f tempest-VolumesListAdminTestJSON-1634395798 None] Acquiring lock "cinder-c1b979cd-7543-4a0c-b320-0dad96c76a2c-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:28:05 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfee6046-ffae-46c6-8a59-2c407640c256]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:28:05 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-89d40dd3-da84-46d1-a323-7b1c1ef5f663 tempest-VolumesListAdminTestJSON-1117250246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e12cea7c-49e1-45d4-b7f5-791d45e86ea8 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:05 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-fea7563f-9d7b-4885-8193-995447bbe60f tempest-VolumesListAdminTestJSON-1634395798 None] Lock "cinder-c1b979cd-7543-4a0c-b320-0dad96c76a2c-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:28:05 devstack sudo[89067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e12cea7c-49e1-45d4-b7f5-791d45e86ea8
Feb 27 01:28:05 devstack sudo[89067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:05 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-fea7563f-9d7b-4885-8193-995447bbe60f tempest-VolumesListAdminTestJSON-1634395798 None] Acquiring lock "cinder-quobyte-c1b979cd-7543-4a0c-b320-0dad96c76a2c" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:28:05 devstack sudo[89055]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:05 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-132e68b0-d8aa-40e9-b4ed-362f25f5a878 tempest-VolumesSnapshotTestJSON-708792780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.655s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:05 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-132e68b0-d8aa-40e9-b4ed-362f25f5a878 tempest-VolumesSnapshotTestJSON-708792780 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:28:05 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-132e68b0-d8aa-40e9-b4ed-362f25f5a878 tempest-VolumesSnapshotTestJSON-708792780 None] Deleted volume successfully.
Feb 27 01:28:05 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-fea7563f-9d7b-4885-8193-995447bbe60f tempest-VolumesListAdminTestJSON-1634395798 None] Lock "cinder-quobyte-c1b979cd-7543-4a0c-b320-0dad96c76a2c" acquired by "delete_volume" :: waited 0.031s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:28:05 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[96340f8e-35f1-4186-b304-d37f32af65f7]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:28:05 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-fea7563f-9d7b-4885-8193-995447bbe60f tempest-VolumesListAdminTestJSON-1634395798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c1b979cd-7543-4a0c-b320-0dad96c76a2c {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:05 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-132e68b0-d8aa-40e9-b4ed-362f25f5a878 tempest-VolumesSnapshotTestJSON-708792780 None] Lock "cinder-8077be60-e7c3-434b-876e-93ce60b85df5-delete_volume" released by "delete_volume" :: held 2.323s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:28:06 devstack sudo[89069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c1b979cd-7543-4a0c-b320-0dad96c76a2c
Feb 27 01:28:06 devstack sudo[89069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:06 devstack sudo[89067]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:06 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-89d40dd3-da84-46d1-a323-7b1c1ef5f663 tempest-VolumesListAdminTestJSON-1117250246 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e12cea7c-49e1-45d4-b7f5-791d45e86ea8" returned: 0 in 0.598s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:06 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-89d40dd3-da84-46d1-a323-7b1c1ef5f663 tempest-VolumesListAdminTestJSON-1117250246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e12cea7c-49e1-45d4-b7f5-791d45e86ea8 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:06 devstack sudo[89074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e12cea7c-49e1-45d4-b7f5-791d45e86ea8
Feb 27 01:28:06 devstack sudo[89074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:06 devstack sudo[89069]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:06 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-fea7563f-9d7b-4885-8193-995447bbe60f tempest-VolumesListAdminTestJSON-1634395798 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c1b979cd-7543-4a0c-b320-0dad96c76a2c" returned: 0 in 0.624s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:06 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-fea7563f-9d7b-4885-8193-995447bbe60f tempest-VolumesListAdminTestJSON-1634395798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c1b979cd-7543-4a0c-b320-0dad96c76a2c {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:06 devstack sudo[89079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c1b979cd-7543-4a0c-b320-0dad96c76a2c
Feb 27 01:28:06 devstack sudo[89079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:06 devstack sudo[89074]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:06 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-89d40dd3-da84-46d1-a323-7b1c1ef5f663 tempest-VolumesListAdminTestJSON-1117250246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e12cea7c-49e1-45d4-b7f5-791d45e86ea8" returned: 0 in 0.520s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:06 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-89d40dd3-da84-46d1-a323-7b1c1ef5f663 tempest-VolumesListAdminTestJSON-1117250246 None] Lock "cinder-quobyte-e12cea7c-49e1-45d4-b7f5-791d45e86ea8" released by "delete_volume" :: held 1.156s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:28:06 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-89d40dd3-da84-46d1-a323-7b1c1ef5f663 tempest-VolumesListAdminTestJSON-1117250246 None] Created reservations ['3bf85c36-43bb-4b1c-b01a-90c0adbe8e78', '7a3b1326-13bc-4a1a-99ac-df9587be0291', '0bc38641-8578-464d-87cf-cb601a67b57b', 'bab5f29d-39fa-4e71-b38f-baf815659381'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:28:07 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-89d40dd3-da84-46d1-a323-7b1c1ef5f663 tempest-VolumesListAdminTestJSON-1117250246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:28:07 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-89d40dd3-da84-46d1-a323-7b1c1ef5f663 tempest-VolumesListAdminTestJSON-1117250246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:28:07 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-89d40dd3-da84-46d1-a323-7b1c1ef5f663 tempest-VolumesListAdminTestJSON-1117250246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:28:07 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-89d40dd3-da84-46d1-a323-7b1c1ef5f663 tempest-VolumesListAdminTestJSON-1117250246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:28:07 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-89d40dd3-da84-46d1-a323-7b1c1ef5f663 tempest-VolumesListAdminTestJSON-1117250246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:28:07 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-89d40dd3-da84-46d1-a323-7b1c1ef5f663 tempest-VolumesListAdminTestJSON-1117250246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:07 devstack sudo[89083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:28:07 devstack sudo[89083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:07 devstack sudo[89079]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:07 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-fea7563f-9d7b-4885-8193-995447bbe60f tempest-VolumesListAdminTestJSON-1634395798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c1b979cd-7543-4a0c-b320-0dad96c76a2c" returned: 0 in 0.525s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:07 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-fea7563f-9d7b-4885-8193-995447bbe60f tempest-VolumesListAdminTestJSON-1634395798 None] Lock "cinder-quobyte-c1b979cd-7543-4a0c-b320-0dad96c76a2c" released by "delete_volume" :: held 1.175s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:28:07 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-fea7563f-9d7b-4885-8193-995447bbe60f tempest-VolumesListAdminTestJSON-1634395798 None] Created reservations ['f517de24-c59b-4b6e-b47b-876b24e659eb', '3396cdc4-ddf8-4c2f-9cf9-4663cbd2369b', '01f3474e-ae00-4e3f-954d-5a21175607d4', '041cf81e-2247-4b1a-8bff-aeef55c42189'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:28:07 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-fea7563f-9d7b-4885-8193-995447bbe60f tempest-VolumesListAdminTestJSON-1634395798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:28:07 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-fea7563f-9d7b-4885-8193-995447bbe60f tempest-VolumesListAdminTestJSON-1634395798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:28:07 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-fea7563f-9d7b-4885-8193-995447bbe60f tempest-VolumesListAdminTestJSON-1634395798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:28:07 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-fea7563f-9d7b-4885-8193-995447bbe60f tempest-VolumesListAdminTestJSON-1634395798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:28:07 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-fea7563f-9d7b-4885-8193-995447bbe60f tempest-VolumesListAdminTestJSON-1634395798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:28:07 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-fea7563f-9d7b-4885-8193-995447bbe60f tempest-VolumesListAdminTestJSON-1634395798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:07 devstack sudo[89085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:28:07 devstack sudo[89085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:07 devstack sudo[89083]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:07 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-89d40dd3-da84-46d1-a323-7b1c1ef5f663 tempest-VolumesListAdminTestJSON-1117250246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.513s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:07 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-89d40dd3-da84-46d1-a323-7b1c1ef5f663 tempest-VolumesListAdminTestJSON-1117250246 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:28:07 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-89d40dd3-da84-46d1-a323-7b1c1ef5f663 tempest-VolumesListAdminTestJSON-1117250246 None] Deleted volume successfully.
Feb 27 01:28:07 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-89d40dd3-da84-46d1-a323-7b1c1ef5f663 tempest-VolumesListAdminTestJSON-1117250246 None] Lock "cinder-e12cea7c-49e1-45d4-b7f5-791d45e86ea8-delete_volume" released by "delete_volume" :: held 1.888s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:28:07 devstack sudo[89085]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:07 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-fea7563f-9d7b-4885-8193-995447bbe60f tempest-VolumesListAdminTestJSON-1634395798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.502s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:07 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-fea7563f-9d7b-4885-8193-995447bbe60f tempest-VolumesListAdminTestJSON-1634395798 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:28:07 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-fea7563f-9d7b-4885-8193-995447bbe60f tempest-VolumesListAdminTestJSON-1634395798 None] Deleted volume successfully.
Feb 27 01:28:07 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-fea7563f-9d7b-4885-8193-995447bbe60f tempest-VolumesListAdminTestJSON-1634395798 None] Lock "cinder-c1b979cd-7543-4a0c-b320-0dad96c76a2c-delete_volume" released by "delete_volume" :: held 1.889s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:28:08 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-4faded20-75eb-43f8-ab72-4d81b0488c4c tempest-VolumesListAdminTestJSON-1634395798 None] Acquiring lock "cinder-50a673ca-af5c-4fec-b144-a80523c1c13c-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:28:08 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-4faded20-75eb-43f8-ab72-4d81b0488c4c tempest-VolumesListAdminTestJSON-1634395798 None] Lock "cinder-50a673ca-af5c-4fec-b144-a80523c1c13c-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:28:08 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-4faded20-75eb-43f8-ab72-4d81b0488c4c tempest-VolumesListAdminTestJSON-1634395798 None] Acquiring lock "cinder-quobyte-50a673ca-af5c-4fec-b144-a80523c1c13c" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:28:08 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-4faded20-75eb-43f8-ab72-4d81b0488c4c tempest-VolumesListAdminTestJSON-1634395798 None] Lock "cinder-quobyte-50a673ca-af5c-4fec-b144-a80523c1c13c" acquired by "delete_volume" :: waited 0.010s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:28:08 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a086eca-efe2-4aca-9137-71ab6f118a1e]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:28:08 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-4faded20-75eb-43f8-ab72-4d81b0488c4c tempest-VolumesListAdminTestJSON-1634395798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-50a673ca-af5c-4fec-b144-a80523c1c13c {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:08 devstack sudo[89090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-50a673ca-af5c-4fec-b144-a80523c1c13c
Feb 27 01:28:08 devstack sudo[89090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:08 devstack sudo[89090]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:08 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-4faded20-75eb-43f8-ab72-4d81b0488c4c tempest-VolumesListAdminTestJSON-1634395798 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-50a673ca-af5c-4fec-b144-a80523c1c13c" returned: 0 in 0.685s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:08 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-4faded20-75eb-43f8-ab72-4d81b0488c4c tempest-VolumesListAdminTestJSON-1634395798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-50a673ca-af5c-4fec-b144-a80523c1c13c {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:08 devstack sudo[89095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-50a673ca-af5c-4fec-b144-a80523c1c13c
Feb 27 01:28:08 devstack sudo[89095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:09 devstack sudo[89095]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:09 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-4faded20-75eb-43f8-ab72-4d81b0488c4c tempest-VolumesListAdminTestJSON-1634395798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-50a673ca-af5c-4fec-b144-a80523c1c13c" returned: 0 in 0.484s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:09 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-4faded20-75eb-43f8-ab72-4d81b0488c4c tempest-VolumesListAdminTestJSON-1634395798 None] Lock "cinder-quobyte-50a673ca-af5c-4fec-b144-a80523c1c13c" released by "delete_volume" :: held 1.202s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:28:09 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-4faded20-75eb-43f8-ab72-4d81b0488c4c tempest-VolumesListAdminTestJSON-1634395798 None] Created reservations ['2668487c-9102-423c-be12-a90a6847b432', '41e7fe46-ebf4-44d0-9a2a-d0799c76c4e8', '9788a909-6cf4-41bb-a0aa-17c60d988a28', '0292eef9-ef14-4d30-823b-6ed6b6455de6'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:28:09 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-4faded20-75eb-43f8-ab72-4d81b0488c4c tempest-VolumesListAdminTestJSON-1634395798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:28:09 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-4faded20-75eb-43f8-ab72-4d81b0488c4c tempest-VolumesListAdminTestJSON-1634395798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:28:09 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-4faded20-75eb-43f8-ab72-4d81b0488c4c tempest-VolumesListAdminTestJSON-1634395798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:28:09 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-4faded20-75eb-43f8-ab72-4d81b0488c4c tempest-VolumesListAdminTestJSON-1634395798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:28:09 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-4faded20-75eb-43f8-ab72-4d81b0488c4c tempest-VolumesListAdminTestJSON-1634395798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:28:09 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-4faded20-75eb-43f8-ab72-4d81b0488c4c tempest-VolumesListAdminTestJSON-1634395798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:09 devstack sudo[89098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:28:09 devstack sudo[89098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:10 devstack sudo[89098]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:10 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-4faded20-75eb-43f8-ab72-4d81b0488c4c tempest-VolumesListAdminTestJSON-1634395798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.678s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:10 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-4faded20-75eb-43f8-ab72-4d81b0488c4c tempest-VolumesListAdminTestJSON-1634395798 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:28:10 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-4faded20-75eb-43f8-ab72-4d81b0488c4c tempest-VolumesListAdminTestJSON-1634395798 None] Deleted volume successfully.
Feb 27 01:28:10 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-4faded20-75eb-43f8-ab72-4d81b0488c4c tempest-VolumesListAdminTestJSON-1634395798 None] Lock "cinder-50a673ca-af5c-4fec-b144-a80523c1c13c-delete_volume" released by "delete_volume" :: held 2.078s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:28:10 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-4d6d2962-24cd-4bc4-a29f-e69716710f21 tempest-VolumesListAdminTestJSON-1634395798 None] Acquiring lock "cinder-14fa7b80-3616-4294-9e83-90d9eb398326-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:28:10 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-4d6d2962-24cd-4bc4-a29f-e69716710f21 tempest-VolumesListAdminTestJSON-1634395798 None] Lock "cinder-14fa7b80-3616-4294-9e83-90d9eb398326-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:28:10 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-4d6d2962-24cd-4bc4-a29f-e69716710f21 tempest-VolumesListAdminTestJSON-1634395798 None] Acquiring lock "cinder-quobyte-14fa7b80-3616-4294-9e83-90d9eb398326" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:28:10 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-4d6d2962-24cd-4bc4-a29f-e69716710f21 tempest-VolumesListAdminTestJSON-1634395798 None] Lock "cinder-quobyte-14fa7b80-3616-4294-9e83-90d9eb398326" acquired by "delete_volume" :: waited 0.012s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:28:10 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[35be3f4f-951a-49ff-90e6-62f2c861f97d]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:28:10 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-4d6d2962-24cd-4bc4-a29f-e69716710f21 tempest-VolumesListAdminTestJSON-1634395798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-14fa7b80-3616-4294-9e83-90d9eb398326 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:10 devstack sudo[89102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-14fa7b80-3616-4294-9e83-90d9eb398326
Feb 27 01:28:10 devstack sudo[89102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:11 devstack sudo[89102]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:11 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-4d6d2962-24cd-4bc4-a29f-e69716710f21 tempest-VolumesListAdminTestJSON-1634395798 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-14fa7b80-3616-4294-9e83-90d9eb398326" returned: 0 in 0.751s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:11 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-4d6d2962-24cd-4bc4-a29f-e69716710f21 tempest-VolumesListAdminTestJSON-1634395798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-14fa7b80-3616-4294-9e83-90d9eb398326 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:11 devstack sudo[89107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-14fa7b80-3616-4294-9e83-90d9eb398326
Feb 27 01:28:11 devstack sudo[89107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:11 devstack sudo[89107]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:11 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-4d6d2962-24cd-4bc4-a29f-e69716710f21 tempest-VolumesListAdminTestJSON-1634395798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-14fa7b80-3616-4294-9e83-90d9eb398326" returned: 0 in 0.538s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:11 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-4d6d2962-24cd-4bc4-a29f-e69716710f21 tempest-VolumesListAdminTestJSON-1634395798 None] Lock "cinder-quobyte-14fa7b80-3616-4294-9e83-90d9eb398326" released by "delete_volume" :: held 1.338s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:28:11 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-4d6d2962-24cd-4bc4-a29f-e69716710f21 tempest-VolumesListAdminTestJSON-1634395798 None] Created reservations ['744092d8-8dad-4923-adb9-a1041cef3af5', '838d859b-799a-49d8-b489-fd90fd9738f2', '36095d46-9b11-4e39-a76f-13c3ec5cb3b7', '8e97758b-5c25-4618-95bb-a790358f7fd4'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:28:11 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-4d6d2962-24cd-4bc4-a29f-e69716710f21 tempest-VolumesListAdminTestJSON-1634395798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:28:11 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-4d6d2962-24cd-4bc4-a29f-e69716710f21 tempest-VolumesListAdminTestJSON-1634395798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:28:11 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-4d6d2962-24cd-4bc4-a29f-e69716710f21 tempest-VolumesListAdminTestJSON-1634395798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:28:11 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-4d6d2962-24cd-4bc4-a29f-e69716710f21 tempest-VolumesListAdminTestJSON-1634395798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:28:11 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-4d6d2962-24cd-4bc4-a29f-e69716710f21 tempest-VolumesListAdminTestJSON-1634395798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:28:11 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-4d6d2962-24cd-4bc4-a29f-e69716710f21 tempest-VolumesListAdminTestJSON-1634395798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:11 devstack sudo[89112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:28:11 devstack sudo[89112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:12 devstack sudo[89112]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:12 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-4d6d2962-24cd-4bc4-a29f-e69716710f21 tempest-VolumesListAdminTestJSON-1634395798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.494s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:12 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-4d6d2962-24cd-4bc4-a29f-e69716710f21 tempest-VolumesListAdminTestJSON-1634395798 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:28:12 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-4d6d2962-24cd-4bc4-a29f-e69716710f21 tempest-VolumesListAdminTestJSON-1634395798 None] Deleted volume successfully.
Feb 27 01:28:12 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-4d6d2962-24cd-4bc4-a29f-e69716710f21 tempest-VolumesListAdminTestJSON-1634395798 None] Lock "cinder-14fa7b80-3616-4294-9e83-90d9eb398326-delete_volume" released by "delete_volume" :: held 2.044s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:28:19 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-78f7bf6b-c000-4265-a8a9-2ab0f6876373 tempest-SnapshotDependencyTests-1761858054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:28:19 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-78f7bf6b-c000-4265-a8a9-2ab0f6876373 tempest-SnapshotDependencyTests-1761858054 None] Flow 'volume_create_manager' (aaf5ea9e-b0a9-4d9f-b808-715d6d90633d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:28:19 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-78f7bf6b-c000-4265-a8a9-2ab0f6876373 tempest-SnapshotDependencyTests-1761858054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f80a2e7-8c7c-414d-8d29-9635c66a609f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:19 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-78f7bf6b-c000-4265-a8a9-2ab0f6876373 tempest-SnapshotDependencyTests-1761858054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f80a2e7-8c7c-414d-8d29-9635c66a609f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:28:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-418528430',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae5ec85b-71ec-4f16-99d3-d53d028cbdeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87dabd8fd0174f7298ab64014e48b1fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:28:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:28:20Z,use_quota=True,user_id='fecef6b548f846ad827b5e5ad3f1445b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:19 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-78f7bf6b-c000-4265-a8a9-2ab0f6876373 tempest-SnapshotDependencyTests-1761858054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c3aac8a-ee2f-4ed9-bbc7-6915d18defa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:19 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-78f7bf6b-c000-4265-a8a9-2ab0f6876373 tempest-SnapshotDependencyTests-1761858054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c3aac8a-ee2f-4ed9-bbc7-6915d18defa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:19 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-78f7bf6b-c000-4265-a8a9-2ab0f6876373 tempest-SnapshotDependencyTests-1761858054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc63af74-edb9-48db-9b54-844d44116a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:19 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-78f7bf6b-c000-4265-a8a9-2ab0f6876373 tempest-SnapshotDependencyTests-1761858054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc63af74-edb9-48db-9b54-844d44116a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae5ec85b-71ec-4f16-99d3-d53d028cbdeb', 'volume_name': 'volume-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:19 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-78f7bf6b-c000-4265-a8a9-2ab0f6876373 tempest-SnapshotDependencyTests-1761858054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d88ab50-1614-44b2-9a58-106e6a06dde0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:19 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-78f7bf6b-c000-4265-a8a9-2ab0f6876373 tempest-SnapshotDependencyTests-1761858054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d88ab50-1614-44b2-9a58-106e6a06dde0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:19 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-78f7bf6b-c000-4265-a8a9-2ab0f6876373 tempest-SnapshotDependencyTests-1761858054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a9c1cdd-3616-47df-ac82-0d26889e4c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:19 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-78f7bf6b-c000-4265-a8a9-2ab0f6876373 tempest-SnapshotDependencyTests-1761858054 None] Volume ae5ec85b-71ec-4f16-99d3-d53d028cbdeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb', 'volume_size': 1}
Feb 27 01:28:19 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-78f7bf6b-c000-4265-a8a9-2ab0f6876373 tempest-SnapshotDependencyTests-1761858054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:28:19 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-78f7bf6b-c000-4265-a8a9-2ab0f6876373 tempest-SnapshotDependencyTests-1761858054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:28:19 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-78f7bf6b-c000-4265-a8a9-2ab0f6876373 tempest-SnapshotDependencyTests-1761858054 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:28:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-418528430',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae5ec85b-71ec-4f16-99d3-d53d028cbdeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87dabd8fd0174f7298ab64014e48b1fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:28:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:28:20Z,use_quota=True,user_id='fecef6b548f846ad827b5e5ad3f1445b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:28:19 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-78f7bf6b-c000-4265-a8a9-2ab0f6876373 tempest-SnapshotDependencyTests-1761858054 None] Creating volume ae5ec85b-71ec-4f16-99d3-d53d028cbdeb {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:28:19 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-78f7bf6b-c000-4265-a8a9-2ab0f6876373 tempest-SnapshotDependencyTests-1761858054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:28:19 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-78f7bf6b-c000-4265-a8a9-2ab0f6876373 tempest-SnapshotDependencyTests-1761858054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:28:19 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-78f7bf6b-c000-4265-a8a9-2ab0f6876373 tempest-SnapshotDependencyTests-1761858054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:28:19 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-78f7bf6b-c000-4265-a8a9-2ab0f6876373 tempest-SnapshotDependencyTests-1761858054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:28:19 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-78f7bf6b-c000-4265-a8a9-2ab0f6876373 tempest-SnapshotDependencyTests-1761858054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:28:19 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-78f7bf6b-c000-4265-a8a9-2ab0f6876373 tempest-SnapshotDependencyTests-1761858054 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:28:19 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-78f7bf6b-c000-4265-a8a9-2ab0f6876373 tempest-SnapshotDependencyTests-1761858054 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:28:19 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-78f7bf6b-c000-4265-a8a9-2ab0f6876373 tempest-SnapshotDependencyTests-1761858054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:20 devstack sudo[89145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb 1073741824
Feb 27 01:28:20 devstack sudo[89145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:20 devstack sudo[89145]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:20 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-78f7bf6b-c000-4265-a8a9-2ab0f6876373 tempest-SnapshotDependencyTests-1761858054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb 1073741824" returned: 0 in 0.758s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:20 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-78f7bf6b-c000-4265-a8a9-2ab0f6876373 tempest-SnapshotDependencyTests-1761858054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:20 devstack sudo[89150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb
Feb 27 01:28:20 devstack sudo[89150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:20 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-52e226a2-fa19-4541-829e-142b076078c4 tempest-AbsoluteLimitsTests-1136866497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:28:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-52e226a2-fa19-4541-829e-142b076078c4 tempest-AbsoluteLimitsTests-1136866497 None] Flow 'volume_create_manager' (a7e5e4d3-e16a-46b1-8051-0b6b5a70065d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:28:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-52e226a2-fa19-4541-829e-142b076078c4 tempest-AbsoluteLimitsTests-1136866497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a3b1799-8ffe-4b77-8790-a947c46bfa4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-52e226a2-fa19-4541-829e-142b076078c4 tempest-AbsoluteLimitsTests-1136866497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a3b1799-8ffe-4b77-8790-a947c46bfa4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:28:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2066879482',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb1a0090-3f66-4ce8-bc32-3d2cdd599bc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b687bd2f76aa41f8b03d2c6fbf4bea41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:28:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:28:21Z,use_quota=True,user_id='efb3daf4d15e4281acb215e133e6413e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-52e226a2-fa19-4541-829e-142b076078c4 tempest-AbsoluteLimitsTests-1136866497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35541608-5509-4550-b279-437763dcb294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-52e226a2-fa19-4541-829e-142b076078c4 tempest-AbsoluteLimitsTests-1136866497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35541608-5509-4550-b279-437763dcb294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:21 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-52e226a2-fa19-4541-829e-142b076078c4 tempest-AbsoluteLimitsTests-1136866497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a7a2b86-4370-47ee-8ef6-e673c121dea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:21 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-52e226a2-fa19-4541-829e-142b076078c4 tempest-AbsoluteLimitsTests-1136866497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a7a2b86-4370-47ee-8ef6-e673c121dea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb1a0090-3f66-4ce8-bc32-3d2cdd599bc0', 'volume_name': 'volume-bb1a0090-3f66-4ce8-bc32-3d2cdd599bc0', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:21 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-52e226a2-fa19-4541-829e-142b076078c4 tempest-AbsoluteLimitsTests-1136866497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0f90de8-3387-42da-9a7a-8f5045c3c73a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:21 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-52e226a2-fa19-4541-829e-142b076078c4 tempest-AbsoluteLimitsTests-1136866497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0f90de8-3387-42da-9a7a-8f5045c3c73a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:21 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-52e226a2-fa19-4541-829e-142b076078c4 tempest-AbsoluteLimitsTests-1136866497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23616183-803e-4ad4-af8d-24f2c15893c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:21 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-52e226a2-fa19-4541-829e-142b076078c4 tempest-AbsoluteLimitsTests-1136866497 None] Volume bb1a0090-3f66-4ce8-bc32-3d2cdd599bc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb1a0090-3f66-4ce8-bc32-3d2cdd599bc0', 'volume_size': 1}
Feb 27 01:28:21 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-52e226a2-fa19-4541-829e-142b076078c4 tempest-AbsoluteLimitsTests-1136866497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:28:21 devstack sudo[89150]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:21 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-78f7bf6b-c000-4265-a8a9-2ab0f6876373 tempest-SnapshotDependencyTests-1761858054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb" returned: 0 in 0.471s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:21 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-78f7bf6b-c000-4265-a8a9-2ab0f6876373 tempest-SnapshotDependencyTests-1761858054 None] <== create_volume: return (1285ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:28:21 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-78f7bf6b-c000-4265-a8a9-2ab0f6876373 tempest-SnapshotDependencyTests-1761858054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.287s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:28:21 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-52e226a2-fa19-4541-829e-142b076078c4 tempest-AbsoluteLimitsTests-1136866497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.196s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:28:21 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-52e226a2-fa19-4541-829e-142b076078c4 tempest-AbsoluteLimitsTests-1136866497 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:28:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2066879482',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb1a0090-3f66-4ce8-bc32-3d2cdd599bc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b687bd2f76aa41f8b03d2c6fbf4bea41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:28:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:28:21Z,use_quota=True,user_id='efb3daf4d15e4281acb215e133e6413e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:28:21 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-52e226a2-fa19-4541-829e-142b076078c4 tempest-AbsoluteLimitsTests-1136866497 None] Creating volume bb1a0090-3f66-4ce8-bc32-3d2cdd599bc0 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:28:21 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-52e226a2-fa19-4541-829e-142b076078c4 tempest-AbsoluteLimitsTests-1136866497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:28:21 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-52e226a2-fa19-4541-829e-142b076078c4 tempest-AbsoluteLimitsTests-1136866497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:28:21 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-52e226a2-fa19-4541-829e-142b076078c4 tempest-AbsoluteLimitsTests-1136866497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:28:21 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-52e226a2-fa19-4541-829e-142b076078c4 tempest-AbsoluteLimitsTests-1136866497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:28:21 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-52e226a2-fa19-4541-829e-142b076078c4 tempest-AbsoluteLimitsTests-1136866497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:28:21 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-52e226a2-fa19-4541-829e-142b076078c4 tempest-AbsoluteLimitsTests-1136866497 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:28:21 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-52e226a2-fa19-4541-829e-142b076078c4 tempest-AbsoluteLimitsTests-1136866497 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:28:21 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-52e226a2-fa19-4541-829e-142b076078c4 tempest-AbsoluteLimitsTests-1136866497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-bb1a0090-3f66-4ce8-bc32-3d2cdd599bc0 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:21 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-78f7bf6b-c000-4265-a8a9-2ab0f6876373 tempest-SnapshotDependencyTests-1761858054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a9c1cdd-3616-47df-ac82-0d26889e4c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:21 devstack sudo[89153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-bb1a0090-3f66-4ce8-bc32-3d2cdd599bc0 1073741824
Feb 27 01:28:21 devstack sudo[89153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:21 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-78f7bf6b-c000-4265-a8a9-2ab0f6876373 tempest-SnapshotDependencyTests-1761858054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7db59d16-cf4c-4851-9e55-e69e9f6c0bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:21 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-78f7bf6b-c000-4265-a8a9-2ab0f6876373 tempest-SnapshotDependencyTests-1761858054 None] Volume volume-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb (ae5ec85b-71ec-4f16-99d3-d53d028cbdeb): created successfully
Feb 27 01:28:21 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-78f7bf6b-c000-4265-a8a9-2ab0f6876373 tempest-SnapshotDependencyTests-1761858054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7db59d16-cf4c-4851-9e55-e69e9f6c0bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:21 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-78f7bf6b-c000-4265-a8a9-2ab0f6876373 tempest-SnapshotDependencyTests-1761858054 None] Flow 'volume_create_manager' (aaf5ea9e-b0a9-4d9f-b808-715d6d90633d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:28:21 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-78f7bf6b-c000-4265-a8a9-2ab0f6876373 tempest-SnapshotDependencyTests-1761858054 None] Created volume successfully.
Feb 27 01:28:21 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-15727ac2-352d-453b-b6a7-dcd1b9fb923c tempest-VolumesActionsTest-1196644426 None] Acquiring lock "cinder-0b66dc01-1c7a-427d-b771-a85154916559" by "attach_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:28:21 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-15727ac2-352d-453b-b6a7-dcd1b9fb923c tempest-VolumesActionsTest-1196644426 None] Lock "cinder-0b66dc01-1c7a-427d-b771-a85154916559" acquired by "attach_volume" :: waited 0.016s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:28:21 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-15727ac2-352d-453b-b6a7-dcd1b9fb923c tempest-VolumesActionsTest-1196644426 None] Attaching volume 0b66dc01-1c7a-427d-b771-a85154916559 to instance 143f5952-ed45-417c-b88b-a807b6f6ca41 at mountpoint /dev/vdb on host None.
Feb 27 01:28:21 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-15727ac2-352d-453b-b6a7-dcd1b9fb923c tempest-VolumesActionsTest-1196644426 None] Attach volume completed successfully.
Feb 27 01:28:21 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-15727ac2-352d-453b-b6a7-dcd1b9fb923c tempest-VolumesActionsTest-1196644426 None] Lock "cinder-0b66dc01-1c7a-427d-b771-a85154916559" released by "attach_volume" :: held 0.087s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:28:21 devstack sudo[89153]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:21 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-52e226a2-fa19-4541-829e-142b076078c4 tempest-AbsoluteLimitsTests-1136866497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-bb1a0090-3f66-4ce8-bc32-3d2cdd599bc0 1073741824" returned: 0 in 0.612s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:21 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-52e226a2-fa19-4541-829e-142b076078c4 tempest-AbsoluteLimitsTests-1136866497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-bb1a0090-3f66-4ce8-bc32-3d2cdd599bc0 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:21 devstack sudo[89158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-bb1a0090-3f66-4ce8-bc32-3d2cdd599bc0
Feb 27 01:28:21 devstack sudo[89158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:22 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-aaa7609b-c458-4083-ae0c-94cb25c8fb9d tempest-SnapshotDependencyTests-1761858054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:28:22 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-f79555f8-10e7-442b-81ab-d0e4561a7d7a tempest-VolumesActionsTest-1196644426 None] Acquiring lock "cinder-0b66dc01-1c7a-427d-b771-a85154916559-detach_volume" by "detach_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:28:22 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-f79555f8-10e7-442b-81ab-d0e4561a7d7a tempest-VolumesActionsTest-1196644426 None] Lock "cinder-0b66dc01-1c7a-427d-b771-a85154916559-detach_volume" acquired by "detach_volume" :: waited 0.013s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:28:22 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-f79555f8-10e7-442b-81ab-d0e4561a7d7a tempest-VolumesActionsTest-1196644426 None] Detaching volume 0b66dc01-1c7a-427d-b771-a85154916559 from instance 143f5952-ed45-417c-b88b-a807b6f6ca41.
Feb 27 01:28:22 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-f79555f8-10e7-442b-81ab-d0e4561a7d7a tempest-VolumesActionsTest-1196644426 None] Detach volume completed successfully.
Feb 27 01:28:22 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-f79555f8-10e7-442b-81ab-d0e4561a7d7a tempest-VolumesActionsTest-1196644426 None] Lock "cinder-0b66dc01-1c7a-427d-b771-a85154916559-detach_volume" released by "detach_volume" :: held 0.048s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:28:22 devstack sudo[89158]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:22 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-52e226a2-fa19-4541-829e-142b076078c4 tempest-AbsoluteLimitsTests-1136866497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-bb1a0090-3f66-4ce8-bc32-3d2cdd599bc0" returned: 0 in 0.588s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:22 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-52e226a2-fa19-4541-829e-142b076078c4 tempest-AbsoluteLimitsTests-1136866497 None] <== create_volume: return (1225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:28:22 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-52e226a2-fa19-4541-829e-142b076078c4 tempest-AbsoluteLimitsTests-1136866497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:28:22 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-aaa7609b-c458-4083-ae0c-94cb25c8fb9d tempest-SnapshotDependencyTests-1761858054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.140s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:28:22 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-52e226a2-fa19-4541-829e-142b076078c4 tempest-AbsoluteLimitsTests-1136866497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23616183-803e-4ad4-af8d-24f2c15893c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb1a0090-3f66-4ce8-bc32-3d2cdd599bc0', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:22 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-52e226a2-fa19-4541-829e-142b076078c4 tempest-AbsoluteLimitsTests-1136866497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0af38b74-3bef-4fd1-bcab-d17e0fc7d840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:22 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-aaa7609b-c458-4083-ae0c-94cb25c8fb9d tempest-SnapshotDependencyTests-1761858054 None] Creating offline snapshot bbd978a5-18ac-4e1e-b281-e69901f4a9d3 of volume ae5ec85b-71ec-4f16-99d3-d53d028cbdeb {{(pid=83106) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:28:22 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-52e226a2-fa19-4541-829e-142b076078c4 tempest-AbsoluteLimitsTests-1136866497 None] Volume volume-bb1a0090-3f66-4ce8-bc32-3d2cdd599bc0 (bb1a0090-3f66-4ce8-bc32-3d2cdd599bc0): created successfully
Feb 27 01:28:22 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-52e226a2-fa19-4541-829e-142b076078c4 tempest-AbsoluteLimitsTests-1136866497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0af38b74-3bef-4fd1-bcab-d17e0fc7d840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:22 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-52e226a2-fa19-4541-829e-142b076078c4 tempest-AbsoluteLimitsTests-1136866497 None] Flow 'volume_create_manager' (a7e5e4d3-e16a-46b1-8051-0b6b5a70065d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:28:22 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f08c18-cb5b-4c88-ab7f-8ffdc4af1321]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:28:22 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-aaa7609b-c458-4083-ae0c-94cb25c8fb9d tempest-SnapshotDependencyTests-1761858054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:22 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-52e226a2-fa19-4541-829e-142b076078c4 tempest-AbsoluteLimitsTests-1136866497 None] Created volume successfully.
Feb 27 01:28:22 devstack sudo[89161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb
Feb 27 01:28:22 devstack sudo[89161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:23 devstack sudo[89161]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:23 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-aaa7609b-c458-4083-ae0c-94cb25c8fb9d tempest-SnapshotDependencyTests-1761858054 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb" returned: 0 in 0.616s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:23 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-aaa7609b-c458-4083-ae0c-94cb25c8fb9d tempest-SnapshotDependencyTests-1761858054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb.bbd978a5-18ac-4e1e-b281-e69901f4a9d3 1G {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:23 devstack sudo[89167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb.bbd978a5-18ac-4e1e-b281-e69901f4a9d3 1G
Feb 27 01:28:23 devstack sudo[89167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:23 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-a1c54fc4-f403-454f-aacb-65d8bab8a343 tempest-AbsoluteLimitsTests-1136866497 None] Acquiring lock "cinder-bb1a0090-3f66-4ce8-bc32-3d2cdd599bc0-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:28:23 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-a1c54fc4-f403-454f-aacb-65d8bab8a343 tempest-AbsoluteLimitsTests-1136866497 None] Lock "cinder-bb1a0090-3f66-4ce8-bc32-3d2cdd599bc0-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:28:23 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-a1c54fc4-f403-454f-aacb-65d8bab8a343 tempest-AbsoluteLimitsTests-1136866497 None] Acquiring lock "cinder-quobyte-bb1a0090-3f66-4ce8-bc32-3d2cdd599bc0" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:28:23 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-a1c54fc4-f403-454f-aacb-65d8bab8a343 tempest-AbsoluteLimitsTests-1136866497 None] Lock "cinder-quobyte-bb1a0090-3f66-4ce8-bc32-3d2cdd599bc0" acquired by "delete_volume" :: waited 0.017s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:28:23 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[21770b29-1ad0-43ac-a5f0-c634cf07e6da]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:28:23 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a1c54fc4-f403-454f-aacb-65d8bab8a343 tempest-AbsoluteLimitsTests-1136866497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-bb1a0090-3f66-4ce8-bc32-3d2cdd599bc0 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:23 devstack sudo[89169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-bb1a0090-3f66-4ce8-bc32-3d2cdd599bc0
Feb 27 01:28:23 devstack sudo[89169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:23 devstack sudo[89167]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:23 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-aaa7609b-c458-4083-ae0c-94cb25c8fb9d tempest-SnapshotDependencyTests-1761858054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb.bbd978a5-18ac-4e1e-b281-e69901f4a9d3 1G" returned: 0 in 0.719s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:23 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-aaa7609b-c458-4083-ae0c-94cb25c8fb9d tempest-SnapshotDependencyTests-1761858054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb.bbd978a5-18ac-4e1e-b281-e69901f4a9d3 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:23 devstack sudo[89179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb.bbd978a5-18ac-4e1e-b281-e69901f4a9d3
Feb 27 01:28:23 devstack sudo[89179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:24 devstack sudo[89169]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:24 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a1c54fc4-f403-454f-aacb-65d8bab8a343 tempest-AbsoluteLimitsTests-1136866497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-bb1a0090-3f66-4ce8-bc32-3d2cdd599bc0" returned: 0 in 0.653s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:24 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a1c54fc4-f403-454f-aacb-65d8bab8a343 tempest-AbsoluteLimitsTests-1136866497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-bb1a0090-3f66-4ce8-bc32-3d2cdd599bc0 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:24 devstack sudo[89181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-bb1a0090-3f66-4ce8-bc32-3d2cdd599bc0
Feb 27 01:28:24 devstack sudo[89181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:24 devstack sudo[89179]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:24 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-aaa7609b-c458-4083-ae0c-94cb25c8fb9d tempest-SnapshotDependencyTests-1761858054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb.bbd978a5-18ac-4e1e-b281-e69901f4a9d3" returned: 0 in 0.768s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:24 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-aaa7609b-c458-4083-ae0c-94cb25c8fb9d tempest-SnapshotDependencyTests-1761858054 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb.bbd978a5-18ac-4e1e-b281-e69901f4a9d3 is being set with open permissions: ugo+rw
Feb 27 01:28:24 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-aaa7609b-c458-4083-ae0c-94cb25c8fb9d tempest-SnapshotDependencyTests-1761858054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb.bbd978a5-18ac-4e1e-b281-e69901f4a9d3 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:24 devstack sudo[89210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb.bbd978a5-18ac-4e1e-b281-e69901f4a9d3
Feb 27 01:28:24 devstack sudo[89210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:24 devstack sudo[89181]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:24 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a1c54fc4-f403-454f-aacb-65d8bab8a343 tempest-AbsoluteLimitsTests-1136866497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-bb1a0090-3f66-4ce8-bc32-3d2cdd599bc0" returned: 0 in 0.724s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:24 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-a1c54fc4-f403-454f-aacb-65d8bab8a343 tempest-AbsoluteLimitsTests-1136866497 None] Lock "cinder-quobyte-bb1a0090-3f66-4ce8-bc32-3d2cdd599bc0" released by "delete_volume" :: held 1.429s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:28:24 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-a1c54fc4-f403-454f-aacb-65d8bab8a343 tempest-AbsoluteLimitsTests-1136866497 None] Created reservations ['997cf737-bc70-4671-a552-7817dc0a898d', '9fdd9d13-14ab-4471-a3e4-b5a82ef9021a', '2768f1e1-7db8-4574-b898-50f3980f5a3a', 'f94c5ecf-0185-4e08-8371-4e5a29edc6cd'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:28:24 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-a1c54fc4-f403-454f-aacb-65d8bab8a343 tempest-AbsoluteLimitsTests-1136866497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:28:24 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-a1c54fc4-f403-454f-aacb-65d8bab8a343 tempest-AbsoluteLimitsTests-1136866497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:28:24 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-a1c54fc4-f403-454f-aacb-65d8bab8a343 tempest-AbsoluteLimitsTests-1136866497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:28:24 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-a1c54fc4-f403-454f-aacb-65d8bab8a343 tempest-AbsoluteLimitsTests-1136866497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:28:24 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-a1c54fc4-f403-454f-aacb-65d8bab8a343 tempest-AbsoluteLimitsTests-1136866497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:28:24 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a1c54fc4-f403-454f-aacb-65d8bab8a343 tempest-AbsoluteLimitsTests-1136866497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:24 devstack sudo[89212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:28:24 devstack sudo[89212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:25 devstack sudo[89210]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:25 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-aaa7609b-c458-4083-ae0c-94cb25c8fb9d tempest-SnapshotDependencyTests-1761858054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb.bbd978a5-18ac-4e1e-b281-e69901f4a9d3" returned: 0 in 0.518s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:25 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-aaa7609b-c458-4083-ae0c-94cb25c8fb9d tempest-SnapshotDependencyTests-1761858054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb.info {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:25 devstack sudo[89216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb.info
Feb 27 01:28:25 devstack sudo[89216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:25 devstack sudo[89212]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:25 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a1c54fc4-f403-454f-aacb-65d8bab8a343 tempest-AbsoluteLimitsTests-1136866497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.441s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:25 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-a1c54fc4-f403-454f-aacb-65d8bab8a343 tempest-AbsoluteLimitsTests-1136866497 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:28:25 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-a1c54fc4-f403-454f-aacb-65d8bab8a343 tempest-AbsoluteLimitsTests-1136866497 None] Deleted volume successfully.
Feb 27 01:28:25 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-a1c54fc4-f403-454f-aacb-65d8bab8a343 tempest-AbsoluteLimitsTests-1136866497 None] Lock "cinder-bb1a0090-3f66-4ce8-bc32-3d2cdd599bc0-delete_volume" released by "delete_volume" :: held 2.088s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:28:25 devstack sudo[89216]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:25 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-aaa7609b-c458-4083-ae0c-94cb25c8fb9d tempest-SnapshotDependencyTests-1761858054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb.info" returned: 0 in 0.536s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:25 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-aaa7609b-c458-4083-ae0c-94cb25c8fb9d tempest-SnapshotDependencyTests-1761858054 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb.info is being set with open permissions: ugo+rw
Feb 27 01:28:25 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-aaa7609b-c458-4083-ae0c-94cb25c8fb9d tempest-SnapshotDependencyTests-1761858054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb.info {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:25 devstack sudo[89220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb.info
Feb 27 01:28:25 devstack sudo[89220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:26 devstack sudo[89220]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:26 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-aaa7609b-c458-4083-ae0c-94cb25c8fb9d tempest-SnapshotDependencyTests-1761858054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb.info" returned: 0 in 0.618s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:26 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-aaa7609b-c458-4083-ae0c-94cb25c8fb9d tempest-SnapshotDependencyTests-1761858054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.879s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:28:26 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-aaa7609b-c458-4083-ae0c-94cb25c8fb9d tempest-SnapshotDependencyTests-1761858054 None] Create snapshot completed successfully
Feb 27 01:28:26 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f71ea4f-86c6-4784-a8b7-96a1a7231f7c tempest-SnapshotDependencyTests-1761858054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:28:26 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-8f71ea4f-86c6-4784-a8b7-96a1a7231f7c tempest-SnapshotDependencyTests-1761858054 None] Flow 'volume_create_manager' (d7d22f17-04d4-4910-9e23-7fdab1ab9c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:28:26 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-8f71ea4f-86c6-4784-a8b7-96a1a7231f7c tempest-SnapshotDependencyTests-1761858054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fe8c0d2-b2df-43a3-91ac-fb6af9e24e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:26 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-8f71ea4f-86c6-4784-a8b7-96a1a7231f7c tempest-SnapshotDependencyTests-1761858054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fe8c0d2-b2df-43a3-91ac-fb6af9e24e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:28:27Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bccc90ad-e438-4ca5-bed0-8b9f926ced54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87dabd8fd0174f7298ab64014e48b1fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:28:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bbd978a5-18ac-4e1e-b281-e69901f4a9d3,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:28:27Z,use_quota=True,user_id='fecef6b548f846ad827b5e5ad3f1445b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:26 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-8f71ea4f-86c6-4784-a8b7-96a1a7231f7c tempest-SnapshotDependencyTests-1761858054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19f0f114-4891-40ed-b742-8cfe037603cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:27 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-8f71ea4f-86c6-4784-a8b7-96a1a7231f7c tempest-SnapshotDependencyTests-1761858054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19f0f114-4891-40ed-b742-8cfe037603cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:27 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-8f71ea4f-86c6-4784-a8b7-96a1a7231f7c tempest-SnapshotDependencyTests-1761858054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2ec69b7-5884-45e6-85fa-c8c41c53e474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:27 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-8f71ea4f-86c6-4784-a8b7-96a1a7231f7c tempest-SnapshotDependencyTests-1761858054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2ec69b7-5884-45e6-85fa-c8c41c53e474) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bccc90ad-e438-4ca5-bed0-8b9f926ced54', 'volume_name': 'volume-bccc90ad-e438-4ca5-bed0-8b9f926ced54', 'volume_size': 1, 'snapshot_id': 'bbd978a5-18ac-4e1e-b281-e69901f4a9d3'}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:27 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-8f71ea4f-86c6-4784-a8b7-96a1a7231f7c tempest-SnapshotDependencyTests-1761858054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17874ab3-c565-4681-b7e6-62d4af7f61f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:27 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-8f71ea4f-86c6-4784-a8b7-96a1a7231f7c tempest-SnapshotDependencyTests-1761858054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17874ab3-c565-4681-b7e6-62d4af7f61f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:27 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-8f71ea4f-86c6-4784-a8b7-96a1a7231f7c tempest-SnapshotDependencyTests-1761858054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3db5940-e62f-4cb9-a69c-3ea0041ff10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:27 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-8f71ea4f-86c6-4784-a8b7-96a1a7231f7c tempest-SnapshotDependencyTests-1761858054 None] Volume bccc90ad-e438-4ca5-bed0-8b9f926ced54: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bccc90ad-e438-4ca5-bed0-8b9f926ced54', 'volume_size': 1, 'snapshot_id': 'bbd978a5-18ac-4e1e-b281-e69901f4a9d3'}
Feb 27 01:28:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-8f71ea4f-86c6-4784-a8b7-96a1a7231f7c tempest-SnapshotDependencyTests-1761858054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:28:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-8f71ea4f-86c6-4784-a8b7-96a1a7231f7c tempest-SnapshotDependencyTests-1761858054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:28:27 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-8f71ea4f-86c6-4784-a8b7-96a1a7231f7c tempest-SnapshotDependencyTests-1761858054 None] Acquiring lock "cinder-quobyte-bbd978a5-18ac-4e1e-b281-e69901f4a9d3-bccc90ad-e438-4ca5-bed0-8b9f926ced54" by "_create_volume_from_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:28:27 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-8f71ea4f-86c6-4784-a8b7-96a1a7231f7c tempest-SnapshotDependencyTests-1761858054 None] Lock "cinder-quobyte-bbd978a5-18ac-4e1e-b281-e69901f4a9d3-bccc90ad-e438-4ca5-bed0-8b9f926ced54" acquired by "_create_volume_from_snapshot" :: waited 0.010s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:28:27 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-8f71ea4f-86c6-4784-a8b7-96a1a7231f7c tempest-SnapshotDependencyTests-1761858054 None] Creating volume bccc90ad-e438-4ca5-bed0-8b9f926ced54 from snapshot bbd978a5-18ac-4e1e-b281-e69901f4a9d3 {{(pid=83106) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Feb 27 01:28:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-8f71ea4f-86c6-4784-a8b7-96a1a7231f7c tempest-SnapshotDependencyTests-1761858054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:28:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-8f71ea4f-86c6-4784-a8b7-96a1a7231f7c tempest-SnapshotDependencyTests-1761858054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:28:27 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-8f71ea4f-86c6-4784-a8b7-96a1a7231f7c tempest-SnapshotDependencyTests-1761858054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:28:27 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-8f71ea4f-86c6-4784-a8b7-96a1a7231f7c tempest-SnapshotDependencyTests-1761858054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:28:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-8f71ea4f-86c6-4784-a8b7-96a1a7231f7c tempest-SnapshotDependencyTests-1761858054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:28:27 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-8f71ea4f-86c6-4784-a8b7-96a1a7231f7c tempest-SnapshotDependencyTests-1761858054 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:28:27 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-8f71ea4f-86c6-4784-a8b7-96a1a7231f7c tempest-SnapshotDependencyTests-1761858054 None] Acquiring lock "cinder-quobyte-bccc90ad-e438-4ca5-bed0-8b9f926ced54" by "_copy_volume_from_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:28:27 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-8f71ea4f-86c6-4784-a8b7-96a1a7231f7c tempest-SnapshotDependencyTests-1761858054 None] Lock "cinder-quobyte-bccc90ad-e438-4ca5-bed0-8b9f926ced54" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:28:27 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-8f71ea4f-86c6-4784-a8b7-96a1a7231f7c tempest-SnapshotDependencyTests-1761858054 None] snapshot: bbd978a5-18ac-4e1e-b281-e69901f4a9d3, volume: bccc90ad-e438-4ca5-bed0-8b9f926ced54,  {{(pid=83106) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Feb 27 01:28:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-8f71ea4f-86c6-4784-a8b7-96a1a7231f7c tempest-SnapshotDependencyTests-1761858054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:28:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-8f71ea4f-86c6-4784-a8b7-96a1a7231f7c tempest-SnapshotDependencyTests-1761858054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:28:27 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-8f71ea4f-86c6-4784-a8b7-96a1a7231f7c tempest-SnapshotDependencyTests-1761858054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:28:27 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-8f71ea4f-86c6-4784-a8b7-96a1a7231f7c tempest-SnapshotDependencyTests-1761858054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:28:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-8f71ea4f-86c6-4784-a8b7-96a1a7231f7c tempest-SnapshotDependencyTests-1761858054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:28:27 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db7162b-3b2a-45d5-aea4-e399d1541351]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:28:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-8f71ea4f-86c6-4784-a8b7-96a1a7231f7c tempest-SnapshotDependencyTests-1761858054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb.bbd978a5-18ac-4e1e-b281-e69901f4a9d3 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:27 devstack sudo[89225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb.bbd978a5-18ac-4e1e-b281-e69901f4a9d3
Feb 27 01:28:27 devstack sudo[89225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:27 devstack sudo[89225]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-8f71ea4f-86c6-4784-a8b7-96a1a7231f7c tempest-SnapshotDependencyTests-1761858054 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb.bbd978a5-18ac-4e1e-b281-e69901f4a9d3" returned: 0 in 0.690s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:27 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-8f71ea4f-86c6-4784-a8b7-96a1a7231f7c tempest-SnapshotDependencyTests-1761858054 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83106) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:28:27 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-8f71ea4f-86c6-4784-a8b7-96a1a7231f7c tempest-SnapshotDependencyTests-1761858054 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb {{(pid=83106) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Feb 27 01:28:27 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-8f71ea4f-86c6-4784-a8b7-96a1a7231f7c tempest-SnapshotDependencyTests-1761858054 None] Creating direct copy from snapshot {{(pid=83106) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Feb 27 01:28:27 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d84140-12ee-4eaa-9d63-e5210195bccf]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:28:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-8f71ea4f-86c6-4784-a8b7-96a1a7231f7c tempest-SnapshotDependencyTests-1761858054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:27 devstack sudo[89230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb
Feb 27 01:28:27 devstack sudo[89230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:28 devstack sudo[89230]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:28 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-8f71ea4f-86c6-4784-a8b7-96a1a7231f7c tempest-SnapshotDependencyTests-1761858054 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb" returned: 0 in 0.651s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:28 devstack cinder-volume[83106]: DEBUG cinder.utils [None req-8f71ea4f-86c6-4784-a8b7-96a1a7231f7c tempest-SnapshotDependencyTests-1761858054 None] Path /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-bccc90ad-e438-4ca5-bed0-8b9f926ced54 not found in is_blk_device check {{(pid=83106) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Feb 27 01:28:28 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-8f71ea4f-86c6-4784-a8b7-96a1a7231f7c tempest-SnapshotDependencyTests-1761858054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-bccc90ad-e438-4ca5-bed0-8b9f926ced54 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:28 devstack sudo[89235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-bccc90ad-e438-4ca5-bed0-8b9f926ced54
Feb 27 01:28:28 devstack sudo[89235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:29 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e02f747-400d-4733-a69a-0571530e73e0 tempest-VolumesExtendTest-1522498811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:28:29 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-0e02f747-400d-4733-a69a-0571530e73e0 tempest-VolumesExtendTest-1522498811 None] Flow 'volume_create_manager' (f6f94cc8-f3d5-483e-a1f0-5b68dec21dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:28:29 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-0e02f747-400d-4733-a69a-0571530e73e0 tempest-VolumesExtendTest-1522498811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8395ca5-659c-4f58-b609-4f0fe7f64caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:29 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-0e02f747-400d-4733-a69a-0571530e73e0 tempest-VolumesExtendTest-1522498811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8395ca5-659c-4f58-b609-4f0fe7f64caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:28:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1380404928',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1c0bc5e-f805-4ac8-bf2e-0091b9c3e6d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='580a8cc4200d4556a9c33bb0b614119a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:28:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:28:29Z,use_quota=True,user_id='4b48c3570a4b4ad89159f784f007d951',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:29 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-0e02f747-400d-4733-a69a-0571530e73e0 tempest-VolumesExtendTest-1522498811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2adb2471-d022-4c52-b85b-2e5651b1bd57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:29 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-0e02f747-400d-4733-a69a-0571530e73e0 tempest-VolumesExtendTest-1522498811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2adb2471-d022-4c52-b85b-2e5651b1bd57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:29 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-0e02f747-400d-4733-a69a-0571530e73e0 tempest-VolumesExtendTest-1522498811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eef46ba-5c84-4392-95b1-38313a77b561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:29 devstack cinder-volume[83106]: DEBUG cinder.image.glance [None req-0e02f747-400d-4733-a69a-0571530e73e0 tempest-VolumesExtendTest-1522498811 None] Creating Keystone auth plugin from conf {{(pid=83106) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Feb 27 01:28:30 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-0e02f747-400d-4733-a69a-0571530e73e0 tempest-VolumesExtendTest-1522498811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eef46ba-5c84-4392-95b1-38313a77b561) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f1c0bc5e-f805-4ac8-bf2e-0091b9c3e6d9', 'volume_name': 'volume-f1c0bc5e-f805-4ac8-bf2e-0091b9c3e6d9', 'volume_size': 1, 'image_id': '4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd105600f18404a29b5061e7b75a5bfe1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca', 'created_at': datetime.datetime(2026, 2, 27, 0, 17, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 17, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f07e8b738e0>}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:30 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-0e02f747-400d-4733-a69a-0571530e73e0 tempest-VolumesExtendTest-1522498811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08896b8c-5e4a-4d13-811b-c634f013cc55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:30 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-0e02f747-400d-4733-a69a-0571530e73e0 tempest-VolumesExtendTest-1522498811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08896b8c-5e4a-4d13-811b-c634f013cc55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:30 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-0e02f747-400d-4733-a69a-0571530e73e0 tempest-VolumesExtendTest-1522498811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7216bd4a-e2c8-403b-8073-38df2ac90ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:30 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-0e02f747-400d-4733-a69a-0571530e73e0 tempest-VolumesExtendTest-1522498811 None] Volume f1c0bc5e-f805-4ac8-bf2e-0091b9c3e6d9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f1c0bc5e-f805-4ac8-bf2e-0091b9c3e6d9', 'volume_size': 1, 'image_id': '4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd105600f18404a29b5061e7b75a5bfe1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca', 'created_at': datetime.datetime(2026, 2, 27, 0, 17, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 17, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f07e8b738e0>}
Feb 27 01:28:30 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e02f747-400d-4733-a69a-0571530e73e0 tempest-VolumesExtendTest-1522498811 None] Trying to clone f1c0bc5e-f805-4ac8-bf2e-0091b9c3e6d9 from image 4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca at location (None, [{'url': 'file:///opt/stack/data/glance/images/4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca', 'metadata': {}}]). {{(pid=83106) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Feb 27 01:28:30 devstack cinder-volume[83106]: DEBUG cinder.image.image_utils [None req-0e02f747-400d-4733-a69a-0571530e73e0 tempest-VolumesExtendTest-1522498811 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_07jdbl9qdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83106) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Feb 27 01:28:30 devstack cinder-volume[83106]: INFO cinder.image.image_utils [None req-0e02f747-400d-4733-a69a-0571530e73e0 tempest-VolumesExtendTest-1522498811 None] Image download 20.69 MB at 20.69 MB/s
Feb 27 01:28:30 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[459e3832-174a-4520-bd81-09c0d5a060e7]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:28:30 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0e02f747-400d-4733-a69a-0571530e73e0 tempest-VolumesExtendTest-1522498811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_07jdbl9qdevstack@QuobyteHD {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:31 devstack sudo[89248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_07jdbl9qdevstack@QuobyteHD
Feb 27 01:28:31 devstack sudo[89248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:31 devstack sudo[89235]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:31 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-8f71ea4f-86c6-4784-a8b7-96a1a7231f7c tempest-SnapshotDependencyTests-1761858054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-bccc90ad-e438-4ca5-bed0-8b9f926ced54" returned: 0 in 2.635s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:31 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f76e4b5-905a-45ab-93fa-63e8692c6dc1]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:28:31 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-8f71ea4f-86c6-4784-a8b7-96a1a7231f7c tempest-SnapshotDependencyTests-1761858054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:31 devstack sudo[89250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb
Feb 27 01:28:31 devstack sudo[89250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:31 devstack sudo[89248]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:31 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0e02f747-400d-4733-a69a-0571530e73e0 tempest-VolumesExtendTest-1522498811 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_07jdbl9qdevstack@QuobyteHD" returned: 0 in 0.602s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:31 devstack cinder-volume[83106]: DEBUG cinder.image.image_utils [None req-0e02f747-400d-4733-a69a-0571530e73e0 tempest-VolumesExtendTest-1522498811 None] Temporary image 4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca is fetched for user 4b48c3570a4b4ad89159f784f007d951. {{(pid=83106) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Feb 27 01:28:31 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[90182731-0806-40fb-85de-00e65205601e]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:28:31 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0e02f747-400d-4733-a69a-0571530e73e0 tempest-VolumesExtendTest-1522498811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_07jdbl9qdevstack@QuobyteHD {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:31 devstack sudo[89257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_07jdbl9qdevstack@QuobyteHD
Feb 27 01:28:31 devstack sudo[89257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:31 devstack sudo[89250]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:31 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-8f71ea4f-86c6-4784-a8b7-96a1a7231f7c tempest-SnapshotDependencyTests-1761858054 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb" returned: 0 in 0.784s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:31 devstack cinder-volume[83106]: DEBUG cinder.image.image_utils [None req-8f71ea4f-86c6-4784-a8b7-96a1a7231f7c tempest-SnapshotDependencyTests-1761858054 None] Image conversion details: src /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb, size 1024.00 MB, duration 2.64 sec, destination /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-bccc90ad-e438-4ca5-bed0-8b9f926ced54 {{(pid=83106) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 27 01:28:31 devstack cinder-volume[83106]: INFO cinder.image.image_utils [None req-8f71ea4f-86c6-4784-a8b7-96a1a7231f7c tempest-SnapshotDependencyTests-1761858054 None] Converted 1024.00 MB image at 388.39 MB/s
Feb 27 01:28:31 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-8f71ea4f-86c6-4784-a8b7-96a1a7231f7c tempest-SnapshotDependencyTests-1761858054 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-bccc90ad-e438-4ca5-bed0-8b9f926ced54 is being set with open permissions: ugo+rw
Feb 27 01:28:31 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-8f71ea4f-86c6-4784-a8b7-96a1a7231f7c tempest-SnapshotDependencyTests-1761858054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-bccc90ad-e438-4ca5-bed0-8b9f926ced54 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:31 devstack sudo[89260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-bccc90ad-e438-4ca5-bed0-8b9f926ced54
Feb 27 01:28:31 devstack sudo[89260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:32 devstack sudo[89257]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:32 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0e02f747-400d-4733-a69a-0571530e73e0 tempest-VolumesExtendTest-1522498811 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_07jdbl9qdevstack@QuobyteHD" returned: 0 in 0.588s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:32 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-0e02f747-400d-4733-a69a-0571530e73e0 tempest-VolumesExtendTest-1522498811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:28:32 devstack sudo[89260]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:32 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-8f71ea4f-86c6-4784-a8b7-96a1a7231f7c tempest-SnapshotDependencyTests-1761858054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-bccc90ad-e438-4ca5-bed0-8b9f926ced54" returned: 0 in 0.511s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:32 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-8f71ea4f-86c6-4784-a8b7-96a1a7231f7c tempest-SnapshotDependencyTests-1761858054 None] Lock "cinder-quobyte-bccc90ad-e438-4ca5-bed0-8b9f926ced54" released by "_copy_volume_from_snapshot" :: held 5.349s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:28:32 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-8f71ea4f-86c6-4784-a8b7-96a1a7231f7c tempest-SnapshotDependencyTests-1761858054 None] Lock "cinder-quobyte-bbd978a5-18ac-4e1e-b281-e69901f4a9d3-bccc90ad-e438-4ca5-bed0-8b9f926ced54" released by "_create_volume_from_snapshot" :: held 5.370s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:28:32 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-8f71ea4f-86c6-4784-a8b7-96a1a7231f7c tempest-SnapshotDependencyTests-1761858054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.381s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:28:32 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-0e02f747-400d-4733-a69a-0571530e73e0 tempest-VolumesExtendTest-1522498811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.177s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:28:32 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-0e02f747-400d-4733-a69a-0571530e73e0 tempest-VolumesExtendTest-1522498811 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:28:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1380404928',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1c0bc5e-f805-4ac8-bf2e-0091b9c3e6d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='580a8cc4200d4556a9c33bb0b614119a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:28:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:28:29Z,use_quota=True,user_id='4b48c3570a4b4ad89159f784f007d951',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:28:32 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-0e02f747-400d-4733-a69a-0571530e73e0 tempest-VolumesExtendTest-1522498811 None] Creating volume f1c0bc5e-f805-4ac8-bf2e-0091b9c3e6d9 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:28:32 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-0e02f747-400d-4733-a69a-0571530e73e0 tempest-VolumesExtendTest-1522498811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:28:32 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-0e02f747-400d-4733-a69a-0571530e73e0 tempest-VolumesExtendTest-1522498811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:28:32 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-0e02f747-400d-4733-a69a-0571530e73e0 tempest-VolumesExtendTest-1522498811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:28:32 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-0e02f747-400d-4733-a69a-0571530e73e0 tempest-VolumesExtendTest-1522498811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:28:32 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-0e02f747-400d-4733-a69a-0571530e73e0 tempest-VolumesExtendTest-1522498811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:28:32 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-0e02f747-400d-4733-a69a-0571530e73e0 tempest-VolumesExtendTest-1522498811 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:28:32 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-0e02f747-400d-4733-a69a-0571530e73e0 tempest-VolumesExtendTest-1522498811 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:28:32 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0e02f747-400d-4733-a69a-0571530e73e0 tempest-VolumesExtendTest-1522498811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f1c0bc5e-f805-4ac8-bf2e-0091b9c3e6d9 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:32 devstack sudo[89266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f1c0bc5e-f805-4ac8-bf2e-0091b9c3e6d9 1073741824
Feb 27 01:28:32 devstack sudo[89266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:32 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-8f71ea4f-86c6-4784-a8b7-96a1a7231f7c tempest-SnapshotDependencyTests-1761858054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3db5940-e62f-4cb9-a69c-3ea0041ff10d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bccc90ad-e438-4ca5-bed0-8b9f926ced54', 'volume_size': 1, 'snapshot_id': 'bbd978a5-18ac-4e1e-b281-e69901f4a9d3'}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:32 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-8f71ea4f-86c6-4784-a8b7-96a1a7231f7c tempest-SnapshotDependencyTests-1761858054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e0d34a8-8bcf-4768-874e-e19c90187a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:32 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-8f71ea4f-86c6-4784-a8b7-96a1a7231f7c tempest-SnapshotDependencyTests-1761858054 None] Volume volume-bccc90ad-e438-4ca5-bed0-8b9f926ced54 (bccc90ad-e438-4ca5-bed0-8b9f926ced54): created successfully
Feb 27 01:28:32 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-8f71ea4f-86c6-4784-a8b7-96a1a7231f7c tempest-SnapshotDependencyTests-1761858054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e0d34a8-8bcf-4768-874e-e19c90187a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:32 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-8f71ea4f-86c6-4784-a8b7-96a1a7231f7c tempest-SnapshotDependencyTests-1761858054 None] Flow 'volume_create_manager' (d7d22f17-04d4-4910-9e23-7fdab1ab9c49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:28:32 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-8f71ea4f-86c6-4784-a8b7-96a1a7231f7c tempest-SnapshotDependencyTests-1761858054 None] Created volume successfully.
Feb 27 01:28:32 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-17249d41-5a26-40f0-897b-fe39659754f7 tempest-VolumesActionsTest-1196644426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:28:33 devstack sudo[89266]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:33 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0e02f747-400d-4733-a69a-0571530e73e0 tempest-VolumesExtendTest-1522498811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f1c0bc5e-f805-4ac8-bf2e-0091b9c3e6d9 1073741824" returned: 0 in 0.599s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:33 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0e02f747-400d-4733-a69a-0571530e73e0 tempest-VolumesExtendTest-1522498811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f1c0bc5e-f805-4ac8-bf2e-0091b9c3e6d9 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:33 devstack sudo[89272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f1c0bc5e-f805-4ac8-bf2e-0091b9c3e6d9
Feb 27 01:28:33 devstack sudo[89272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:33 devstack sudo[89272]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:33 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0e02f747-400d-4733-a69a-0571530e73e0 tempest-VolumesExtendTest-1522498811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f1c0bc5e-f805-4ac8-bf2e-0091b9c3e6d9" returned: 0 in 0.526s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:33 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-0e02f747-400d-4733-a69a-0571530e73e0 tempest-VolumesExtendTest-1522498811 None] <== create_volume: return (1164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:28:33 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-0e02f747-400d-4733-a69a-0571530e73e0 tempest-VolumesExtendTest-1522498811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.167s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:28:33 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-17249d41-5a26-40f0-897b-fe39659754f7 tempest-VolumesActionsTest-1196644426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.925s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:28:33 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-2499d481-0ee7-4df1-b5b2-4a95bd6a6edc tempest-SnapshotDependencyTests-1761858054 None] Acquiring lock "cinder-bbd978a5-18ac-4e1e-b281-e69901f4a9d3-delete_snapshot" by "delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:28:33 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[92cdc798-a7e9-4b70-b822-edbc5d347583]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:28:33 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-17249d41-5a26-40f0-897b-fe39659754f7 tempest-VolumesActionsTest-1196644426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0b66dc01-1c7a-427d-b771-a85154916559 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:33 devstack cinder-volume[83106]: DEBUG cinder.volume.volume_utils [None req-0e02f747-400d-4733-a69a-0571530e73e0 tempest-VolumesExtendTest-1522498811 None] Attempting download of 4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca ((None, [{'url': 'file:///opt/stack/data/glance/images/4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca', 'metadata': {}}])) to volume f1c0bc5e-f805-4ac8-bf2e-0091b9c3e6d9. {{(pid=83106) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Feb 27 01:28:33 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-2499d481-0ee7-4df1-b5b2-4a95bd6a6edc tempest-SnapshotDependencyTests-1761858054 None] Lock "cinder-bbd978a5-18ac-4e1e-b281-e69901f4a9d3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:28:33 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-2499d481-0ee7-4df1-b5b2-4a95bd6a6edc tempest-SnapshotDependencyTests-1761858054 None] Acquiring lock "cinder-quobyte-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb" by "delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:28:33 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-2499d481-0ee7-4df1-b5b2-4a95bd6a6edc tempest-SnapshotDependencyTests-1761858054 None] Lock "cinder-quobyte-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:28:33 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-2499d481-0ee7-4df1-b5b2-4a95bd6a6edc tempest-SnapshotDependencyTests-1761858054 None] Acquiring lock "cinder-quobyte-bbd978a5-18ac-4e1e-b281-e69901f4a9d3" by "_delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:28:33 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-2499d481-0ee7-4df1-b5b2-4a95bd6a6edc tempest-SnapshotDependencyTests-1761858054 None] Lock "cinder-quobyte-bbd978a5-18ac-4e1e-b281-e69901f4a9d3" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:28:33 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-2499d481-0ee7-4df1-b5b2-4a95bd6a6edc tempest-SnapshotDependencyTests-1761858054 None] Deleting offline snapshot bbd978a5-18ac-4e1e-b281-e69901f4a9d3 of volume ae5ec85b-71ec-4f16-99d3-d53d028cbdeb {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:28:33 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-2499d481-0ee7-4df1-b5b2-4a95bd6a6edc tempest-SnapshotDependencyTests-1761858054 None] snapshot_file for this snap is: volume-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb.bbd978a5-18ac-4e1e-b281-e69901f4a9d3 {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:28:33 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1742ba-bf80-42df-9908-848bbe036fc8]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:28:33 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-2499d481-0ee7-4df1-b5b2-4a95bd6a6edc tempest-SnapshotDependencyTests-1761858054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb.bbd978a5-18ac-4e1e-b281-e69901f4a9d3 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:33 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[c804b031-56a6-477e-b081-bdebf460e519]: (4, 'raw') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:28:33 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0e02f747-400d-4733-a69a-0571530e73e0 tempest-VolumesExtendTest-1522498811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_rp6y5pfs {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:33 devstack sudo[89275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0b66dc01-1c7a-427d-b771-a85154916559
Feb 27 01:28:33 devstack sudo[89275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:33 devstack sudo[89276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb.bbd978a5-18ac-4e1e-b281-e69901f4a9d3
Feb 27 01:28:33 devstack sudo[89276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:33 devstack sudo[89277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_rp6y5pfs
Feb 27 01:28:33 devstack sudo[89277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:34 devstack sudo[89275]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:34 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-17249d41-5a26-40f0-897b-fe39659754f7 tempest-VolumesActionsTest-1196644426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0b66dc01-1c7a-427d-b771-a85154916559" returned: 0 in 0.655s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:34 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae624444-44fd-4331-a7fa-0e680c20609a]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:28:34 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-17249d41-5a26-40f0-897b-fe39659754f7 tempest-VolumesActionsTest-1196644426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0b66dc01-1c7a-427d-b771-a85154916559 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:34 devstack sudo[89277]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:34 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0e02f747-400d-4733-a69a-0571530e73e0 tempest-VolumesExtendTest-1522498811 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_rp6y5pfs" returned: 0 in 0.581s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:34 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0e02f747-400d-4733-a69a-0571530e73e0 tempest-VolumesExtendTest-1522498811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_rp6y5pfs {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:34 devstack sudo[89276]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:34 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-2499d481-0ee7-4df1-b5b2-4a95bd6a6edc tempest-SnapshotDependencyTests-1761858054 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb.bbd978a5-18ac-4e1e-b281-e69901f4a9d3" returned: 0 in 0.661s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:34 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-2499d481-0ee7-4df1-b5b2-4a95bd6a6edc tempest-SnapshotDependencyTests-1761858054 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83106) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:28:34 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[5097d994-28b2-4e55-998a-fd5e6379531a]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:28:34 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-2499d481-0ee7-4df1-b5b2-4a95bd6a6edc tempest-SnapshotDependencyTests-1761858054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:34 devstack sudo[89289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0b66dc01-1c7a-427d-b771-a85154916559
Feb 27 01:28:34 devstack sudo[89289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:34 devstack sudo[89290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_rp6y5pfs
Feb 27 01:28:34 devstack sudo[89290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:34 devstack sudo[89291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb
Feb 27 01:28:34 devstack sudo[89291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:34 devstack sudo[89289]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:34 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-17249d41-5a26-40f0-897b-fe39659754f7 tempest-VolumesActionsTest-1196644426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0b66dc01-1c7a-427d-b771-a85154916559" returned: 0 in 0.572s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:34 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-17249d41-5a26-40f0-897b-fe39659754f7 tempest-VolumesActionsTest-1196644426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0b66dc01-1c7a-427d-b771-a85154916559 /opt/stack/data/cinder/conversion/0b66dc01-1c7a-427d-b771-a85154916559.temp_image.9acf1e18-997b-481e-b8e1-a501c03a9476ecyv1n_c.img {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:34 devstack sudo[89290]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:34 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0e02f747-400d-4733-a69a-0571530e73e0 tempest-VolumesExtendTest-1522498811 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_rp6y5pfs" returned: 1 in 0.567s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:34 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0e02f747-400d-4733-a69a-0571530e73e0 tempest-VolumesExtendTest-1522498811 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_rp6y5pfs' failed. Not Retrying. {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 27 01:28:34 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[900e5d72-5fbf-42fe-81a8-e07d4e4db91b]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:28:34 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0e02f747-400d-4733-a69a-0571530e73e0 tempest-VolumesExtendTest-1522498811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_07jdbl9qdevstack@QuobyteHD {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:34 devstack sudo[89302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0b66dc01-1c7a-427d-b771-a85154916559 /opt/stack/data/cinder/conversion/0b66dc01-1c7a-427d-b771-a85154916559.temp_image.9acf1e18-997b-481e-b8e1-a501c03a9476ecyv1n_c.img
Feb 27 01:28:34 devstack sudo[89302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:34 devstack sudo[89304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_07jdbl9qdevstack@QuobyteHD
Feb 27 01:28:34 devstack sudo[89304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:34 devstack sudo[89291]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:34 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-2499d481-0ee7-4df1-b5b2-4a95bd6a6edc tempest-SnapshotDependencyTests-1761858054 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb" returned: 0 in 0.618s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:34 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-2499d481-0ee7-4df1-b5b2-4a95bd6a6edc tempest-SnapshotDependencyTests-1761858054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb.bbd978a5-18ac-4e1e-b281-e69901f4a9d3 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:35 devstack sudo[89307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb.bbd978a5-18ac-4e1e-b281-e69901f4a9d3
Feb 27 01:28:35 devstack sudo[89307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:36 devstack sudo[89304]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:36 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0e02f747-400d-4733-a69a-0571530e73e0 tempest-VolumesExtendTest-1522498811 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_07jdbl9qdevstack@QuobyteHD" returned: 0 in 1.288s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:36 devstack cinder-volume[83106]: DEBUG cinder.image.image_utils [None req-0e02f747-400d-4733-a69a-0571530e73e0 tempest-VolumesExtendTest-1522498811 None] 4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca was qcow2, converting to raw {{(pid=83106) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Feb 27 01:28:36 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0e02f747-400d-4733-a69a-0571530e73e0 tempest-VolumesExtendTest-1522498811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_07jdbl9qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f1c0bc5e-f805-4ac8-bf2e-0091b9c3e6d9 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:36 devstack sudo[89307]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:36 devstack sudo[89332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_07jdbl9qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f1c0bc5e-f805-4ac8-bf2e-0091b9c3e6d9
Feb 27 01:28:36 devstack sudo[89332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:36 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-2499d481-0ee7-4df1-b5b2-4a95bd6a6edc tempest-SnapshotDependencyTests-1761858054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb.bbd978a5-18ac-4e1e-b281-e69901f4a9d3" returned: 0 in 1.252s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:36 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-2499d481-0ee7-4df1-b5b2-4a95bd6a6edc tempest-SnapshotDependencyTests-1761858054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb.bbd978a5-18ac-4e1e-b281-e69901f4a9d3 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:36 devstack sudo[89334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb.bbd978a5-18ac-4e1e-b281-e69901f4a9d3
Feb 27 01:28:36 devstack sudo[89334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:37 devstack sudo[89302]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-17249d41-5a26-40f0-897b-fe39659754f7 tempest-VolumesActionsTest-1196644426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0b66dc01-1c7a-427d-b771-a85154916559 /opt/stack/data/cinder/conversion/0b66dc01-1c7a-427d-b771-a85154916559.temp_image.9acf1e18-997b-481e-b8e1-a501c03a9476ecyv1n_c.img" returned: 0 in 2.462s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:37 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[a634fd7d-282b-4dc8-b588-19ce9f469e43]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:28:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-17249d41-5a26-40f0-897b-fe39659754f7 tempest-VolumesActionsTest-1196644426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0b66dc01-1c7a-427d-b771-a85154916559 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:37 devstack sudo[89339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0b66dc01-1c7a-427d-b771-a85154916559
Feb 27 01:28:37 devstack sudo[89339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:37 devstack sudo[89334]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-2499d481-0ee7-4df1-b5b2-4a95bd6a6edc tempest-SnapshotDependencyTests-1761858054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb.bbd978a5-18ac-4e1e-b281-e69901f4a9d3" returned: 0 in 1.236s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:37 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-2499d481-0ee7-4df1-b5b2-4a95bd6a6edc tempest-SnapshotDependencyTests-1761858054 None] Lock "cinder-quobyte-bbd978a5-18ac-4e1e-b281-e69901f4a9d3" released by "_delete_snapshot" :: held 3.843s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:28:37 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-2499d481-0ee7-4df1-b5b2-4a95bd6a6edc tempest-SnapshotDependencyTests-1761858054 None] Lock "cinder-quobyte-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb" released by "delete_snapshot" :: held 3.859s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:28:37 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-2499d481-0ee7-4df1-b5b2-4a95bd6a6edc tempest-SnapshotDependencyTests-1761858054 None] Created reservations ['c6623d49-824d-49ad-baaf-1091d7c6965b', '0c6dd41b-b0cc-48d8-b5eb-898b6540508a', '6b96a6c7-8231-4f79-90a5-64844c2a2bc6', '2f1c257f-784e-4c2b-816a-5108da5e274a'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:28:37 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-2499d481-0ee7-4df1-b5b2-4a95bd6a6edc tempest-SnapshotDependencyTests-1761858054 None] Delete snapshot completed successfully.
Feb 27 01:28:37 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-2499d481-0ee7-4df1-b5b2-4a95bd6a6edc tempest-SnapshotDependencyTests-1761858054 None] Lock "cinder-bbd978a5-18ac-4e1e-b281-e69901f4a9d3-delete_snapshot" released by "delete_snapshot" :: held 4.005s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:28:37 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-cd04f835-5d42-4291-bc45-f8b6da6d0eca tempest-SnapshotDependencyTests-1761858054 None] Acquiring lock "cinder-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:28:37 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-cd04f835-5d42-4291-bc45-f8b6da6d0eca tempest-SnapshotDependencyTests-1761858054 None] Lock "cinder-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:28:37 devstack sudo[89332]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0e02f747-400d-4733-a69a-0571530e73e0 tempest-VolumesExtendTest-1522498811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_07jdbl9qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f1c0bc5e-f805-4ac8-bf2e-0091b9c3e6d9" returned: 0 in 1.744s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:37 devstack cinder-volume[83106]: DEBUG cinder.image.image_utils [None req-0e02f747-400d-4733-a69a-0571530e73e0 tempest-VolumesExtendTest-1522498811 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_07jdbl9qdevstack@QuobyteHD, size 112.00 MB, duration 1.75 sec, destination /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f1c0bc5e-f805-4ac8-bf2e-0091b9c3e6d9 {{(pid=83106) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 27 01:28:37 devstack cinder-volume[83106]: INFO cinder.image.image_utils [None req-0e02f747-400d-4733-a69a-0571530e73e0 tempest-VolumesExtendTest-1522498811 None] Converted 112.00 MB image at 64.08 MB/s
Feb 27 01:28:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0e02f747-400d-4733-a69a-0571530e73e0 tempest-VolumesExtendTest-1522498811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f1c0bc5e-f805-4ac8-bf2e-0091b9c3e6d9 1G {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:37 devstack sudo[89355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f1c0bc5e-f805-4ac8-bf2e-0091b9c3e6d9 1G
Feb 27 01:28:37 devstack sudo[89355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:37 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-cd04f835-5d42-4291-bc45-f8b6da6d0eca tempest-SnapshotDependencyTests-1761858054 None] Acquiring lock "cinder-quobyte-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:28:37 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-cd04f835-5d42-4291-bc45-f8b6da6d0eca tempest-SnapshotDependencyTests-1761858054 None] Lock "cinder-quobyte-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb" acquired by "delete_volume" :: waited 0.011s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:28:37 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7aa9593-3ae2-4e93-85ab-1811bcdd828b]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:28:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-cd04f835-5d42-4291-bc45-f8b6da6d0eca tempest-SnapshotDependencyTests-1761858054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:38 devstack sudo[89357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb
Feb 27 01:28:38 devstack sudo[89357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:38 devstack sudo[89339]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:38 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-17249d41-5a26-40f0-897b-fe39659754f7 tempest-VolumesActionsTest-1196644426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0b66dc01-1c7a-427d-b771-a85154916559" returned: 0 in 0.793s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:38 devstack cinder-volume[83106]: DEBUG cinder.image.image_utils [None req-17249d41-5a26-40f0-897b-fe39659754f7 tempest-VolumesActionsTest-1196644426 None] Image conversion details: src /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0b66dc01-1c7a-427d-b771-a85154916559, size 1024.00 MB, duration 2.46 sec, destination /opt/stack/data/cinder/conversion/0b66dc01-1c7a-427d-b771-a85154916559.temp_image.9acf1e18-997b-481e-b8e1-a501c03a9476ecyv1n_c.img {{(pid=83106) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 27 01:28:38 devstack cinder-volume[83106]: INFO cinder.image.image_utils [None req-17249d41-5a26-40f0-897b-fe39659754f7 tempest-VolumesActionsTest-1196644426 None] Converted 1024.00 MB image at 415.69 MB/s
Feb 27 01:28:38 devstack cinder-volume[83106]: DEBUG cinder.image.image_utils [None req-17249d41-5a26-40f0-897b-fe39659754f7 tempest-VolumesActionsTest-1196644426 None] 9acf1e18-997b-481e-b8e1-a501c03a9476 was raw, no need to convert to raw {{(pid=83106) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}}
Feb 27 01:28:38 devstack sudo[89355]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:38 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0e02f747-400d-4733-a69a-0571530e73e0 tempest-VolumesExtendTest-1522498811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f1c0bc5e-f805-4ac8-bf2e-0091b9c3e6d9 1G" returned: 0 in 0.495s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:38 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[0613ed58-0f44-4c0d-8efc-830c0caea0d9]: (4, 'raw') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:28:38 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0e02f747-400d-4733-a69a-0571530e73e0 tempest-VolumesExtendTest-1522498811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f1c0bc5e-f805-4ac8-bf2e-0091b9c3e6d9 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:38 devstack sudo[89363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f1c0bc5e-f805-4ac8-bf2e-0091b9c3e6d9
Feb 27 01:28:38 devstack sudo[89363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:38 devstack sudo[89357]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:38 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-cd04f835-5d42-4291-bc45-f8b6da6d0eca tempest-SnapshotDependencyTests-1761858054 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb" returned: 0 in 0.579s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:38 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-cd04f835-5d42-4291-bc45-f8b6da6d0eca tempest-SnapshotDependencyTests-1761858054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:38 devstack sudo[89368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb
Feb 27 01:28:38 devstack sudo[89368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:39 devstack sudo[89368]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-cd04f835-5d42-4291-bc45-f8b6da6d0eca tempest-SnapshotDependencyTests-1761858054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb" returned: 0 in 0.451s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:39 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-cd04f835-5d42-4291-bc45-f8b6da6d0eca tempest-SnapshotDependencyTests-1761858054 None] Lock "cinder-quobyte-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb" released by "delete_volume" :: held 1.073s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:28:39 devstack sudo[89363]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0e02f747-400d-4733-a69a-0571530e73e0 tempest-VolumesExtendTest-1522498811 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f1c0bc5e-f805-4ac8-bf2e-0091b9c3e6d9" returned: 0 in 0.637s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0e02f747-400d-4733-a69a-0571530e73e0 tempest-VolumesExtendTest-1522498811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f1c0bc5e-f805-4ac8-bf2e-0091b9c3e6d9 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:39 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-cd04f835-5d42-4291-bc45-f8b6da6d0eca tempest-SnapshotDependencyTests-1761858054 None] Created reservations ['3d442346-6950-4219-8b3d-4263eaaa55f0', '00e5943d-0e7c-49ba-bbc8-4db1a2635f43', '08897e4b-f58f-49b6-afb4-a0d0a93f7f34', 'ecb77287-e776-4e14-9e4a-31f63cf29165'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:28:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-cd04f835-5d42-4291-bc45-f8b6da6d0eca tempest-SnapshotDependencyTests-1761858054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:28:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-cd04f835-5d42-4291-bc45-f8b6da6d0eca tempest-SnapshotDependencyTests-1761858054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:28:39 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-cd04f835-5d42-4291-bc45-f8b6da6d0eca tempest-SnapshotDependencyTests-1761858054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:28:39 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-cd04f835-5d42-4291-bc45-f8b6da6d0eca tempest-SnapshotDependencyTests-1761858054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:28:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-cd04f835-5d42-4291-bc45-f8b6da6d0eca tempest-SnapshotDependencyTests-1761858054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:28:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-cd04f835-5d42-4291-bc45-f8b6da6d0eca tempest-SnapshotDependencyTests-1761858054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:39 devstack sudo[89373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f1c0bc5e-f805-4ac8-bf2e-0091b9c3e6d9
Feb 27 01:28:39 devstack sudo[89373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:39 devstack sudo[89375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:28:39 devstack sudo[89375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:39 devstack sudo[89375]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-cd04f835-5d42-4291-bc45-f8b6da6d0eca tempest-SnapshotDependencyTests-1761858054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.460s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:39 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-cd04f835-5d42-4291-bc45-f8b6da6d0eca tempest-SnapshotDependencyTests-1761858054 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:28:39 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-cd04f835-5d42-4291-bc45-f8b6da6d0eca tempest-SnapshotDependencyTests-1761858054 None] Deleted volume successfully.
Feb 27 01:28:39 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-cd04f835-5d42-4291-bc45-f8b6da6d0eca tempest-SnapshotDependencyTests-1761858054 None] Lock "cinder-ae5ec85b-71ec-4f16-99d3-d53d028cbdeb-delete_volume" released by "delete_volume" :: held 1.749s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:28:39 devstack sudo[89373]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0e02f747-400d-4733-a69a-0571530e73e0 tempest-VolumesExtendTest-1522498811 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f1c0bc5e-f805-4ac8-bf2e-0091b9c3e6d9" returned: 1 in 0.584s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0e02f747-400d-4733-a69a-0571530e73e0 tempest-VolumesExtendTest-1522498811 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f1c0bc5e-f805-4ac8-bf2e-0091b9c3e6d9' failed. Not Retrying. {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 27 01:28:39 devstack cinder-volume[83106]: DEBUG cinder.volume.volume_utils [None req-0e02f747-400d-4733-a69a-0571530e73e0 tempest-VolumesExtendTest-1522498811 None] Downloaded image 4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca ((None, [{'url': 'file:///opt/stack/data/glance/images/4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca', 'metadata': {}}])) to volume f1c0bc5e-f805-4ac8-bf2e-0091b9c3e6d9 successfully. {{(pid=83106) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Feb 27 01:28:39 devstack cinder-volume[83106]: DEBUG cinder.image.image_utils [None req-0e02f747-400d-4733-a69a-0571530e73e0 tempest-VolumesExtendTest-1522498811 None] Temporary image 4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca for user 4b48c3570a4b4ad89159f784f007d951 is deleted. {{(pid=83106) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Feb 27 01:28:39 devstack cinder-volume[83106]: DEBUG cinder.volume.volume_utils [None req-0e02f747-400d-4733-a69a-0571530e73e0 tempest-VolumesExtendTest-1522498811 None] Marking volume f1c0bc5e-f805-4ac8-bf2e-0091b9c3e6d9 as bootable. {{(pid=83106) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Feb 27 01:28:39 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e02f747-400d-4733-a69a-0571530e73e0 tempest-VolumesExtendTest-1522498811 None] Copying metadata from image 4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca to f1c0bc5e-f805-4ac8-bf2e-0091b9c3e6d9. {{(pid=83106) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Feb 27 01:28:39 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e02f747-400d-4733-a69a-0571530e73e0 tempest-VolumesExtendTest-1522498811 None] Creating volume glance metadata for volume f1c0bc5e-f805-4ac8-bf2e-0091b9c3e6d9 backed by image 4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83106) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Feb 27 01:28:39 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-0e02f747-400d-4733-a69a-0571530e73e0 tempest-VolumesExtendTest-1522498811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7216bd4a-e2c8-403b-8073-38df2ac90ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1c0bc5e-f805-4ac8-bf2e-0091b9c3e6d9', 'volume_size': 1, 'image_id': '4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd105600f18404a29b5061e7b75a5bfe1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca', 'created_at': datetime.datetime(2026, 2, 27, 0, 17, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 17, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f07e8b738e0>}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:39 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-0e02f747-400d-4733-a69a-0571530e73e0 tempest-VolumesExtendTest-1522498811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b46c9d51-a58a-40d4-af96-3412059b0697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:39 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-0e02f747-400d-4733-a69a-0571530e73e0 tempest-VolumesExtendTest-1522498811 None] Volume volume-f1c0bc5e-f805-4ac8-bf2e-0091b9c3e6d9 (f1c0bc5e-f805-4ac8-bf2e-0091b9c3e6d9): created successfully
Feb 27 01:28:39 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-0e02f747-400d-4733-a69a-0571530e73e0 tempest-VolumesExtendTest-1522498811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b46c9d51-a58a-40d4-af96-3412059b0697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:39 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-0e02f747-400d-4733-a69a-0571530e73e0 tempest-VolumesExtendTest-1522498811 None] Flow 'volume_create_manager' (f6f94cc8-f3d5-483e-a1f0-5b68dec21dd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:28:39 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-0e02f747-400d-4733-a69a-0571530e73e0 tempest-VolumesExtendTest-1522498811 None] Created volume successfully.
Feb 27 01:28:40 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-fd2020e2-98e5-428d-89f7-a16e4420f022 tempest-SnapshotDependencyTests-1761858054 None] Acquiring lock "cinder-bccc90ad-e438-4ca5-bed0-8b9f926ced54-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:28:40 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-d3de333c-ccb4-462c-b513-a3d8fa309dc8 tempest-VolumesExtendTest-1522498811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:28:40 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-fd2020e2-98e5-428d-89f7-a16e4420f022 tempest-SnapshotDependencyTests-1761858054 None] Lock "cinder-bccc90ad-e438-4ca5-bed0-8b9f926ced54-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:28:40 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-fd2020e2-98e5-428d-89f7-a16e4420f022 tempest-SnapshotDependencyTests-1761858054 None] Acquiring lock "cinder-quobyte-bccc90ad-e438-4ca5-bed0-8b9f926ced54" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:28:40 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-fd2020e2-98e5-428d-89f7-a16e4420f022 tempest-SnapshotDependencyTests-1761858054 None] Lock "cinder-quobyte-bccc90ad-e438-4ca5-bed0-8b9f926ced54" acquired by "delete_volume" :: waited 0.009s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:28:40 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[89410ff3-4fe0-4e5b-b4d8-7ddfad2668a9]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:28:40 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-fd2020e2-98e5-428d-89f7-a16e4420f022 tempest-SnapshotDependencyTests-1761858054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-bccc90ad-e438-4ca5-bed0-8b9f926ced54 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:40 devstack sudo[89381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-bccc90ad-e438-4ca5-bed0-8b9f926ced54
Feb 27 01:28:40 devstack sudo[89381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:40 devstack sudo[89381]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:40 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-fd2020e2-98e5-428d-89f7-a16e4420f022 tempest-SnapshotDependencyTests-1761858054 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-bccc90ad-e438-4ca5-bed0-8b9f926ced54" returned: 0 in 0.535s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:40 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-fd2020e2-98e5-428d-89f7-a16e4420f022 tempest-SnapshotDependencyTests-1761858054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-bccc90ad-e438-4ca5-bed0-8b9f926ced54 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:40 devstack sudo[89386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-bccc90ad-e438-4ca5-bed0-8b9f926ced54
Feb 27 01:28:40 devstack sudo[89386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:41 devstack sudo[89386]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:41 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-fd2020e2-98e5-428d-89f7-a16e4420f022 tempest-SnapshotDependencyTests-1761858054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-bccc90ad-e438-4ca5-bed0-8b9f926ced54" returned: 0 in 0.441s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:41 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-fd2020e2-98e5-428d-89f7-a16e4420f022 tempest-SnapshotDependencyTests-1761858054 None] Lock "cinder-quobyte-bccc90ad-e438-4ca5-bed0-8b9f926ced54" released by "delete_volume" :: held 1.007s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:28:41 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-fd2020e2-98e5-428d-89f7-a16e4420f022 tempest-SnapshotDependencyTests-1761858054 None] Created reservations ['417abdc9-2108-475d-b6d7-55721dc7edee', 'd79f7ef0-e03a-4415-bd3b-ba2949094cdb', '697961c4-7b4f-43d5-a334-f72865846502', 'd631a3b5-f53f-4b1d-99cd-73dbf7abacda'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:28:41 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-fd2020e2-98e5-428d-89f7-a16e4420f022 tempest-SnapshotDependencyTests-1761858054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:28:41 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-fd2020e2-98e5-428d-89f7-a16e4420f022 tempest-SnapshotDependencyTests-1761858054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:28:41 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-fd2020e2-98e5-428d-89f7-a16e4420f022 tempest-SnapshotDependencyTests-1761858054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:28:41 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-fd2020e2-98e5-428d-89f7-a16e4420f022 tempest-SnapshotDependencyTests-1761858054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:28:41 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-fd2020e2-98e5-428d-89f7-a16e4420f022 tempest-SnapshotDependencyTests-1761858054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:28:41 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-fd2020e2-98e5-428d-89f7-a16e4420f022 tempest-SnapshotDependencyTests-1761858054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:41 devstack sudo[89389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:28:41 devstack sudo[89389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:41 devstack sudo[89389]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:41 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-fd2020e2-98e5-428d-89f7-a16e4420f022 tempest-SnapshotDependencyTests-1761858054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.420s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:41 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-fd2020e2-98e5-428d-89f7-a16e4420f022 tempest-SnapshotDependencyTests-1761858054 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:28:41 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-fd2020e2-98e5-428d-89f7-a16e4420f022 tempest-SnapshotDependencyTests-1761858054 None] Deleted volume successfully.
Feb 27 01:28:41 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-fd2020e2-98e5-428d-89f7-a16e4420f022 tempest-SnapshotDependencyTests-1761858054 None] Lock "cinder-bccc90ad-e438-4ca5-bed0-8b9f926ced54-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:28:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-17249d41-5a26-40f0-897b-fe39659754f7 tempest-VolumesActionsTest-1196644426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 15.591s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:28:49 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-17249d41-5a26-40f0-897b-fe39659754f7 tempest-VolumesActionsTest-1196644426 None] Uploaded volume to glance image-id: 9acf1e18-997b-481e-b8e1-a501c03a9476. {{(pid=83106) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Feb 27 01:28:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-d3de333c-ccb4-462c-b513-a3d8fa309dc8 tempest-VolumesExtendTest-1522498811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 9.080s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:28:49 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-17249d41-5a26-40f0-897b-fe39659754f7 tempest-VolumesActionsTest-1196644426 None] Copy volume to image completed successfully.
Feb 27 01:28:49 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[085cac16-b97f-48f6-b886-72aa1f16c0f3]: (4, 'raw') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:28:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d3de333c-ccb4-462c-b513-a3d8fa309dc8 tempest-VolumesExtendTest-1522498811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f1c0bc5e-f805-4ac8-bf2e-0091b9c3e6d9 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:49 devstack sudo[89397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f1c0bc5e-f805-4ac8-bf2e-0091b9c3e6d9
Feb 27 01:28:49 devstack sudo[89397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:49 devstack sudo[89397]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d3de333c-ccb4-462c-b513-a3d8fa309dc8 tempest-VolumesExtendTest-1522498811 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f1c0bc5e-f805-4ac8-bf2e-0091b9c3e6d9" returned: 0 in 0.495s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d3de333c-ccb4-462c-b513-a3d8fa309dc8 tempest-VolumesExtendTest-1522498811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f1c0bc5e-f805-4ac8-bf2e-0091b9c3e6d9 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:49 devstack sudo[89401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f1c0bc5e-f805-4ac8-bf2e-0091b9c3e6d9
Feb 27 01:28:49 devstack sudo[89401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:50 devstack sudo[89401]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:50 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d3de333c-ccb4-462c-b513-a3d8fa309dc8 tempest-VolumesExtendTest-1522498811 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f1c0bc5e-f805-4ac8-bf2e-0091b9c3e6d9" returned: 1 in 0.502s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:50 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d3de333c-ccb4-462c-b513-a3d8fa309dc8 tempest-VolumesExtendTest-1522498811 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f1c0bc5e-f805-4ac8-bf2e-0091b9c3e6d9' failed. Not Retrying. {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 27 01:28:50 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d3de333c-ccb4-462c-b513-a3d8fa309dc8 tempest-VolumesExtendTest-1522498811 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f1c0bc5e-f805-4ac8-bf2e-0091b9c3e6d9 2G {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:50 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d3de333c-ccb4-462c-b513-a3d8fa309dc8 tempest-VolumesExtendTest-1522498811 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f1c0bc5e-f805-4ac8-bf2e-0091b9c3e6d9 2G" returned: 0 in 0.089s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:50 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-d3de333c-ccb4-462c-b513-a3d8fa309dc8 tempest-VolumesExtendTest-1522498811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.130s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:28:50 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-d3de333c-ccb4-462c-b513-a3d8fa309dc8 tempest-VolumesExtendTest-1522498811 None] Extend volume completed successfully.
Feb 27 01:28:50 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-71fbda33-f4ed-47b7-ba5f-2936e74eecd6 tempest-VolumesExtendTest-1522498811 None] Acquiring lock "cinder-f1c0bc5e-f805-4ac8-bf2e-0091b9c3e6d9-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:28:50 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-71fbda33-f4ed-47b7-ba5f-2936e74eecd6 tempest-VolumesExtendTest-1522498811 None] Lock "cinder-f1c0bc5e-f805-4ac8-bf2e-0091b9c3e6d9-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:28:50 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-71fbda33-f4ed-47b7-ba5f-2936e74eecd6 tempest-VolumesExtendTest-1522498811 None] Acquiring lock "cinder-quobyte-f1c0bc5e-f805-4ac8-bf2e-0091b9c3e6d9" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:28:50 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-71fbda33-f4ed-47b7-ba5f-2936e74eecd6 tempest-VolumesExtendTest-1522498811 None] Lock "cinder-quobyte-f1c0bc5e-f805-4ac8-bf2e-0091b9c3e6d9" acquired by "delete_volume" :: waited 0.015s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:28:50 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf672feb-b1f8-424c-ba17-c4c3792795d8]: (4, 'raw') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:28:50 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-71fbda33-f4ed-47b7-ba5f-2936e74eecd6 tempest-VolumesExtendTest-1522498811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f1c0bc5e-f805-4ac8-bf2e-0091b9c3e6d9 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:51 devstack sudo[89409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f1c0bc5e-f805-4ac8-bf2e-0091b9c3e6d9
Feb 27 01:28:51 devstack sudo[89409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:51 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-24099f0f-83d5-40fe-a3fc-58abbb2262ed tempest-VolumesActionsTest-1196644426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:28:51 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-24099f0f-83d5-40fe-a3fc-58abbb2262ed tempest-VolumesActionsTest-1196644426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:28:51 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[453c710f-2d96-46a0-927e-bea34fcf44e6]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:28:51 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-24099f0f-83d5-40fe-a3fc-58abbb2262ed tempest-VolumesActionsTest-1196644426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0b66dc01-1c7a-427d-b771-a85154916559 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:51 devstack sudo[89411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0b66dc01-1c7a-427d-b771-a85154916559
Feb 27 01:28:51 devstack sudo[89411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:51 devstack sudo[89409]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:51 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-71fbda33-f4ed-47b7-ba5f-2936e74eecd6 tempest-VolumesExtendTest-1522498811 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f1c0bc5e-f805-4ac8-bf2e-0091b9c3e6d9" returned: 0 in 0.590s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:51 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-71fbda33-f4ed-47b7-ba5f-2936e74eecd6 tempest-VolumesExtendTest-1522498811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f1c0bc5e-f805-4ac8-bf2e-0091b9c3e6d9 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:51 devstack sudo[89411]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:51 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-24099f0f-83d5-40fe-a3fc-58abbb2262ed tempest-VolumesActionsTest-1196644426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0b66dc01-1c7a-427d-b771-a85154916559" returned: 0 in 0.486s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:51 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[2955478b-8f65-459a-a26d-87d338f95c3e]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:28:51 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-24099f0f-83d5-40fe-a3fc-58abbb2262ed tempest-VolumesActionsTest-1196644426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0b66dc01-1c7a-427d-b771-a85154916559 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:51 devstack sudo[89418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f1c0bc5e-f805-4ac8-bf2e-0091b9c3e6d9
Feb 27 01:28:51 devstack sudo[89418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:51 devstack sudo[89419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0b66dc01-1c7a-427d-b771-a85154916559
Feb 27 01:28:51 devstack sudo[89419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:52 devstack sudo[89418]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:52 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-71fbda33-f4ed-47b7-ba5f-2936e74eecd6 tempest-VolumesExtendTest-1522498811 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f1c0bc5e-f805-4ac8-bf2e-0091b9c3e6d9" returned: 1 in 0.490s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:52 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-71fbda33-f4ed-47b7-ba5f-2936e74eecd6 tempest-VolumesExtendTest-1522498811 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f1c0bc5e-f805-4ac8-bf2e-0091b9c3e6d9' failed. Not Retrying. {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 27 01:28:52 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-71fbda33-f4ed-47b7-ba5f-2936e74eecd6 tempest-VolumesExtendTest-1522498811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f1c0bc5e-f805-4ac8-bf2e-0091b9c3e6d9 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:52 devstack sudo[89425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f1c0bc5e-f805-4ac8-bf2e-0091b9c3e6d9
Feb 27 01:28:52 devstack sudo[89425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:52 devstack sudo[89419]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:52 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-24099f0f-83d5-40fe-a3fc-58abbb2262ed tempest-VolumesActionsTest-1196644426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0b66dc01-1c7a-427d-b771-a85154916559" returned: 0 in 0.552s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:52 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-24099f0f-83d5-40fe-a3fc-58abbb2262ed tempest-VolumesActionsTest-1196644426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0b66dc01-1c7a-427d-b771-a85154916559 /opt/stack/data/cinder/conversion/0b66dc01-1c7a-427d-b771-a85154916559.temp_image.5eeed060-eeb2-4065-8ba8-172d79d04334jwpu35qk.img {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:52 devstack sudo[89430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0b66dc01-1c7a-427d-b771-a85154916559 /opt/stack/data/cinder/conversion/0b66dc01-1c7a-427d-b771-a85154916559.temp_image.5eeed060-eeb2-4065-8ba8-172d79d04334jwpu35qk.img
Feb 27 01:28:52 devstack sudo[89430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:52 devstack sudo[89425]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:52 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-71fbda33-f4ed-47b7-ba5f-2936e74eecd6 tempest-VolumesExtendTest-1522498811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f1c0bc5e-f805-4ac8-bf2e-0091b9c3e6d9" returned: 0 in 0.455s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:52 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-71fbda33-f4ed-47b7-ba5f-2936e74eecd6 tempest-VolumesExtendTest-1522498811 None] Lock "cinder-quobyte-f1c0bc5e-f805-4ac8-bf2e-0091b9c3e6d9" released by "delete_volume" :: held 1.596s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:28:52 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-71fbda33-f4ed-47b7-ba5f-2936e74eecd6 tempest-VolumesExtendTest-1522498811 None] Created reservations ['e28a0f76-e816-4c87-a3d2-08a6c0a327e7', '0bf3922a-e4b9-4177-a665-4d7f2fa750a7', 'ebfb5718-f4a6-4e71-b0dd-08af9fc868a5', 'b1348c08-6b1d-40f0-8978-0bf9906a3adb'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:28:52 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-71fbda33-f4ed-47b7-ba5f-2936e74eecd6 tempest-VolumesExtendTest-1522498811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:28:52 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-71fbda33-f4ed-47b7-ba5f-2936e74eecd6 tempest-VolumesExtendTest-1522498811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:28:52 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-71fbda33-f4ed-47b7-ba5f-2936e74eecd6 tempest-VolumesExtendTest-1522498811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:28:52 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-71fbda33-f4ed-47b7-ba5f-2936e74eecd6 tempest-VolumesExtendTest-1522498811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:28:52 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-71fbda33-f4ed-47b7-ba5f-2936e74eecd6 tempest-VolumesExtendTest-1522498811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:28:52 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-71fbda33-f4ed-47b7-ba5f-2936e74eecd6 tempest-VolumesExtendTest-1522498811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:52 devstack sudo[89444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:28:52 devstack sudo[89444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:54 devstack sudo[89444]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:54 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-71fbda33-f4ed-47b7-ba5f-2936e74eecd6 tempest-VolumesExtendTest-1522498811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 1.442s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:54 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-71fbda33-f4ed-47b7-ba5f-2936e74eecd6 tempest-VolumesExtendTest-1522498811 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:28:54 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-71fbda33-f4ed-47b7-ba5f-2936e74eecd6 tempest-VolumesExtendTest-1522498811 None] Deleted volume successfully.
Feb 27 01:28:54 devstack sudo[89430]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:54 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-24099f0f-83d5-40fe-a3fc-58abbb2262ed tempest-VolumesActionsTest-1196644426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0b66dc01-1c7a-427d-b771-a85154916559 /opt/stack/data/cinder/conversion/0b66dc01-1c7a-427d-b771-a85154916559.temp_image.5eeed060-eeb2-4065-8ba8-172d79d04334jwpu35qk.img" returned: 0 in 2.168s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:54 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[f67a85e2-a7c2-4eeb-a5ac-153355f53ab8]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:28:54 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-24099f0f-83d5-40fe-a3fc-58abbb2262ed tempest-VolumesActionsTest-1196644426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0b66dc01-1c7a-427d-b771-a85154916559 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:54 devstack sudo[89447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0b66dc01-1c7a-427d-b771-a85154916559
Feb 27 01:28:54 devstack sudo[89447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:54 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-71fbda33-f4ed-47b7-ba5f-2936e74eecd6 tempest-VolumesExtendTest-1522498811 None] Lock "cinder-f1c0bc5e-f805-4ac8-bf2e-0091b9c3e6d9-delete_volume" released by "delete_volume" :: held 3.624s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:28:54 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-3177592d-48c2-43e9-8ee3-78fbbb8b44b4 tempest-VolumesExtendTest-1522498811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:28:55 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-3177592d-48c2-43e9-8ee3-78fbbb8b44b4 tempest-VolumesExtendTest-1522498811 None] Flow 'volume_create_manager' (2da11c22-8bf0-4e64-973c-cbcfe1af9670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:28:55 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-3177592d-48c2-43e9-8ee3-78fbbb8b44b4 tempest-VolumesExtendTest-1522498811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d22ad3b-3e54-47b4-b4c6-18b3fe63fd01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:55 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-3177592d-48c2-43e9-8ee3-78fbbb8b44b4 tempest-VolumesExtendTest-1522498811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d22ad3b-3e54-47b4-b4c6-18b3fe63fd01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:28:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1045269899',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=548cd26c-b285-4d94-83c3-531e0fbf429f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='580a8cc4200d4556a9c33bb0b614119a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:28:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:28:55Z,use_quota=True,user_id='4b48c3570a4b4ad89159f784f007d951',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:55 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-3177592d-48c2-43e9-8ee3-78fbbb8b44b4 tempest-VolumesExtendTest-1522498811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ad21e3e-9264-40ff-b813-2eb08764d201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:55 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-3177592d-48c2-43e9-8ee3-78fbbb8b44b4 tempest-VolumesExtendTest-1522498811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ad21e3e-9264-40ff-b813-2eb08764d201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:55 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-3177592d-48c2-43e9-8ee3-78fbbb8b44b4 tempest-VolumesExtendTest-1522498811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67d48433-e610-4b7b-9679-4757ac2ed302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:55 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-3177592d-48c2-43e9-8ee3-78fbbb8b44b4 tempest-VolumesExtendTest-1522498811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67d48433-e610-4b7b-9679-4757ac2ed302) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '548cd26c-b285-4d94-83c3-531e0fbf429f', 'volume_name': 'volume-548cd26c-b285-4d94-83c3-531e0fbf429f', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:55 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-3177592d-48c2-43e9-8ee3-78fbbb8b44b4 tempest-VolumesExtendTest-1522498811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcc33032-1776-4422-888a-b387aa35453e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:55 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-3177592d-48c2-43e9-8ee3-78fbbb8b44b4 tempest-VolumesExtendTest-1522498811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcc33032-1776-4422-888a-b387aa35453e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:55 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-3177592d-48c2-43e9-8ee3-78fbbb8b44b4 tempest-VolumesExtendTest-1522498811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0c60f7c-098f-47d2-9b78-ac72404999d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:55 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-3177592d-48c2-43e9-8ee3-78fbbb8b44b4 tempest-VolumesExtendTest-1522498811 None] Volume 548cd26c-b285-4d94-83c3-531e0fbf429f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-548cd26c-b285-4d94-83c3-531e0fbf429f', 'volume_size': 1}
Feb 27 01:28:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-3177592d-48c2-43e9-8ee3-78fbbb8b44b4 tempest-VolumesExtendTest-1522498811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:28:55 devstack sudo[89447]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-24099f0f-83d5-40fe-a3fc-58abbb2262ed tempest-VolumesActionsTest-1196644426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0b66dc01-1c7a-427d-b771-a85154916559" returned: 0 in 0.703s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:55 devstack cinder-volume[83106]: DEBUG cinder.image.image_utils [None req-24099f0f-83d5-40fe-a3fc-58abbb2262ed tempest-VolumesActionsTest-1196644426 None] Image conversion details: src /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0b66dc01-1c7a-427d-b771-a85154916559, size 1024.00 MB, duration 2.17 sec, destination /opt/stack/data/cinder/conversion/0b66dc01-1c7a-427d-b771-a85154916559.temp_image.5eeed060-eeb2-4065-8ba8-172d79d04334jwpu35qk.img {{(pid=83106) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 27 01:28:55 devstack cinder-volume[83106]: INFO cinder.image.image_utils [None req-24099f0f-83d5-40fe-a3fc-58abbb2262ed tempest-VolumesActionsTest-1196644426 None] Converted 1024.00 MB image at 472.02 MB/s
Feb 27 01:28:55 devstack cinder-volume[83106]: DEBUG cinder.image.image_utils [None req-24099f0f-83d5-40fe-a3fc-58abbb2262ed tempest-VolumesActionsTest-1196644426 None] 5eeed060-eeb2-4065-8ba8-172d79d04334 was raw, converting to qcow2 {{(pid=83106) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}}
Feb 27 01:28:55 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3494e92-c103-4a85-a265-3ed84be00342]: (4, 'raw') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:28:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-24099f0f-83d5-40fe-a3fc-58abbb2262ed tempest-VolumesActionsTest-1196644426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/0b66dc01-1c7a-427d-b771-a85154916559.temp_image.5eeed060-eeb2-4065-8ba8-172d79d04334jwpu35qk.img {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:55 devstack sudo[89452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/0b66dc01-1c7a-427d-b771-a85154916559.temp_image.5eeed060-eeb2-4065-8ba8-172d79d04334jwpu35qk.img
Feb 27 01:28:55 devstack sudo[89452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:55 devstack sudo[89452]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-24099f0f-83d5-40fe-a3fc-58abbb2262ed tempest-VolumesActionsTest-1196644426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/0b66dc01-1c7a-427d-b771-a85154916559.temp_image.5eeed060-eeb2-4065-8ba8-172d79d04334jwpu35qk.img" returned: 0 in 0.518s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-24099f0f-83d5-40fe-a3fc-58abbb2262ed tempest-VolumesActionsTest-1196644426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/0b66dc01-1c7a-427d-b771-a85154916559.temp_image.5eeed060-eeb2-4065-8ba8-172d79d04334jwpu35qk.img {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:55 devstack sudo[89456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/0b66dc01-1c7a-427d-b771-a85154916559.temp_image.5eeed060-eeb2-4065-8ba8-172d79d04334jwpu35qk.img
Feb 27 01:28:55 devstack sudo[89456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:56 devstack sudo[89456]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-24099f0f-83d5-40fe-a3fc-58abbb2262ed tempest-VolumesActionsTest-1196644426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/0b66dc01-1c7a-427d-b771-a85154916559.temp_image.5eeed060-eeb2-4065-8ba8-172d79d04334jwpu35qk.img" returned: 1 in 0.574s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-24099f0f-83d5-40fe-a3fc-58abbb2262ed tempest-VolumesActionsTest-1196644426 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/0b66dc01-1c7a-427d-b771-a85154916559.temp_image.5eeed060-eeb2-4065-8ba8-172d79d04334jwpu35qk.img' failed. Not Retrying. {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 27 01:28:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-24099f0f-83d5-40fe-a3fc-58abbb2262ed tempest-VolumesActionsTest-1196644426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/0b66dc01-1c7a-427d-b771-a85154916559.temp_image.5eeed060-eeb2-4065-8ba8-172d79d04334jwpu35qk.img /opt/stack/data/cinder/conversion/vol_upload_c34qlvhh {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:56 devstack sudo[89461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/0b66dc01-1c7a-427d-b771-a85154916559.temp_image.5eeed060-eeb2-4065-8ba8-172d79d04334jwpu35qk.img /opt/stack/data/cinder/conversion/vol_upload_c34qlvhh
Feb 27 01:28:56 devstack sudo[89461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:56 devstack sudo[89461]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-24099f0f-83d5-40fe-a3fc-58abbb2262ed tempest-VolumesActionsTest-1196644426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/0b66dc01-1c7a-427d-b771-a85154916559.temp_image.5eeed060-eeb2-4065-8ba8-172d79d04334jwpu35qk.img /opt/stack/data/cinder/conversion/vol_upload_c34qlvhh" returned: 0 in 0.445s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:56 devstack cinder-volume[83106]: DEBUG cinder.image.image_utils [None req-24099f0f-83d5-40fe-a3fc-58abbb2262ed tempest-VolumesActionsTest-1196644426 None] Image conversion details: src /opt/stack/data/cinder/conversion/0b66dc01-1c7a-427d-b771-a85154916559.temp_image.5eeed060-eeb2-4065-8ba8-172d79d04334jwpu35qk.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_c34qlvhh {{(pid=83106) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 27 01:28:56 devstack cinder-volume[83106]: INFO cinder.image.image_utils [None req-24099f0f-83d5-40fe-a3fc-58abbb2262ed tempest-VolumesActionsTest-1196644426 None] Converted 1024.00 MB image at 1024.00 MB/s
Feb 27 01:28:56 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[683f1afe-66da-48a0-b0f3-9c0584257305]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:28:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-24099f0f-83d5-40fe-a3fc-58abbb2262ed tempest-VolumesActionsTest-1196644426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_c34qlvhh {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:56 devstack sudo[89466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_c34qlvhh
Feb 27 01:28:56 devstack sudo[89466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:56 devstack cinder-volume[83106]: DEBUG oslo_service.periodic_task [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83106) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Feb 27 01:28:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:28:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:28:56 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:28:56 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:28:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:28:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:56 devstack sudo[89468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:28:56 devstack sudo[89468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:57 devstack sudo[89466]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-24099f0f-83d5-40fe-a3fc-58abbb2262ed tempest-VolumesActionsTest-1196644426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_c34qlvhh" returned: 0 in 0.481s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:57 devstack sudo[89468]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.490s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:57 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:28:58 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-24099f0f-83d5-40fe-a3fc-58abbb2262ed tempest-VolumesActionsTest-1196644426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 6.900s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:28:58 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-24099f0f-83d5-40fe-a3fc-58abbb2262ed tempest-VolumesActionsTest-1196644426 None] Uploaded volume to glance image-id: 5eeed060-eeb2-4065-8ba8-172d79d04334. {{(pid=83106) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Feb 27 01:28:58 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-3177592d-48c2-43e9-8ee3-78fbbb8b44b4 tempest-VolumesExtendTest-1522498811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.996s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:28:58 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-3177592d-48c2-43e9-8ee3-78fbbb8b44b4 tempest-VolumesExtendTest-1522498811 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:28:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1045269899',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=548cd26c-b285-4d94-83c3-531e0fbf429f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='580a8cc4200d4556a9c33bb0b614119a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:28:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:28:55Z,use_quota=True,user_id='4b48c3570a4b4ad89159f784f007d951',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:28:58 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-3177592d-48c2-43e9-8ee3-78fbbb8b44b4 tempest-VolumesExtendTest-1522498811 None] Creating volume 548cd26c-b285-4d94-83c3-531e0fbf429f {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:28:58 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-3177592d-48c2-43e9-8ee3-78fbbb8b44b4 tempest-VolumesExtendTest-1522498811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:28:58 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-3177592d-48c2-43e9-8ee3-78fbbb8b44b4 tempest-VolumesExtendTest-1522498811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:28:58 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-3177592d-48c2-43e9-8ee3-78fbbb8b44b4 tempest-VolumesExtendTest-1522498811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:28:58 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-3177592d-48c2-43e9-8ee3-78fbbb8b44b4 tempest-VolumesExtendTest-1522498811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:28:58 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-3177592d-48c2-43e9-8ee3-78fbbb8b44b4 tempest-VolumesExtendTest-1522498811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:28:58 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-3177592d-48c2-43e9-8ee3-78fbbb8b44b4 tempest-VolumesExtendTest-1522498811 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:28:58 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-3177592d-48c2-43e9-8ee3-78fbbb8b44b4 tempest-VolumesExtendTest-1522498811 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:28:58 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-3177592d-48c2-43e9-8ee3-78fbbb8b44b4 tempest-VolumesExtendTest-1522498811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-548cd26c-b285-4d94-83c3-531e0fbf429f 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:58 devstack cinder-volume[83106]: DEBUG dbcounter [-] [83106] Writing DB stats cinder:SELECT=98,cinder:INSERT=40,cinder:UPDATE=126,cinder:DELETE=8 {{(pid=83106) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 01:28:58 devstack cinder-volume[83106]: DEBUG dbcounter [-] [83106] Writing DB stats cinder:SELECT=115,cinder:UPDATE=146,cinder:DELETE=12,cinder:INSERT=38 {{(pid=83106) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 01:28:58 devstack sudo[89474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-548cd26c-b285-4d94-83c3-531e0fbf429f 1073741824
Feb 27 01:28:58 devstack sudo[89474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:58 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-24099f0f-83d5-40fe-a3fc-58abbb2262ed tempest-VolumesActionsTest-1196644426 None] Copy volume to image completed successfully.
Feb 27 01:28:58 devstack sudo[89474]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:58 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-3177592d-48c2-43e9-8ee3-78fbbb8b44b4 tempest-VolumesExtendTest-1522498811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-548cd26c-b285-4d94-83c3-531e0fbf429f 1073741824" returned: 0 in 0.546s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:58 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-3177592d-48c2-43e9-8ee3-78fbbb8b44b4 tempest-VolumesExtendTest-1522498811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-548cd26c-b285-4d94-83c3-531e0fbf429f {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:58 devstack sudo[89479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-548cd26c-b285-4d94-83c3-531e0fbf429f
Feb 27 01:28:58 devstack sudo[89479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:58 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-de43c517-c282-4172-a0f5-628debecd860 tempest-VolumesActionsTest-1196644426 None] Acquiring lock "cinder-0b66dc01-1c7a-427d-b771-a85154916559-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:28:58 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-de43c517-c282-4172-a0f5-628debecd860 tempest-VolumesActionsTest-1196644426 None] Lock "cinder-0b66dc01-1c7a-427d-b771-a85154916559-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:28:58 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-de43c517-c282-4172-a0f5-628debecd860 tempest-VolumesActionsTest-1196644426 None] Acquiring lock "cinder-quobyte-0b66dc01-1c7a-427d-b771-a85154916559" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:28:59 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-de43c517-c282-4172-a0f5-628debecd860 tempest-VolumesActionsTest-1196644426 None] Lock "cinder-quobyte-0b66dc01-1c7a-427d-b771-a85154916559" acquired by "delete_volume" :: waited 0.013s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:28:59 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[312fd68a-a713-4d30-81cb-572913f26bf1]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:28:59 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-de43c517-c282-4172-a0f5-628debecd860 tempest-VolumesActionsTest-1196644426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0b66dc01-1c7a-427d-b771-a85154916559 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:59 devstack sudo[89479]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:59 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-3177592d-48c2-43e9-8ee3-78fbbb8b44b4 tempest-VolumesExtendTest-1522498811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-548cd26c-b285-4d94-83c3-531e0fbf429f" returned: 0 in 0.445s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:59 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-3177592d-48c2-43e9-8ee3-78fbbb8b44b4 tempest-VolumesExtendTest-1522498811 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:28:59 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-3177592d-48c2-43e9-8ee3-78fbbb8b44b4 tempest-VolumesExtendTest-1522498811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:28:59 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-3177592d-48c2-43e9-8ee3-78fbbb8b44b4 tempest-VolumesExtendTest-1522498811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0c60f7c-098f-47d2-9b78-ac72404999d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-548cd26c-b285-4d94-83c3-531e0fbf429f', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:59 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-3177592d-48c2-43e9-8ee3-78fbbb8b44b4 tempest-VolumesExtendTest-1522498811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ced06139-21fc-4d96-9a6c-22fe5a98b04d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:28:59 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-3177592d-48c2-43e9-8ee3-78fbbb8b44b4 tempest-VolumesExtendTest-1522498811 None] Volume volume-548cd26c-b285-4d94-83c3-531e0fbf429f (548cd26c-b285-4d94-83c3-531e0fbf429f): created successfully
Feb 27 01:28:59 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-3177592d-48c2-43e9-8ee3-78fbbb8b44b4 tempest-VolumesExtendTest-1522498811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ced06139-21fc-4d96-9a6c-22fe5a98b04d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:28:59 devstack sudo[89482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0b66dc01-1c7a-427d-b771-a85154916559
Feb 27 01:28:59 devstack sudo[89482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:59 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-3177592d-48c2-43e9-8ee3-78fbbb8b44b4 tempest-VolumesExtendTest-1522498811 None] Flow 'volume_create_manager' (2da11c22-8bf0-4e64-973c-cbcfe1af9670) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:28:59 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-3177592d-48c2-43e9-8ee3-78fbbb8b44b4 tempest-VolumesExtendTest-1522498811 None] Created volume successfully.
Feb 27 01:28:59 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-023b8328-58c1-4d16-b16a-ad8e7ed85756 tempest-VolumesExtendTest-1522498811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:28:59 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-023b8328-58c1-4d16-b16a-ad8e7ed85756 tempest-VolumesExtendTest-1522498811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:28:59 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-023b8328-58c1-4d16-b16a-ad8e7ed85756 tempest-VolumesExtendTest-1522498811 None] Creating offline snapshot 1b29e148-7b70-4800-b48b-27bc7ed85398 of volume 548cd26c-b285-4d94-83c3-531e0fbf429f {{(pid=83106) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:28:59 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f57285-725b-48d0-bfb5-8e21f99cec2d]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:28:59 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-023b8328-58c1-4d16-b16a-ad8e7ed85756 tempest-VolumesExtendTest-1522498811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-548cd26c-b285-4d94-83c3-531e0fbf429f {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:59 devstack sudo[89484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-548cd26c-b285-4d94-83c3-531e0fbf429f
Feb 27 01:28:59 devstack sudo[89484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:59 devstack sudo[89482]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:59 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-de43c517-c282-4172-a0f5-628debecd860 tempest-VolumesActionsTest-1196644426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0b66dc01-1c7a-427d-b771-a85154916559" returned: 0 in 0.540s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:59 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-de43c517-c282-4172-a0f5-628debecd860 tempest-VolumesActionsTest-1196644426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0b66dc01-1c7a-427d-b771-a85154916559 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:28:59 devstack sudo[89489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0b66dc01-1c7a-427d-b771-a85154916559
Feb 27 01:28:59 devstack sudo[89489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:28:59 devstack sudo[89484]: pam_unix(sudo:session): session closed for user root
Feb 27 01:28:59 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-023b8328-58c1-4d16-b16a-ad8e7ed85756 tempest-VolumesExtendTest-1522498811 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-548cd26c-b285-4d94-83c3-531e0fbf429f" returned: 0 in 0.558s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:28:59 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-023b8328-58c1-4d16-b16a-ad8e7ed85756 tempest-VolumesExtendTest-1522498811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-548cd26c-b285-4d94-83c3-531e0fbf429f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-548cd26c-b285-4d94-83c3-531e0fbf429f.1b29e148-7b70-4800-b48b-27bc7ed85398 1G {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:00 devstack sudo[89495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-548cd26c-b285-4d94-83c3-531e0fbf429f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-548cd26c-b285-4d94-83c3-531e0fbf429f.1b29e148-7b70-4800-b48b-27bc7ed85398 1G
Feb 27 01:29:00 devstack sudo[89495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:00 devstack sudo[89489]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:00 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-de43c517-c282-4172-a0f5-628debecd860 tempest-VolumesActionsTest-1196644426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0b66dc01-1c7a-427d-b771-a85154916559" returned: 0 in 0.486s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:00 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-de43c517-c282-4172-a0f5-628debecd860 tempest-VolumesActionsTest-1196644426 None] Lock "cinder-quobyte-0b66dc01-1c7a-427d-b771-a85154916559" released by "delete_volume" :: held 1.060s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:29:00 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-de43c517-c282-4172-a0f5-628debecd860 tempest-VolumesActionsTest-1196644426 None] Created reservations ['2bf805f1-01c2-4e4a-868c-204b61db14ca', 'bd580097-7ab5-4f42-8b73-fdbfa95f5c46', '3e1c3b4f-d653-428a-87eb-a555599576d8', 'f8a6953a-006f-4278-9a3d-52d959d7f664'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:29:00 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-de43c517-c282-4172-a0f5-628debecd860 tempest-VolumesActionsTest-1196644426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:00 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-de43c517-c282-4172-a0f5-628debecd860 tempest-VolumesActionsTest-1196644426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:29:00 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-de43c517-c282-4172-a0f5-628debecd860 tempest-VolumesActionsTest-1196644426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:29:00 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-de43c517-c282-4172-a0f5-628debecd860 tempest-VolumesActionsTest-1196644426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:29:00 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-de43c517-c282-4172-a0f5-628debecd860 tempest-VolumesActionsTest-1196644426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:29:00 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-de43c517-c282-4172-a0f5-628debecd860 tempest-VolumesActionsTest-1196644426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:00 devstack sudo[89497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:29:00 devstack sudo[89497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:00 devstack sudo[89495]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:00 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-023b8328-58c1-4d16-b16a-ad8e7ed85756 tempest-VolumesExtendTest-1522498811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-548cd26c-b285-4d94-83c3-531e0fbf429f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-548cd26c-b285-4d94-83c3-531e0fbf429f.1b29e148-7b70-4800-b48b-27bc7ed85398 1G" returned: 0 in 0.650s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:00 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-023b8328-58c1-4d16-b16a-ad8e7ed85756 tempest-VolumesExtendTest-1522498811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-548cd26c-b285-4d94-83c3-531e0fbf429f -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-548cd26c-b285-4d94-83c3-531e0fbf429f.1b29e148-7b70-4800-b48b-27bc7ed85398 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:00 devstack sudo[89508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-548cd26c-b285-4d94-83c3-531e0fbf429f -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-548cd26c-b285-4d94-83c3-531e0fbf429f.1b29e148-7b70-4800-b48b-27bc7ed85398
Feb 27 01:29:00 devstack sudo[89508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:00 devstack sudo[89497]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:00 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-de43c517-c282-4172-a0f5-628debecd860 tempest-VolumesActionsTest-1196644426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.525s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:00 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-de43c517-c282-4172-a0f5-628debecd860 tempest-VolumesActionsTest-1196644426 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:29:00 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-de43c517-c282-4172-a0f5-628debecd860 tempest-VolumesActionsTest-1196644426 None] Deleted volume successfully.
Feb 27 01:29:00 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-de43c517-c282-4172-a0f5-628debecd860 tempest-VolumesActionsTest-1196644426 None] Lock "cinder-0b66dc01-1c7a-427d-b771-a85154916559-delete_volume" released by "delete_volume" :: held 1.811s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:29:01 devstack sudo[89508]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:01 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-023b8328-58c1-4d16-b16a-ad8e7ed85756 tempest-VolumesExtendTest-1522498811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-548cd26c-b285-4d94-83c3-531e0fbf429f -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-548cd26c-b285-4d94-83c3-531e0fbf429f.1b29e148-7b70-4800-b48b-27bc7ed85398" returned: 0 in 0.499s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:01 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-023b8328-58c1-4d16-b16a-ad8e7ed85756 tempest-VolumesExtendTest-1522498811 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-548cd26c-b285-4d94-83c3-531e0fbf429f.1b29e148-7b70-4800-b48b-27bc7ed85398 is being set with open permissions: ugo+rw
Feb 27 01:29:01 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-023b8328-58c1-4d16-b16a-ad8e7ed85756 tempest-VolumesExtendTest-1522498811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-548cd26c-b285-4d94-83c3-531e0fbf429f.1b29e148-7b70-4800-b48b-27bc7ed85398 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:01 devstack sudo[89548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-548cd26c-b285-4d94-83c3-531e0fbf429f.1b29e148-7b70-4800-b48b-27bc7ed85398
Feb 27 01:29:01 devstack sudo[89548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:01 devstack sudo[89548]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:01 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-023b8328-58c1-4d16-b16a-ad8e7ed85756 tempest-VolumesExtendTest-1522498811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-548cd26c-b285-4d94-83c3-531e0fbf429f.1b29e148-7b70-4800-b48b-27bc7ed85398" returned: 0 in 0.508s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:01 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-023b8328-58c1-4d16-b16a-ad8e7ed85756 tempest-VolumesExtendTest-1522498811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-548cd26c-b285-4d94-83c3-531e0fbf429f.info {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:01 devstack sudo[89551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-548cd26c-b285-4d94-83c3-531e0fbf429f.info
Feb 27 01:29:01 devstack sudo[89551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:02 devstack sudo[89551]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:02 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-023b8328-58c1-4d16-b16a-ad8e7ed85756 tempest-VolumesExtendTest-1522498811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-548cd26c-b285-4d94-83c3-531e0fbf429f.info" returned: 0 in 0.608s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:02 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-023b8328-58c1-4d16-b16a-ad8e7ed85756 tempest-VolumesExtendTest-1522498811 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-548cd26c-b285-4d94-83c3-531e0fbf429f.info is being set with open permissions: ugo+rw
Feb 27 01:29:02 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-023b8328-58c1-4d16-b16a-ad8e7ed85756 tempest-VolumesExtendTest-1522498811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-548cd26c-b285-4d94-83c3-531e0fbf429f.info {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:02 devstack sudo[89555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-548cd26c-b285-4d94-83c3-531e0fbf429f.info
Feb 27 01:29:02 devstack sudo[89555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:02 devstack sudo[89555]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:02 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-023b8328-58c1-4d16-b16a-ad8e7ed85756 tempest-VolumesExtendTest-1522498811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-548cd26c-b285-4d94-83c3-531e0fbf429f.info" returned: 0 in 0.459s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:02 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-023b8328-58c1-4d16-b16a-ad8e7ed85756 tempest-VolumesExtendTest-1522498811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.355s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:29:02 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-023b8328-58c1-4d16-b16a-ad8e7ed85756 tempest-VolumesExtendTest-1522498811 None] Create snapshot completed successfully
Feb 27 01:29:03 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-9eb5d7fe-180a-4dfe-9ab2-948aabad4ff4 tempest-VolumesExtendTest-1522498811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:03 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-9eb5d7fe-180a-4dfe-9ab2-948aabad4ff4 tempest-VolumesExtendTest-1522498811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:29:03 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[898b910c-e7fc-4402-8ec3-279f7332ec95]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:29:03 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9eb5d7fe-180a-4dfe-9ab2-948aabad4ff4 tempest-VolumesExtendTest-1522498811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-548cd26c-b285-4d94-83c3-531e0fbf429f {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:03 devstack sudo[89560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-548cd26c-b285-4d94-83c3-531e0fbf429f
Feb 27 01:29:03 devstack sudo[89560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:04 devstack sudo[89560]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:04 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9eb5d7fe-180a-4dfe-9ab2-948aabad4ff4 tempest-VolumesExtendTest-1522498811 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-548cd26c-b285-4d94-83c3-531e0fbf429f" returned: 0 in 0.633s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:04 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9eb5d7fe-180a-4dfe-9ab2-948aabad4ff4 tempest-VolumesExtendTest-1522498811 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-548cd26c-b285-4d94-83c3-531e0fbf429f.1b29e148-7b70-4800-b48b-27bc7ed85398 2G {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:04 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9eb5d7fe-180a-4dfe-9ab2-948aabad4ff4 tempest-VolumesExtendTest-1522498811 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-548cd26c-b285-4d94-83c3-531e0fbf429f.1b29e148-7b70-4800-b48b-27bc7ed85398 2G" returned: 0 in 0.090s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:04 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-9eb5d7fe-180a-4dfe-9ab2-948aabad4ff4 tempest-VolumesExtendTest-1522498811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.740s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:29:04 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-9eb5d7fe-180a-4dfe-9ab2-948aabad4ff4 tempest-VolumesExtendTest-1522498811 None] Extend volume completed successfully.
Feb 27 01:29:04 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5725c69a-ec5b-472f-a8da-bd432b708e50 tempest-VolumesExtendTest-1522498811 None] Acquiring lock "cinder-1b29e148-7b70-4800-b48b-27bc7ed85398-delete_snapshot" by "delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:29:04 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5725c69a-ec5b-472f-a8da-bd432b708e50 tempest-VolumesExtendTest-1522498811 None] Lock "cinder-1b29e148-7b70-4800-b48b-27bc7ed85398-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:29:04 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5725c69a-ec5b-472f-a8da-bd432b708e50 tempest-VolumesExtendTest-1522498811 None] Acquiring lock "cinder-quobyte-548cd26c-b285-4d94-83c3-531e0fbf429f" by "delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:29:04 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5725c69a-ec5b-472f-a8da-bd432b708e50 tempest-VolumesExtendTest-1522498811 None] Lock "cinder-quobyte-548cd26c-b285-4d94-83c3-531e0fbf429f" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:29:04 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5725c69a-ec5b-472f-a8da-bd432b708e50 tempest-VolumesExtendTest-1522498811 None] Acquiring lock "cinder-quobyte-1b29e148-7b70-4800-b48b-27bc7ed85398" by "_delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:29:04 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5725c69a-ec5b-472f-a8da-bd432b708e50 tempest-VolumesExtendTest-1522498811 None] Lock "cinder-quobyte-1b29e148-7b70-4800-b48b-27bc7ed85398" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:29:04 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-5725c69a-ec5b-472f-a8da-bd432b708e50 tempest-VolumesExtendTest-1522498811 None] Deleting offline snapshot 1b29e148-7b70-4800-b48b-27bc7ed85398 of volume 548cd26c-b285-4d94-83c3-531e0fbf429f {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:29:04 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-5725c69a-ec5b-472f-a8da-bd432b708e50 tempest-VolumesExtendTest-1522498811 None] snapshot_file for this snap is: volume-548cd26c-b285-4d94-83c3-531e0fbf429f.1b29e148-7b70-4800-b48b-27bc7ed85398 {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:29:04 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f79c32d-72e3-4652-ba2e-d1c8e7f3ae07]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:29:04 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5725c69a-ec5b-472f-a8da-bd432b708e50 tempest-VolumesExtendTest-1522498811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-548cd26c-b285-4d94-83c3-531e0fbf429f.1b29e148-7b70-4800-b48b-27bc7ed85398 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:04 devstack sudo[89569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-548cd26c-b285-4d94-83c3-531e0fbf429f.1b29e148-7b70-4800-b48b-27bc7ed85398
Feb 27 01:29:04 devstack sudo[89569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:05 devstack sudo[89569]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:05 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5725c69a-ec5b-472f-a8da-bd432b708e50 tempest-VolumesExtendTest-1522498811 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-548cd26c-b285-4d94-83c3-531e0fbf429f.1b29e148-7b70-4800-b48b-27bc7ed85398" returned: 0 in 0.567s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:05 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-5725c69a-ec5b-472f-a8da-bd432b708e50 tempest-VolumesExtendTest-1522498811 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-548cd26c-b285-4d94-83c3-531e0fbf429f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83106) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:29:05 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[017d59eb-1e9c-4dcb-8d75-057d50dc84c0]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:29:05 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5725c69a-ec5b-472f-a8da-bd432b708e50 tempest-VolumesExtendTest-1522498811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-548cd26c-b285-4d94-83c3-531e0fbf429f {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:05 devstack sudo[89574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-548cd26c-b285-4d94-83c3-531e0fbf429f
Feb 27 01:29:05 devstack sudo[89574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:05 devstack sudo[89574]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:06 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5725c69a-ec5b-472f-a8da-bd432b708e50 tempest-VolumesExtendTest-1522498811 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-548cd26c-b285-4d94-83c3-531e0fbf429f" returned: 0 in 0.530s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:06 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5725c69a-ec5b-472f-a8da-bd432b708e50 tempest-VolumesExtendTest-1522498811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-548cd26c-b285-4d94-83c3-531e0fbf429f.1b29e148-7b70-4800-b48b-27bc7ed85398 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:06 devstack sudo[89579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-548cd26c-b285-4d94-83c3-531e0fbf429f.1b29e148-7b70-4800-b48b-27bc7ed85398
Feb 27 01:29:06 devstack sudo[89579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:06 devstack sudo[89579]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:06 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5725c69a-ec5b-472f-a8da-bd432b708e50 tempest-VolumesExtendTest-1522498811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-548cd26c-b285-4d94-83c3-531e0fbf429f.1b29e148-7b70-4800-b48b-27bc7ed85398" returned: 0 in 0.573s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:06 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5725c69a-ec5b-472f-a8da-bd432b708e50 tempest-VolumesExtendTest-1522498811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-548cd26c-b285-4d94-83c3-531e0fbf429f.1b29e148-7b70-4800-b48b-27bc7ed85398 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:06 devstack sudo[89584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-548cd26c-b285-4d94-83c3-531e0fbf429f.1b29e148-7b70-4800-b48b-27bc7ed85398
Feb 27 01:29:06 devstack sudo[89584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:07 devstack sudo[89584]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:07 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5725c69a-ec5b-472f-a8da-bd432b708e50 tempest-VolumesExtendTest-1522498811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-548cd26c-b285-4d94-83c3-531e0fbf429f.1b29e148-7b70-4800-b48b-27bc7ed85398" returned: 0 in 0.462s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:07 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5725c69a-ec5b-472f-a8da-bd432b708e50 tempest-VolumesExtendTest-1522498811 None] Lock "cinder-quobyte-1b29e148-7b70-4800-b48b-27bc7ed85398" released by "_delete_snapshot" :: held 2.202s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:29:07 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5725c69a-ec5b-472f-a8da-bd432b708e50 tempest-VolumesExtendTest-1522498811 None] Lock "cinder-quobyte-548cd26c-b285-4d94-83c3-531e0fbf429f" released by "delete_snapshot" :: held 2.215s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:29:07 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-5725c69a-ec5b-472f-a8da-bd432b708e50 tempest-VolumesExtendTest-1522498811 None] Created reservations ['e93d1a39-7061-4003-adde-2e9419ff5f88', '7f6f1a4b-98a7-4c6f-aa81-5c9fb4df0255', '065abcc1-98cb-4313-a441-fc07b3f7d84d', 'f8bae568-b9bb-46e5-9fb4-1c89958dcdee'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:29:07 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-5725c69a-ec5b-472f-a8da-bd432b708e50 tempest-VolumesExtendTest-1522498811 None] Delete snapshot completed successfully.
Feb 27 01:29:07 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5725c69a-ec5b-472f-a8da-bd432b708e50 tempest-VolumesExtendTest-1522498811 None] Lock "cinder-1b29e148-7b70-4800-b48b-27bc7ed85398-delete_snapshot" released by "delete_snapshot" :: held 2.321s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:29:07 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-95c58d4f-dee0-442a-a039-7cbeffa71688 tempest-VolumesNegativeTest-891639816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:29:07 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-95c58d4f-dee0-442a-a039-7cbeffa71688 tempest-VolumesNegativeTest-891639816 None] Flow 'volume_create_manager' (653c4bdd-70e7-4023-a121-a74752050ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:29:07 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-95c58d4f-dee0-442a-a039-7cbeffa71688 tempest-VolumesNegativeTest-891639816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8199ff8d-5f79-44ee-b688-737a0fa41fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:07 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-95c58d4f-dee0-442a-a039-7cbeffa71688 tempest-VolumesNegativeTest-891639816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8199ff8d-5f79-44ee-b688-737a0fa41fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:29:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1869181956',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d6bca05-3f56-4a07-9d1b-711bc76b6e93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0de8ba3b92d42b29712323f311adc90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:29:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:29:07Z,use_quota=True,user_id='4b607037931145e6a011dd9411fd8b1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:07 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-95c58d4f-dee0-442a-a039-7cbeffa71688 tempest-VolumesNegativeTest-891639816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80063eb9-577e-40bf-99cb-2cac5f22ccda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:07 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-95c58d4f-dee0-442a-a039-7cbeffa71688 tempest-VolumesNegativeTest-891639816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80063eb9-577e-40bf-99cb-2cac5f22ccda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:07 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-95c58d4f-dee0-442a-a039-7cbeffa71688 tempest-VolumesNegativeTest-891639816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (effd8455-3a12-4775-b21a-7a8154d79f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:07 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-95c58d4f-dee0-442a-a039-7cbeffa71688 tempest-VolumesNegativeTest-891639816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (effd8455-3a12-4775-b21a-7a8154d79f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d6bca05-3f56-4a07-9d1b-711bc76b6e93', 'volume_name': 'volume-4d6bca05-3f56-4a07-9d1b-711bc76b6e93', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:07 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-95c58d4f-dee0-442a-a039-7cbeffa71688 tempest-VolumesNegativeTest-891639816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b33df04f-d5c4-4f4c-a4af-6540d3c018d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:07 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-95c58d4f-dee0-442a-a039-7cbeffa71688 tempest-VolumesNegativeTest-891639816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b33df04f-d5c4-4f4c-a4af-6540d3c018d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:07 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-95c58d4f-dee0-442a-a039-7cbeffa71688 tempest-VolumesNegativeTest-891639816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81c3e995-475b-4cc2-8f05-84c455c7afc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:07 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-95c58d4f-dee0-442a-a039-7cbeffa71688 tempest-VolumesNegativeTest-891639816 None] Volume 4d6bca05-3f56-4a07-9d1b-711bc76b6e93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d6bca05-3f56-4a07-9d1b-711bc76b6e93', 'volume_size': 1}
Feb 27 01:29:07 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-95c58d4f-dee0-442a-a039-7cbeffa71688 tempest-VolumesNegativeTest-891639816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:07 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-95c58d4f-dee0-442a-a039-7cbeffa71688 tempest-VolumesNegativeTest-891639816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:29:07 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-95c58d4f-dee0-442a-a039-7cbeffa71688 tempest-VolumesNegativeTest-891639816 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:29:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1869181956',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d6bca05-3f56-4a07-9d1b-711bc76b6e93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0de8ba3b92d42b29712323f311adc90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:29:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:29:07Z,use_quota=True,user_id='4b607037931145e6a011dd9411fd8b1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:29:07 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-95c58d4f-dee0-442a-a039-7cbeffa71688 tempest-VolumesNegativeTest-891639816 None] Creating volume 4d6bca05-3f56-4a07-9d1b-711bc76b6e93 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:29:07 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-95c58d4f-dee0-442a-a039-7cbeffa71688 tempest-VolumesNegativeTest-891639816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:07 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-95c58d4f-dee0-442a-a039-7cbeffa71688 tempest-VolumesNegativeTest-891639816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:29:07 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-95c58d4f-dee0-442a-a039-7cbeffa71688 tempest-VolumesNegativeTest-891639816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:29:07 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-95c58d4f-dee0-442a-a039-7cbeffa71688 tempest-VolumesNegativeTest-891639816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:29:07 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-95c58d4f-dee0-442a-a039-7cbeffa71688 tempest-VolumesNegativeTest-891639816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:29:07 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-95c58d4f-dee0-442a-a039-7cbeffa71688 tempest-VolumesNegativeTest-891639816 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:29:07 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-95c58d4f-dee0-442a-a039-7cbeffa71688 tempest-VolumesNegativeTest-891639816 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:29:07 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-95c58d4f-dee0-442a-a039-7cbeffa71688 tempest-VolumesNegativeTest-891639816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-4d6bca05-3f56-4a07-9d1b-711bc76b6e93 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:07 devstack sudo[89587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-4d6bca05-3f56-4a07-9d1b-711bc76b6e93 1073741824
Feb 27 01:29:07 devstack sudo[89587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:07 devstack sudo[89587]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:07 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-95c58d4f-dee0-442a-a039-7cbeffa71688 tempest-VolumesNegativeTest-891639816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-4d6bca05-3f56-4a07-9d1b-711bc76b6e93 1073741824" returned: 0 in 0.467s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:07 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-95c58d4f-dee0-442a-a039-7cbeffa71688 tempest-VolumesNegativeTest-891639816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-4d6bca05-3f56-4a07-9d1b-711bc76b6e93 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:08 devstack sudo[89592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-4d6bca05-3f56-4a07-9d1b-711bc76b6e93
Feb 27 01:29:08 devstack sudo[89592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:08 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-9a267198-64e6-4fb6-bea1-5ba3f0db26a7 tempest-VolumesExtendTest-1522498811 None] Acquiring lock "cinder-548cd26c-b285-4d94-83c3-531e0fbf429f-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:29:08 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-9a267198-64e6-4fb6-bea1-5ba3f0db26a7 tempest-VolumesExtendTest-1522498811 None] Lock "cinder-548cd26c-b285-4d94-83c3-531e0fbf429f-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:29:08 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-9a267198-64e6-4fb6-bea1-5ba3f0db26a7 tempest-VolumesExtendTest-1522498811 None] Acquiring lock "cinder-quobyte-548cd26c-b285-4d94-83c3-531e0fbf429f" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:29:08 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-9a267198-64e6-4fb6-bea1-5ba3f0db26a7 tempest-VolumesExtendTest-1522498811 None] Lock "cinder-quobyte-548cd26c-b285-4d94-83c3-531e0fbf429f" acquired by "delete_volume" :: waited 0.020s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:29:08 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[135f2d34-0401-40b9-9619-662d348be5f8]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:29:08 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9a267198-64e6-4fb6-bea1-5ba3f0db26a7 tempest-VolumesExtendTest-1522498811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-548cd26c-b285-4d94-83c3-531e0fbf429f {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:08 devstack sudo[89594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-548cd26c-b285-4d94-83c3-531e0fbf429f
Feb 27 01:29:08 devstack sudo[89594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:08 devstack sudo[89592]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:08 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-95c58d4f-dee0-442a-a039-7cbeffa71688 tempest-VolumesNegativeTest-891639816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-4d6bca05-3f56-4a07-9d1b-711bc76b6e93" returned: 0 in 0.422s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:08 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-95c58d4f-dee0-442a-a039-7cbeffa71688 tempest-VolumesNegativeTest-891639816 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:29:08 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-95c58d4f-dee0-442a-a039-7cbeffa71688 tempest-VolumesNegativeTest-891639816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:29:08 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-95c58d4f-dee0-442a-a039-7cbeffa71688 tempest-VolumesNegativeTest-891639816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81c3e995-475b-4cc2-8f05-84c455c7afc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d6bca05-3f56-4a07-9d1b-711bc76b6e93', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:08 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-95c58d4f-dee0-442a-a039-7cbeffa71688 tempest-VolumesNegativeTest-891639816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (533636e0-8bcb-4e0a-88ea-8c93ff6cf505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:08 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-95c58d4f-dee0-442a-a039-7cbeffa71688 tempest-VolumesNegativeTest-891639816 None] Volume volume-4d6bca05-3f56-4a07-9d1b-711bc76b6e93 (4d6bca05-3f56-4a07-9d1b-711bc76b6e93): created successfully
Feb 27 01:29:08 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-95c58d4f-dee0-442a-a039-7cbeffa71688 tempest-VolumesNegativeTest-891639816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (533636e0-8bcb-4e0a-88ea-8c93ff6cf505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:08 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-95c58d4f-dee0-442a-a039-7cbeffa71688 tempest-VolumesNegativeTest-891639816 None] Flow 'volume_create_manager' (653c4bdd-70e7-4023-a121-a74752050ba3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:29:08 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-95c58d4f-dee0-442a-a039-7cbeffa71688 tempest-VolumesNegativeTest-891639816 None] Created volume successfully.
Feb 27 01:29:08 devstack sudo[89594]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:08 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9a267198-64e6-4fb6-bea1-5ba3f0db26a7 tempest-VolumesExtendTest-1522498811 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-548cd26c-b285-4d94-83c3-531e0fbf429f" returned: 0 in 0.500s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:08 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9a267198-64e6-4fb6-bea1-5ba3f0db26a7 tempest-VolumesExtendTest-1522498811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-548cd26c-b285-4d94-83c3-531e0fbf429f {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:08 devstack sudo[89600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-548cd26c-b285-4d94-83c3-531e0fbf429f
Feb 27 01:29:08 devstack sudo[89600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:08 devstack sudo[89600]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:08 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9a267198-64e6-4fb6-bea1-5ba3f0db26a7 tempest-VolumesExtendTest-1522498811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-548cd26c-b285-4d94-83c3-531e0fbf429f" returned: 0 in 0.388s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:09 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-9a267198-64e6-4fb6-bea1-5ba3f0db26a7 tempest-VolumesExtendTest-1522498811 None] Lock "cinder-quobyte-548cd26c-b285-4d94-83c3-531e0fbf429f" released by "delete_volume" :: held 0.916s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:29:09 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-9a267198-64e6-4fb6-bea1-5ba3f0db26a7 tempest-VolumesExtendTest-1522498811 None] Created reservations ['2e9b29c5-aa9e-4301-b02b-bc928f82f222', 'c9c2d346-5236-4991-b0c4-5a9cd03f9a56', 'a8d7bc29-ac58-4f81-b99c-f2c61c2b530d', '993cde29-b238-4edd-a9ef-e0ed2b856526'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:29:09 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-9a267198-64e6-4fb6-bea1-5ba3f0db26a7 tempest-VolumesExtendTest-1522498811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:09 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-9a267198-64e6-4fb6-bea1-5ba3f0db26a7 tempest-VolumesExtendTest-1522498811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:29:09 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-9a267198-64e6-4fb6-bea1-5ba3f0db26a7 tempest-VolumesExtendTest-1522498811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:29:09 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-9a267198-64e6-4fb6-bea1-5ba3f0db26a7 tempest-VolumesExtendTest-1522498811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:29:09 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-9a267198-64e6-4fb6-bea1-5ba3f0db26a7 tempest-VolumesExtendTest-1522498811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:29:09 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9a267198-64e6-4fb6-bea1-5ba3f0db26a7 tempest-VolumesExtendTest-1522498811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:09 devstack sudo[89603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:29:09 devstack sudo[89603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:09 devstack sudo[89603]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:09 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9a267198-64e6-4fb6-bea1-5ba3f0db26a7 tempest-VolumesExtendTest-1522498811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.453s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:09 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-9a267198-64e6-4fb6-bea1-5ba3f0db26a7 tempest-VolumesExtendTest-1522498811 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:29:09 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-9a267198-64e6-4fb6-bea1-5ba3f0db26a7 tempest-VolumesExtendTest-1522498811 None] Deleted volume successfully.
Feb 27 01:29:09 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-9a267198-64e6-4fb6-bea1-5ba3f0db26a7 tempest-VolumesExtendTest-1522498811 None] Lock "cinder-548cd26c-b285-4d94-83c3-531e0fbf429f-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:29:10 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-776c63a8-8b40-40a6-8fb2-a84bf57b0d92 tempest-VolumesGetTest-1299330385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:29:10 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-776c63a8-8b40-40a6-8fb2-a84bf57b0d92 tempest-VolumesGetTest-1299330385 None] Flow 'volume_create_manager' (079b1107-ffc2-4843-9775-efa0978c2b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:29:10 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-776c63a8-8b40-40a6-8fb2-a84bf57b0d92 tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1adc4aff-a7ae-4e4e-a1bf-df877b28559b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:11 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-776c63a8-8b40-40a6-8fb2-a84bf57b0d92 tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1adc4aff-a7ae-4e4e-a1bf-df877b28559b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:29:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-813392967',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef6e36fb-d266-4391-8085-fcd0107dc810,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='62820bf75832490faca5bc43e4724911',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:29:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:29:11Z,use_quota=True,user_id='127cb18bec0a41a9bc4186e2ee63b6a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:11 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-776c63a8-8b40-40a6-8fb2-a84bf57b0d92 tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f242bdcb-037d-4c88-b56d-d67ef6b15a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:11 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-776c63a8-8b40-40a6-8fb2-a84bf57b0d92 tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f242bdcb-037d-4c88-b56d-d67ef6b15a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:11 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-776c63a8-8b40-40a6-8fb2-a84bf57b0d92 tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (812ec1ec-5956-4c15-9ca0-a605d6ee28ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:11 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-776c63a8-8b40-40a6-8fb2-a84bf57b0d92 tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (812ec1ec-5956-4c15-9ca0-a605d6ee28ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef6e36fb-d266-4391-8085-fcd0107dc810', 'volume_name': 'volume-ef6e36fb-d266-4391-8085-fcd0107dc810', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:11 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-776c63a8-8b40-40a6-8fb2-a84bf57b0d92 tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bbefef1-ab30-4d8a-8797-1b76347a91b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:11 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-776c63a8-8b40-40a6-8fb2-a84bf57b0d92 tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bbefef1-ab30-4d8a-8797-1b76347a91b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:11 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-776c63a8-8b40-40a6-8fb2-a84bf57b0d92 tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05bffa31-7ebc-4d26-b490-0044871e6a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:11 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-776c63a8-8b40-40a6-8fb2-a84bf57b0d92 tempest-VolumesGetTest-1299330385 None] Volume ef6e36fb-d266-4391-8085-fcd0107dc810: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef6e36fb-d266-4391-8085-fcd0107dc810', 'volume_size': 1}
Feb 27 01:29:11 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-776c63a8-8b40-40a6-8fb2-a84bf57b0d92 tempest-VolumesGetTest-1299330385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:11 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-776c63a8-8b40-40a6-8fb2-a84bf57b0d92 tempest-VolumesGetTest-1299330385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:29:11 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-776c63a8-8b40-40a6-8fb2-a84bf57b0d92 tempest-VolumesGetTest-1299330385 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:29:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-813392967',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef6e36fb-d266-4391-8085-fcd0107dc810,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='62820bf75832490faca5bc43e4724911',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:29:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:29:11Z,use_quota=True,user_id='127cb18bec0a41a9bc4186e2ee63b6a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:29:11 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-776c63a8-8b40-40a6-8fb2-a84bf57b0d92 tempest-VolumesGetTest-1299330385 None] Creating volume ef6e36fb-d266-4391-8085-fcd0107dc810 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:29:11 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-776c63a8-8b40-40a6-8fb2-a84bf57b0d92 tempest-VolumesGetTest-1299330385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:11 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-776c63a8-8b40-40a6-8fb2-a84bf57b0d92 tempest-VolumesGetTest-1299330385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:29:11 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-776c63a8-8b40-40a6-8fb2-a84bf57b0d92 tempest-VolumesGetTest-1299330385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:29:11 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-776c63a8-8b40-40a6-8fb2-a84bf57b0d92 tempest-VolumesGetTest-1299330385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:29:11 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-776c63a8-8b40-40a6-8fb2-a84bf57b0d92 tempest-VolumesGetTest-1299330385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:29:11 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-776c63a8-8b40-40a6-8fb2-a84bf57b0d92 tempest-VolumesGetTest-1299330385 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:29:11 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-776c63a8-8b40-40a6-8fb2-a84bf57b0d92 tempest-VolumesGetTest-1299330385 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:29:11 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-776c63a8-8b40-40a6-8fb2-a84bf57b0d92 tempest-VolumesGetTest-1299330385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ef6e36fb-d266-4391-8085-fcd0107dc810 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:11 devstack sudo[89608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ef6e36fb-d266-4391-8085-fcd0107dc810 1073741824
Feb 27 01:29:11 devstack sudo[89608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:11 devstack sudo[89608]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:11 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-776c63a8-8b40-40a6-8fb2-a84bf57b0d92 tempest-VolumesGetTest-1299330385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ef6e36fb-d266-4391-8085-fcd0107dc810 1073741824" returned: 0 in 0.458s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:11 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-776c63a8-8b40-40a6-8fb2-a84bf57b0d92 tempest-VolumesGetTest-1299330385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ef6e36fb-d266-4391-8085-fcd0107dc810 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:11 devstack sudo[89613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ef6e36fb-d266-4391-8085-fcd0107dc810
Feb 27 01:29:11 devstack sudo[89613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:11 devstack sudo[89613]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:11 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-776c63a8-8b40-40a6-8fb2-a84bf57b0d92 tempest-VolumesGetTest-1299330385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ef6e36fb-d266-4391-8085-fcd0107dc810" returned: 0 in 0.389s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:11 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-776c63a8-8b40-40a6-8fb2-a84bf57b0d92 tempest-VolumesGetTest-1299330385 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:29:11 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-776c63a8-8b40-40a6-8fb2-a84bf57b0d92 tempest-VolumesGetTest-1299330385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:29:11 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-776c63a8-8b40-40a6-8fb2-a84bf57b0d92 tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05bffa31-7ebc-4d26-b490-0044871e6a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef6e36fb-d266-4391-8085-fcd0107dc810', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:11 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-776c63a8-8b40-40a6-8fb2-a84bf57b0d92 tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d364d5d1-a73b-4723-b7a1-272d54a0b1df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:11 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-776c63a8-8b40-40a6-8fb2-a84bf57b0d92 tempest-VolumesGetTest-1299330385 None] Volume volume-ef6e36fb-d266-4391-8085-fcd0107dc810 (ef6e36fb-d266-4391-8085-fcd0107dc810): created successfully
Feb 27 01:29:11 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-776c63a8-8b40-40a6-8fb2-a84bf57b0d92 tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d364d5d1-a73b-4723-b7a1-272d54a0b1df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:11 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-776c63a8-8b40-40a6-8fb2-a84bf57b0d92 tempest-VolumesGetTest-1299330385 None] Flow 'volume_create_manager' (079b1107-ffc2-4843-9775-efa0978c2b22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:29:11 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-776c63a8-8b40-40a6-8fb2-a84bf57b0d92 tempest-VolumesGetTest-1299330385 None] Created volume successfully.
Feb 27 01:29:13 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2d77ede-6664-4ec7-b858-6e032cada12a tempest-VolumesGetTest-1299330385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:29:13 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-e2d77ede-6664-4ec7-b858-6e032cada12a tempest-VolumesGetTest-1299330385 None] Flow 'volume_create_manager' (ff50d7d2-e300-460d-a239-f834ac82ed12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:29:13 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-e2d77ede-6664-4ec7-b858-6e032cada12a tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13191761-6209-41e0-8d68-046bf161f162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:13 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-e2d77ede-6664-4ec7-b858-6e032cada12a tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13191761-6209-41e0-8d68-046bf161f162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:29:13Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1604020750',display_name='tempest-VolumesGetTest-Volume-1757852000',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0691de3-b5c2-4e8b-92bf-9e209689d45d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62820bf75832490faca5bc43e4724911',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:29:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:29:13Z,use_quota=True,user_id='127cb18bec0a41a9bc4186e2ee63b6a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:13 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-e2d77ede-6664-4ec7-b858-6e032cada12a tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12a16d47-fead-4ef5-8332-0b7a14140d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:13 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-e2d77ede-6664-4ec7-b858-6e032cada12a tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12a16d47-fead-4ef5-8332-0b7a14140d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:13 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-e2d77ede-6664-4ec7-b858-6e032cada12a tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96e6b4df-9f82-4e1a-8532-35902958ddfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:13 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-e2d77ede-6664-4ec7-b858-6e032cada12a tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96e6b4df-9f82-4e1a-8532-35902958ddfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0691de3-b5c2-4e8b-92bf-9e209689d45d', 'volume_name': 'volume-a0691de3-b5c2-4e8b-92bf-9e209689d45d', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:13 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-e2d77ede-6664-4ec7-b858-6e032cada12a tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5507189f-ce69-42bf-bf79-2819237666e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:13 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-e2d77ede-6664-4ec7-b858-6e032cada12a tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5507189f-ce69-42bf-bf79-2819237666e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:13 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-e2d77ede-6664-4ec7-b858-6e032cada12a tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64633376-113d-4056-a264-f000d370c68d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:13 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-e2d77ede-6664-4ec7-b858-6e032cada12a tempest-VolumesGetTest-1299330385 None] Volume a0691de3-b5c2-4e8b-92bf-9e209689d45d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0691de3-b5c2-4e8b-92bf-9e209689d45d', 'volume_size': 1}
Feb 27 01:29:13 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-e2d77ede-6664-4ec7-b858-6e032cada12a tempest-VolumesGetTest-1299330385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:13 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-e2d77ede-6664-4ec7-b858-6e032cada12a tempest-VolumesGetTest-1299330385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:29:13 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-e2d77ede-6664-4ec7-b858-6e032cada12a tempest-VolumesGetTest-1299330385 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:29:13Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1604020750',display_name='tempest-VolumesGetTest-Volume-1757852000',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0691de3-b5c2-4e8b-92bf-9e209689d45d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62820bf75832490faca5bc43e4724911',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:29:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:29:13Z,use_quota=True,user_id='127cb18bec0a41a9bc4186e2ee63b6a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:29:13 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-e2d77ede-6664-4ec7-b858-6e032cada12a tempest-VolumesGetTest-1299330385 None] Creating volume a0691de3-b5c2-4e8b-92bf-9e209689d45d {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:29:13 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-e2d77ede-6664-4ec7-b858-6e032cada12a tempest-VolumesGetTest-1299330385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:13 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-e2d77ede-6664-4ec7-b858-6e032cada12a tempest-VolumesGetTest-1299330385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:29:13 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-e2d77ede-6664-4ec7-b858-6e032cada12a tempest-VolumesGetTest-1299330385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:29:13 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-e2d77ede-6664-4ec7-b858-6e032cada12a tempest-VolumesGetTest-1299330385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:29:13 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-e2d77ede-6664-4ec7-b858-6e032cada12a tempest-VolumesGetTest-1299330385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:29:13 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-e2d77ede-6664-4ec7-b858-6e032cada12a tempest-VolumesGetTest-1299330385 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:29:13 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-e2d77ede-6664-4ec7-b858-6e032cada12a tempest-VolumesGetTest-1299330385 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:29:13 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-e2d77ede-6664-4ec7-b858-6e032cada12a tempest-VolumesGetTest-1299330385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-a0691de3-b5c2-4e8b-92bf-9e209689d45d 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:13 devstack sudo[89617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-a0691de3-b5c2-4e8b-92bf-9e209689d45d 1073741824
Feb 27 01:29:13 devstack sudo[89617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:14 devstack sudo[89617]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:14 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-e2d77ede-6664-4ec7-b858-6e032cada12a tempest-VolumesGetTest-1299330385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-a0691de3-b5c2-4e8b-92bf-9e209689d45d 1073741824" returned: 0 in 0.555s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:14 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-e2d77ede-6664-4ec7-b858-6e032cada12a tempest-VolumesGetTest-1299330385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-a0691de3-b5c2-4e8b-92bf-9e209689d45d {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:14 devstack sudo[89622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-a0691de3-b5c2-4e8b-92bf-9e209689d45d
Feb 27 01:29:14 devstack sudo[89622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:14 devstack sudo[89622]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:14 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-e2d77ede-6664-4ec7-b858-6e032cada12a tempest-VolumesGetTest-1299330385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-a0691de3-b5c2-4e8b-92bf-9e209689d45d" returned: 0 in 0.475s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:14 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-e2d77ede-6664-4ec7-b858-6e032cada12a tempest-VolumesGetTest-1299330385 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:29:14 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-e2d77ede-6664-4ec7-b858-6e032cada12a tempest-VolumesGetTest-1299330385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:29:14 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-e2d77ede-6664-4ec7-b858-6e032cada12a tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64633376-113d-4056-a264-f000d370c68d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0691de3-b5c2-4e8b-92bf-9e209689d45d', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:14 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-e2d77ede-6664-4ec7-b858-6e032cada12a tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5dbbb42-7881-4538-b4aa-e43ed5fa175d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:14 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-e2d77ede-6664-4ec7-b858-6e032cada12a tempest-VolumesGetTest-1299330385 None] Volume volume-a0691de3-b5c2-4e8b-92bf-9e209689d45d (a0691de3-b5c2-4e8b-92bf-9e209689d45d): created successfully
Feb 27 01:29:14 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-e2d77ede-6664-4ec7-b858-6e032cada12a tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5dbbb42-7881-4538-b4aa-e43ed5fa175d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:14 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-e2d77ede-6664-4ec7-b858-6e032cada12a tempest-VolumesGetTest-1299330385 None] Flow 'volume_create_manager' (ff50d7d2-e300-460d-a239-f834ac82ed12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:29:14 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-e2d77ede-6664-4ec7-b858-6e032cada12a tempest-VolumesGetTest-1299330385 None] Created volume successfully.
Feb 27 01:29:15 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-779e44c4-8c30-44ec-97d4-49a28aa2268b tempest-VolumesGetTest-1299330385 None] Acquiring lock "cinder-a0691de3-b5c2-4e8b-92bf-9e209689d45d-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:29:15 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-779e44c4-8c30-44ec-97d4-49a28aa2268b tempest-VolumesGetTest-1299330385 None] Lock "cinder-a0691de3-b5c2-4e8b-92bf-9e209689d45d-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:29:15 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-779e44c4-8c30-44ec-97d4-49a28aa2268b tempest-VolumesGetTest-1299330385 None] Acquiring lock "cinder-quobyte-a0691de3-b5c2-4e8b-92bf-9e209689d45d" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:29:15 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-779e44c4-8c30-44ec-97d4-49a28aa2268b tempest-VolumesGetTest-1299330385 None] Lock "cinder-quobyte-a0691de3-b5c2-4e8b-92bf-9e209689d45d" acquired by "delete_volume" :: waited 0.010s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:29:15 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ee9746-aa63-4319-ae18-64bd52534e7b]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:29:15 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-779e44c4-8c30-44ec-97d4-49a28aa2268b tempest-VolumesGetTest-1299330385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-a0691de3-b5c2-4e8b-92bf-9e209689d45d {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:15 devstack sudo[89625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-a0691de3-b5c2-4e8b-92bf-9e209689d45d
Feb 27 01:29:15 devstack sudo[89625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:16 devstack sudo[89625]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:16 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-779e44c4-8c30-44ec-97d4-49a28aa2268b tempest-VolumesGetTest-1299330385 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-a0691de3-b5c2-4e8b-92bf-9e209689d45d" returned: 0 in 0.549s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:16 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-779e44c4-8c30-44ec-97d4-49a28aa2268b tempest-VolumesGetTest-1299330385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-a0691de3-b5c2-4e8b-92bf-9e209689d45d {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:16 devstack sudo[89632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-a0691de3-b5c2-4e8b-92bf-9e209689d45d
Feb 27 01:29:16 devstack sudo[89632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:16 devstack sudo[89632]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:16 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-779e44c4-8c30-44ec-97d4-49a28aa2268b tempest-VolumesGetTest-1299330385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-a0691de3-b5c2-4e8b-92bf-9e209689d45d" returned: 0 in 0.475s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:16 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-779e44c4-8c30-44ec-97d4-49a28aa2268b tempest-VolumesGetTest-1299330385 None] Lock "cinder-quobyte-a0691de3-b5c2-4e8b-92bf-9e209689d45d" released by "delete_volume" :: held 1.065s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:29:16 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-779e44c4-8c30-44ec-97d4-49a28aa2268b tempest-VolumesGetTest-1299330385 None] Created reservations ['d076a8f6-f4d1-464f-9a0e-a42cf6aa6986', 'aaf33346-ee03-4ffc-9313-c5a6e853160a', 'b854ef29-2031-4288-93ff-60fecd14cb9f', '5753a882-8033-45f4-bd6f-953181420f85'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:29:16 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-779e44c4-8c30-44ec-97d4-49a28aa2268b tempest-VolumesGetTest-1299330385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:16 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-779e44c4-8c30-44ec-97d4-49a28aa2268b tempest-VolumesGetTest-1299330385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:29:16 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-779e44c4-8c30-44ec-97d4-49a28aa2268b tempest-VolumesGetTest-1299330385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:29:16 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-779e44c4-8c30-44ec-97d4-49a28aa2268b tempest-VolumesGetTest-1299330385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:29:16 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-779e44c4-8c30-44ec-97d4-49a28aa2268b tempest-VolumesGetTest-1299330385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:29:16 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-779e44c4-8c30-44ec-97d4-49a28aa2268b tempest-VolumesGetTest-1299330385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:16 devstack sudo[89649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:29:16 devstack sudo[89649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:17 devstack sudo[89649]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:17 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-779e44c4-8c30-44ec-97d4-49a28aa2268b tempest-VolumesGetTest-1299330385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.387s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:17 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-779e44c4-8c30-44ec-97d4-49a28aa2268b tempest-VolumesGetTest-1299330385 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:29:17 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-779e44c4-8c30-44ec-97d4-49a28aa2268b tempest-VolumesGetTest-1299330385 None] Deleted volume successfully.
Feb 27 01:29:17 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-779e44c4-8c30-44ec-97d4-49a28aa2268b tempest-VolumesGetTest-1299330385 None] Lock "cinder-a0691de3-b5c2-4e8b-92bf-9e209689d45d-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:29:18 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-72f4e12c-fa9c-47d7-a186-9550aa8a6956 tempest-VolumesGetTest-1299330385 None] Acquiring lock "cinder-ef6e36fb-d266-4391-8085-fcd0107dc810-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:29:18 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-72f4e12c-fa9c-47d7-a186-9550aa8a6956 tempest-VolumesGetTest-1299330385 None] Lock "cinder-ef6e36fb-d266-4391-8085-fcd0107dc810-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:29:18 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-72f4e12c-fa9c-47d7-a186-9550aa8a6956 tempest-VolumesGetTest-1299330385 None] Acquiring lock "cinder-quobyte-ef6e36fb-d266-4391-8085-fcd0107dc810" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:29:18 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-72f4e12c-fa9c-47d7-a186-9550aa8a6956 tempest-VolumesGetTest-1299330385 None] Lock "cinder-quobyte-ef6e36fb-d266-4391-8085-fcd0107dc810" acquired by "delete_volume" :: waited 0.015s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:29:18 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4c8b23-8e36-4163-b662-89905447f9f8]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:29:18 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-72f4e12c-fa9c-47d7-a186-9550aa8a6956 tempest-VolumesGetTest-1299330385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ef6e36fb-d266-4391-8085-fcd0107dc810 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:18 devstack sudo[89652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ef6e36fb-d266-4391-8085-fcd0107dc810
Feb 27 01:29:18 devstack sudo[89652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:18 devstack sudo[89652]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:18 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-72f4e12c-fa9c-47d7-a186-9550aa8a6956 tempest-VolumesGetTest-1299330385 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ef6e36fb-d266-4391-8085-fcd0107dc810" returned: 0 in 0.498s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:18 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-72f4e12c-fa9c-47d7-a186-9550aa8a6956 tempest-VolumesGetTest-1299330385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ef6e36fb-d266-4391-8085-fcd0107dc810 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:18 devstack sudo[89657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ef6e36fb-d266-4391-8085-fcd0107dc810
Feb 27 01:29:18 devstack sudo[89657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:18 devstack sudo[89657]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:18 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-72f4e12c-fa9c-47d7-a186-9550aa8a6956 tempest-VolumesGetTest-1299330385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ef6e36fb-d266-4391-8085-fcd0107dc810" returned: 0 in 0.413s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:19 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-72f4e12c-fa9c-47d7-a186-9550aa8a6956 tempest-VolumesGetTest-1299330385 None] Lock "cinder-quobyte-ef6e36fb-d266-4391-8085-fcd0107dc810" released by "delete_volume" :: held 0.934s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:29:19 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-72f4e12c-fa9c-47d7-a186-9550aa8a6956 tempest-VolumesGetTest-1299330385 None] Created reservations ['733e72a3-f5d4-4fb8-a8c9-e8bdd11dc720', '89b20e7f-ce34-46a3-9e4b-ee765cb022c2', 'b73682f9-c4a4-458f-ace6-47faab18a10c', 'f775227c-b2bd-418f-8a81-25e28f73b610'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:29:19 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-72f4e12c-fa9c-47d7-a186-9550aa8a6956 tempest-VolumesGetTest-1299330385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:19 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-72f4e12c-fa9c-47d7-a186-9550aa8a6956 tempest-VolumesGetTest-1299330385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:29:19 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-72f4e12c-fa9c-47d7-a186-9550aa8a6956 tempest-VolumesGetTest-1299330385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:29:19 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-72f4e12c-fa9c-47d7-a186-9550aa8a6956 tempest-VolumesGetTest-1299330385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:29:19 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-72f4e12c-fa9c-47d7-a186-9550aa8a6956 tempest-VolumesGetTest-1299330385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:29:19 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-72f4e12c-fa9c-47d7-a186-9550aa8a6956 tempest-VolumesGetTest-1299330385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:19 devstack sudo[89660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:29:19 devstack sudo[89660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:19 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f9e9ad4-72d5-49b1-9108-bd71274d0f39 tempest-VolumesGetTest-1299330385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:29:19 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-3f9e9ad4-72d5-49b1-9108-bd71274d0f39 tempest-VolumesGetTest-1299330385 None] Flow 'volume_create_manager' (d9c444e6-599c-4a67-b188-d12c66aab29f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:29:19 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-3f9e9ad4-72d5-49b1-9108-bd71274d0f39 tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90ae7726-bb87-41c8-8dbd-71db2a2c5db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:19 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-3f9e9ad4-72d5-49b1-9108-bd71274d0f39 tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90ae7726-bb87-41c8-8dbd-71db2a2c5db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:29:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1661230950',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9db09e36-e368-4def-8ba2-79706a8e29c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62820bf75832490faca5bc43e4724911',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:29:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:29:19Z,use_quota=True,user_id='127cb18bec0a41a9bc4186e2ee63b6a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:19 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-3f9e9ad4-72d5-49b1-9108-bd71274d0f39 tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d1fa5af-5c72-45ae-8fd6-81256bc15f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:19 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-3f9e9ad4-72d5-49b1-9108-bd71274d0f39 tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d1fa5af-5c72-45ae-8fd6-81256bc15f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:19 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-3f9e9ad4-72d5-49b1-9108-bd71274d0f39 tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccfa9eff-033d-4a58-a05f-b25c398bfceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:19 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-3f9e9ad4-72d5-49b1-9108-bd71274d0f39 tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccfa9eff-033d-4a58-a05f-b25c398bfceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9db09e36-e368-4def-8ba2-79706a8e29c4', 'volume_name': 'volume-9db09e36-e368-4def-8ba2-79706a8e29c4', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:19 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-3f9e9ad4-72d5-49b1-9108-bd71274d0f39 tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cb0f84d-aa64-4fcc-b03e-eb1bea637e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:19 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-3f9e9ad4-72d5-49b1-9108-bd71274d0f39 tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cb0f84d-aa64-4fcc-b03e-eb1bea637e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:19 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-3f9e9ad4-72d5-49b1-9108-bd71274d0f39 tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c622852c-f610-474b-b44a-0f5e4947efac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:19 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-3f9e9ad4-72d5-49b1-9108-bd71274d0f39 tempest-VolumesGetTest-1299330385 None] Volume 9db09e36-e368-4def-8ba2-79706a8e29c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9db09e36-e368-4def-8ba2-79706a8e29c4', 'volume_size': 1}
Feb 27 01:29:19 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-3f9e9ad4-72d5-49b1-9108-bd71274d0f39 tempest-VolumesGetTest-1299330385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:19 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-3f9e9ad4-72d5-49b1-9108-bd71274d0f39 tempest-VolumesGetTest-1299330385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:29:19 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-3f9e9ad4-72d5-49b1-9108-bd71274d0f39 tempest-VolumesGetTest-1299330385 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:29:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1661230950',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9db09e36-e368-4def-8ba2-79706a8e29c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62820bf75832490faca5bc43e4724911',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:29:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:29:19Z,use_quota=True,user_id='127cb18bec0a41a9bc4186e2ee63b6a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:29:19 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-3f9e9ad4-72d5-49b1-9108-bd71274d0f39 tempest-VolumesGetTest-1299330385 None] Creating volume 9db09e36-e368-4def-8ba2-79706a8e29c4 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:29:19 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-3f9e9ad4-72d5-49b1-9108-bd71274d0f39 tempest-VolumesGetTest-1299330385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:19 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-3f9e9ad4-72d5-49b1-9108-bd71274d0f39 tempest-VolumesGetTest-1299330385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:29:19 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-3f9e9ad4-72d5-49b1-9108-bd71274d0f39 tempest-VolumesGetTest-1299330385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:29:19 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-3f9e9ad4-72d5-49b1-9108-bd71274d0f39 tempest-VolumesGetTest-1299330385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:29:19 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-3f9e9ad4-72d5-49b1-9108-bd71274d0f39 tempest-VolumesGetTest-1299330385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:29:19 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-3f9e9ad4-72d5-49b1-9108-bd71274d0f39 tempest-VolumesGetTest-1299330385 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:29:19 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-3f9e9ad4-72d5-49b1-9108-bd71274d0f39 tempest-VolumesGetTest-1299330385 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:29:19 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-3f9e9ad4-72d5-49b1-9108-bd71274d0f39 tempest-VolumesGetTest-1299330385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9db09e36-e368-4def-8ba2-79706a8e29c4 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:19 devstack sudo[89665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9db09e36-e368-4def-8ba2-79706a8e29c4 1073741824
Feb 27 01:29:19 devstack sudo[89665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:19 devstack sudo[89660]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:19 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-72f4e12c-fa9c-47d7-a186-9550aa8a6956 tempest-VolumesGetTest-1299330385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.475s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:19 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-72f4e12c-fa9c-47d7-a186-9550aa8a6956 tempest-VolumesGetTest-1299330385 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:29:19 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-72f4e12c-fa9c-47d7-a186-9550aa8a6956 tempest-VolumesGetTest-1299330385 None] Deleted volume successfully.
Feb 27 01:29:19 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-72f4e12c-fa9c-47d7-a186-9550aa8a6956 tempest-VolumesGetTest-1299330385 None] Lock "cinder-ef6e36fb-d266-4391-8085-fcd0107dc810-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:29:19 devstack sudo[89665]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:19 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-3f9e9ad4-72d5-49b1-9108-bd71274d0f39 tempest-VolumesGetTest-1299330385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9db09e36-e368-4def-8ba2-79706a8e29c4 1073741824" returned: 0 in 0.487s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:19 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-3f9e9ad4-72d5-49b1-9108-bd71274d0f39 tempest-VolumesGetTest-1299330385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9db09e36-e368-4def-8ba2-79706a8e29c4 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:19 devstack sudo[89671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9db09e36-e368-4def-8ba2-79706a8e29c4
Feb 27 01:29:20 devstack sudo[89671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:20 devstack sudo[89671]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:20 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-3f9e9ad4-72d5-49b1-9108-bd71274d0f39 tempest-VolumesGetTest-1299330385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9db09e36-e368-4def-8ba2-79706a8e29c4" returned: 0 in 0.454s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:20 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-3f9e9ad4-72d5-49b1-9108-bd71274d0f39 tempest-VolumesGetTest-1299330385 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:29:20 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-3f9e9ad4-72d5-49b1-9108-bd71274d0f39 tempest-VolumesGetTest-1299330385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:29:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-3f9e9ad4-72d5-49b1-9108-bd71274d0f39 tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c622852c-f610-474b-b44a-0f5e4947efac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9db09e36-e368-4def-8ba2-79706a8e29c4', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-3f9e9ad4-72d5-49b1-9108-bd71274d0f39 tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d71a6abe-b3be-4b12-aa7c-d64cf36d515b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:20 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-3f9e9ad4-72d5-49b1-9108-bd71274d0f39 tempest-VolumesGetTest-1299330385 None] Volume volume-9db09e36-e368-4def-8ba2-79706a8e29c4 (9db09e36-e368-4def-8ba2-79706a8e29c4): created successfully
Feb 27 01:29:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-3f9e9ad4-72d5-49b1-9108-bd71274d0f39 tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d71a6abe-b3be-4b12-aa7c-d64cf36d515b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-3f9e9ad4-72d5-49b1-9108-bd71274d0f39 tempest-VolumesGetTest-1299330385 None] Flow 'volume_create_manager' (d9c444e6-599c-4a67-b188-d12c66aab29f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:29:20 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-3f9e9ad4-72d5-49b1-9108-bd71274d0f39 tempest-VolumesGetTest-1299330385 None] Created volume successfully.
Feb 27 01:29:21 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:29:21 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] Flow 'volume_create_manager' (5941534b-2af2-4e63-892c-add73b380adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:29:21 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae555649-c4be-4570-b4fd-3db83d635e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:21 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae555649-c4be-4570-b4fd-3db83d635e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:29:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2028518643',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71204c91-3819-4fd8-b7e3-5b4afdef2c4f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='62820bf75832490faca5bc43e4724911',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:29:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=9db09e36-e368-4def-8ba2-79706a8e29c4,status='creating',terminated_at=None,updated_at=2026-02-27T00:29:22Z,use_quota=True,user_id='127cb18bec0a41a9bc4186e2ee63b6a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:21 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd54d13e-6ac1-4948-bdd5-c115413bb2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:21 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd54d13e-6ac1-4948-bdd5-c115413bb2f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:21 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0cc293e-eada-456e-93dd-e18aeeec312d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:21 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0cc293e-eada-456e-93dd-e18aeeec312d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '71204c91-3819-4fd8-b7e3-5b4afdef2c4f', 'volume_name': 'volume-71204c91-3819-4fd8-b7e3-5b4afdef2c4f', 'volume_size': 1, 'source_volid': '9db09e36-e368-4def-8ba2-79706a8e29c4', 'source_volstatus': 'available'}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:21 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f6dd789-d0a1-4b8e-bc17-7619af0e289c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:21 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f6dd789-d0a1-4b8e-bc17-7619af0e289c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:21 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ee14f8e-c096-4a54-a25d-240fccb06e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:21 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] Volume 71204c91-3819-4fd8-b7e3-5b4afdef2c4f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-71204c91-3819-4fd8-b7e3-5b4afdef2c4f', 'volume_size': 1, 'source_volid': '9db09e36-e368-4def-8ba2-79706a8e29c4', 'source_volstatus': 'available'}
Feb 27 01:29:21 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:21 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:29:21 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] Cloning volume 9db09e36-e368-4def-8ba2-79706a8e29c4 to volume 71204c91-3819-4fd8-b7e3-5b4afdef2c4f
Feb 27 01:29:21 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] Creating offline snapshot f5fe7e36-42bf-4fef-bdcf-d61e5ddbeca7 of volume 9db09e36-e368-4def-8ba2-79706a8e29c4 {{(pid=83106) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:29:22 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ddc6372-ce67-4043-8cc1-4ed9d598a0fd]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:29:22 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9db09e36-e368-4def-8ba2-79706a8e29c4 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:22 devstack sudo[89702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9db09e36-e368-4def-8ba2-79706a8e29c4
Feb 27 01:29:22 devstack sudo[89702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:22 devstack sudo[89702]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:22 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9db09e36-e368-4def-8ba2-79706a8e29c4" returned: 0 in 0.582s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:22 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9db09e36-e368-4def-8ba2-79706a8e29c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9db09e36-e368-4def-8ba2-79706a8e29c4.f5fe7e36-42bf-4fef-bdcf-d61e5ddbeca7 1G {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:22 devstack sudo[89707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9db09e36-e368-4def-8ba2-79706a8e29c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9db09e36-e368-4def-8ba2-79706a8e29c4.f5fe7e36-42bf-4fef-bdcf-d61e5ddbeca7 1G
Feb 27 01:29:22 devstack sudo[89707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:23 devstack sudo[89707]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:23 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9db09e36-e368-4def-8ba2-79706a8e29c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9db09e36-e368-4def-8ba2-79706a8e29c4.f5fe7e36-42bf-4fef-bdcf-d61e5ddbeca7 1G" returned: 0 in 0.677s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:23 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9db09e36-e368-4def-8ba2-79706a8e29c4 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9db09e36-e368-4def-8ba2-79706a8e29c4.f5fe7e36-42bf-4fef-bdcf-d61e5ddbeca7 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:23 devstack sudo[89713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9db09e36-e368-4def-8ba2-79706a8e29c4 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9db09e36-e368-4def-8ba2-79706a8e29c4.f5fe7e36-42bf-4fef-bdcf-d61e5ddbeca7
Feb 27 01:29:23 devstack sudo[89713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:23 devstack sudo[89713]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:23 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9db09e36-e368-4def-8ba2-79706a8e29c4 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9db09e36-e368-4def-8ba2-79706a8e29c4.f5fe7e36-42bf-4fef-bdcf-d61e5ddbeca7" returned: 0 in 0.482s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:23 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9db09e36-e368-4def-8ba2-79706a8e29c4.f5fe7e36-42bf-4fef-bdcf-d61e5ddbeca7 is being set with open permissions: ugo+rw
Feb 27 01:29:23 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9db09e36-e368-4def-8ba2-79706a8e29c4.f5fe7e36-42bf-4fef-bdcf-d61e5ddbeca7 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:23 devstack sudo[89719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9db09e36-e368-4def-8ba2-79706a8e29c4.f5fe7e36-42bf-4fef-bdcf-d61e5ddbeca7
Feb 27 01:29:23 devstack sudo[89719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:24 devstack sudo[89719]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:24 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9db09e36-e368-4def-8ba2-79706a8e29c4.f5fe7e36-42bf-4fef-bdcf-d61e5ddbeca7" returned: 0 in 0.512s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:24 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9db09e36-e368-4def-8ba2-79706a8e29c4.info {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:24 devstack sudo[89747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9db09e36-e368-4def-8ba2-79706a8e29c4.info
Feb 27 01:29:24 devstack sudo[89747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:24 devstack sudo[89747]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:24 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9db09e36-e368-4def-8ba2-79706a8e29c4.info" returned: 0 in 0.457s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:24 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9db09e36-e368-4def-8ba2-79706a8e29c4.info is being set with open permissions: ugo+rw
Feb 27 01:29:24 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9db09e36-e368-4def-8ba2-79706a8e29c4.info {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:24 devstack sudo[89751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9db09e36-e368-4def-8ba2-79706a8e29c4.info
Feb 27 01:29:24 devstack sudo[89751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:25 devstack sudo[89751]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:25 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9db09e36-e368-4def-8ba2-79706a8e29c4.info" returned: 0 in 0.446s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:25 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] Acquiring lock "cinder-quobyte-71204c91-3819-4fd8-b7e3-5b4afdef2c4f" by "_copy_volume_from_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:29:25 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] Lock "cinder-quobyte-71204c91-3819-4fd8-b7e3-5b4afdef2c4f" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:29:25 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] snapshot: f5fe7e36-42bf-4fef-bdcf-d61e5ddbeca7, volume: 71204c91-3819-4fd8-b7e3-5b4afdef2c4f,  {{(pid=83106) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Feb 27 01:29:25 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:25 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:29:25 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:29:25 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:29:25 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:29:25 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[e644461e-ddcc-406c-b7d6-8476977f353e]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:29:25 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9db09e36-e368-4def-8ba2-79706a8e29c4.f5fe7e36-42bf-4fef-bdcf-d61e5ddbeca7 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:25 devstack sudo[89754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9db09e36-e368-4def-8ba2-79706a8e29c4.f5fe7e36-42bf-4fef-bdcf-d61e5ddbeca7
Feb 27 01:29:25 devstack sudo[89754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:25 devstack sudo[89754]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:25 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9db09e36-e368-4def-8ba2-79706a8e29c4.f5fe7e36-42bf-4fef-bdcf-d61e5ddbeca7" returned: 0 in 0.591s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:25 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9db09e36-e368-4def-8ba2-79706a8e29c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83106) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:29:25 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9db09e36-e368-4def-8ba2-79706a8e29c4 {{(pid=83106) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Feb 27 01:29:25 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] Creating direct copy from snapshot {{(pid=83106) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Feb 27 01:29:25 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c54d39-b151-4d4c-afd1-2f74a61d7319]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:29:25 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9db09e36-e368-4def-8ba2-79706a8e29c4 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:26 devstack sudo[89760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9db09e36-e368-4def-8ba2-79706a8e29c4
Feb 27 01:29:26 devstack sudo[89760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:26 devstack sudo[89760]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:26 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9db09e36-e368-4def-8ba2-79706a8e29c4" returned: 0 in 0.548s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:26 devstack cinder-volume[83106]: DEBUG cinder.utils [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] Path /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-71204c91-3819-4fd8-b7e3-5b4afdef2c4f not found in is_blk_device check {{(pid=83106) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Feb 27 01:29:26 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9db09e36-e368-4def-8ba2-79706a8e29c4 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-71204c91-3819-4fd8-b7e3-5b4afdef2c4f {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:26 devstack sudo[89766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9db09e36-e368-4def-8ba2-79706a8e29c4 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-71204c91-3819-4fd8-b7e3-5b4afdef2c4f
Feb 27 01:29:26 devstack sudo[89766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:28 devstack sudo[89766]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:28 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9db09e36-e368-4def-8ba2-79706a8e29c4 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-71204c91-3819-4fd8-b7e3-5b4afdef2c4f" returned: 0 in 2.455s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:28 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7abf32-7dd7-4735-aef2-2d3af97820af]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:29:28 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9db09e36-e368-4def-8ba2-79706a8e29c4 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:29 devstack sudo[89778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9db09e36-e368-4def-8ba2-79706a8e29c4
Feb 27 01:29:29 devstack sudo[89778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:29 devstack sudo[89778]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:29 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9db09e36-e368-4def-8ba2-79706a8e29c4" returned: 0 in 0.670s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:29 devstack cinder-volume[83106]: DEBUG cinder.image.image_utils [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] Image conversion details: src /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9db09e36-e368-4def-8ba2-79706a8e29c4, size 1024.00 MB, duration 2.46 sec, destination /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-71204c91-3819-4fd8-b7e3-5b4afdef2c4f {{(pid=83106) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 27 01:29:29 devstack cinder-volume[83106]: INFO cinder.image.image_utils [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] Converted 1024.00 MB image at 416.83 MB/s
Feb 27 01:29:29 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-71204c91-3819-4fd8-b7e3-5b4afdef2c4f is being set with open permissions: ugo+rw
Feb 27 01:29:29 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-71204c91-3819-4fd8-b7e3-5b4afdef2c4f {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:29 devstack sudo[89783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-71204c91-3819-4fd8-b7e3-5b4afdef2c4f
Feb 27 01:29:29 devstack sudo[89783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:30 devstack sudo[89783]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:30 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-71204c91-3819-4fd8-b7e3-5b4afdef2c4f" returned: 0 in 0.471s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:30 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] Lock "cinder-quobyte-71204c91-3819-4fd8-b7e3-5b4afdef2c4f" released by "_copy_volume_from_snapshot" :: held 4.787s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:29:30 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] Acquiring lock "cinder-quobyte-f5fe7e36-42bf-4fef-bdcf-d61e5ddbeca7" by "_delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:29:30 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] Lock "cinder-quobyte-f5fe7e36-42bf-4fef-bdcf-d61e5ddbeca7" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:29:30 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] Deleting offline snapshot f5fe7e36-42bf-4fef-bdcf-d61e5ddbeca7 of volume 9db09e36-e368-4def-8ba2-79706a8e29c4 {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:29:30 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] snapshot_file for this snap is: volume-9db09e36-e368-4def-8ba2-79706a8e29c4.f5fe7e36-42bf-4fef-bdcf-d61e5ddbeca7 {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:29:30 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[b531fe14-313e-4666-aeee-c40c4bdcc23f]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:29:30 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9db09e36-e368-4def-8ba2-79706a8e29c4.f5fe7e36-42bf-4fef-bdcf-d61e5ddbeca7 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:30 devstack sudo[89786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9db09e36-e368-4def-8ba2-79706a8e29c4.f5fe7e36-42bf-4fef-bdcf-d61e5ddbeca7
Feb 27 01:29:30 devstack sudo[89786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:30 devstack sudo[89786]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:30 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9db09e36-e368-4def-8ba2-79706a8e29c4.f5fe7e36-42bf-4fef-bdcf-d61e5ddbeca7" returned: 0 in 0.643s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:30 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9db09e36-e368-4def-8ba2-79706a8e29c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83106) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:29:30 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e72862-8860-4734-a479-9d8f7a186f8a]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:29:30 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9db09e36-e368-4def-8ba2-79706a8e29c4 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:30 devstack sudo[89791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9db09e36-e368-4def-8ba2-79706a8e29c4
Feb 27 01:29:30 devstack sudo[89791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:31 devstack sudo[89791]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:31 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9db09e36-e368-4def-8ba2-79706a8e29c4" returned: 0 in 0.557s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:31 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9db09e36-e368-4def-8ba2-79706a8e29c4.f5fe7e36-42bf-4fef-bdcf-d61e5ddbeca7 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:31 devstack sudo[89796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9db09e36-e368-4def-8ba2-79706a8e29c4.f5fe7e36-42bf-4fef-bdcf-d61e5ddbeca7
Feb 27 01:29:31 devstack sudo[89796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:31 devstack sudo[89796]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:31 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9db09e36-e368-4def-8ba2-79706a8e29c4.f5fe7e36-42bf-4fef-bdcf-d61e5ddbeca7" returned: 0 in 0.567s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:31 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9db09e36-e368-4def-8ba2-79706a8e29c4.f5fe7e36-42bf-4fef-bdcf-d61e5ddbeca7 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:31 devstack sudo[89801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9db09e36-e368-4def-8ba2-79706a8e29c4.f5fe7e36-42bf-4fef-bdcf-d61e5ddbeca7
Feb 27 01:29:31 devstack sudo[89801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:32 devstack sudo[89801]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:32 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9db09e36-e368-4def-8ba2-79706a8e29c4.f5fe7e36-42bf-4fef-bdcf-d61e5ddbeca7" returned: 0 in 0.462s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:32 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] Lock "cinder-quobyte-f5fe7e36-42bf-4fef-bdcf-d61e5ddbeca7" released by "_delete_snapshot" :: held 2.285s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:29:32 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.468s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:29:32 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ee14f8e-c096-4a54-a25d-240fccb06e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71204c91-3819-4fd8-b7e3-5b4afdef2c4f', 'volume_size': 1, 'source_volid': '9db09e36-e368-4def-8ba2-79706a8e29c4', 'source_volstatus': 'available'}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:32 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2732a652-ce4b-4ef1-a01c-265e51ae291b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:32 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] Volume volume-71204c91-3819-4fd8-b7e3-5b4afdef2c4f (71204c91-3819-4fd8-b7e3-5b4afdef2c4f): created successfully
Feb 27 01:29:32 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2732a652-ce4b-4ef1-a01c-265e51ae291b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:32 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] Flow 'volume_create_manager' (5941534b-2af2-4e63-892c-add73b380adb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:29:32 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-c67a69b7-5f8a-466e-bd3d-75fbc5dffd2a tempest-VolumesGetTest-1299330385 None] Created volume successfully.
Feb 27 01:29:33 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-114d8039-cbdf-4938-be27-06a6037e81ec tempest-VolumesGetTest-1299330385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:29:33 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-114d8039-cbdf-4938-be27-06a6037e81ec tempest-VolumesGetTest-1299330385 None] Flow 'volume_create_manager' (7a796813-2ea3-48d6-8f8d-d6a7ea53fe20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:29:33 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-114d8039-cbdf-4938-be27-06a6037e81ec tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80587bb6-35b4-4979-b238-290c25781a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:33 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-114d8039-cbdf-4938-be27-06a6037e81ec tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80587bb6-35b4-4979-b238-290c25781a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:29:33Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-700865321',display_name='tempest-VolumesGetTest-Volume-813335455',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82766af6-7ecf-4cfe-8fc4-8932fe28e802,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62820bf75832490faca5bc43e4724911',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:29:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:29:33Z,use_quota=True,user_id='127cb18bec0a41a9bc4186e2ee63b6a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:33 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-114d8039-cbdf-4938-be27-06a6037e81ec tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ec49900-c4e1-4cdd-bd45-9a3e21ac477e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:33 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-114d8039-cbdf-4938-be27-06a6037e81ec tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ec49900-c4e1-4cdd-bd45-9a3e21ac477e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:33 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-114d8039-cbdf-4938-be27-06a6037e81ec tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c13fd1c-699c-4941-bd85-bfc42d09d457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:33 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-114d8039-cbdf-4938-be27-06a6037e81ec tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c13fd1c-699c-4941-bd85-bfc42d09d457) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82766af6-7ecf-4cfe-8fc4-8932fe28e802', 'volume_name': 'volume-82766af6-7ecf-4cfe-8fc4-8932fe28e802', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:33 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-114d8039-cbdf-4938-be27-06a6037e81ec tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4a18bb1-104d-4118-982a-73183095db27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:33 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-114d8039-cbdf-4938-be27-06a6037e81ec tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4a18bb1-104d-4118-982a-73183095db27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:33 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-114d8039-cbdf-4938-be27-06a6037e81ec tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c87fad8d-72b1-46c9-8f4d-89430cd393bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:33 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-114d8039-cbdf-4938-be27-06a6037e81ec tempest-VolumesGetTest-1299330385 None] Volume 82766af6-7ecf-4cfe-8fc4-8932fe28e802: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82766af6-7ecf-4cfe-8fc4-8932fe28e802', 'volume_size': 1}
Feb 27 01:29:33 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-114d8039-cbdf-4938-be27-06a6037e81ec tempest-VolumesGetTest-1299330385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:33 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-114d8039-cbdf-4938-be27-06a6037e81ec tempest-VolumesGetTest-1299330385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:29:33 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-114d8039-cbdf-4938-be27-06a6037e81ec tempest-VolumesGetTest-1299330385 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:29:33Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-700865321',display_name='tempest-VolumesGetTest-Volume-813335455',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82766af6-7ecf-4cfe-8fc4-8932fe28e802,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62820bf75832490faca5bc43e4724911',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:29:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:29:33Z,use_quota=True,user_id='127cb18bec0a41a9bc4186e2ee63b6a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:29:33 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-114d8039-cbdf-4938-be27-06a6037e81ec tempest-VolumesGetTest-1299330385 None] Creating volume 82766af6-7ecf-4cfe-8fc4-8932fe28e802 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:29:33 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-114d8039-cbdf-4938-be27-06a6037e81ec tempest-VolumesGetTest-1299330385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:33 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-114d8039-cbdf-4938-be27-06a6037e81ec tempest-VolumesGetTest-1299330385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:29:33 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-114d8039-cbdf-4938-be27-06a6037e81ec tempest-VolumesGetTest-1299330385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:29:33 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-114d8039-cbdf-4938-be27-06a6037e81ec tempest-VolumesGetTest-1299330385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:29:33 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-114d8039-cbdf-4938-be27-06a6037e81ec tempest-VolumesGetTest-1299330385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:29:33 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-114d8039-cbdf-4938-be27-06a6037e81ec tempest-VolumesGetTest-1299330385 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:29:33 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-114d8039-cbdf-4938-be27-06a6037e81ec tempest-VolumesGetTest-1299330385 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:29:33 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-114d8039-cbdf-4938-be27-06a6037e81ec tempest-VolumesGetTest-1299330385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-82766af6-7ecf-4cfe-8fc4-8932fe28e802 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:33 devstack sudo[89807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-82766af6-7ecf-4cfe-8fc4-8932fe28e802 1073741824
Feb 27 01:29:33 devstack sudo[89807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:33 devstack sudo[89807]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:33 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-114d8039-cbdf-4938-be27-06a6037e81ec tempest-VolumesGetTest-1299330385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-82766af6-7ecf-4cfe-8fc4-8932fe28e802 1073741824" returned: 0 in 0.581s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:33 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-114d8039-cbdf-4938-be27-06a6037e81ec tempest-VolumesGetTest-1299330385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-82766af6-7ecf-4cfe-8fc4-8932fe28e802 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:33 devstack sudo[89812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-82766af6-7ecf-4cfe-8fc4-8932fe28e802
Feb 27 01:29:33 devstack sudo[89812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:34 devstack sudo[89812]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:34 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-114d8039-cbdf-4938-be27-06a6037e81ec tempest-VolumesGetTest-1299330385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-82766af6-7ecf-4cfe-8fc4-8932fe28e802" returned: 0 in 0.563s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:34 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-114d8039-cbdf-4938-be27-06a6037e81ec tempest-VolumesGetTest-1299330385 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:29:34 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-114d8039-cbdf-4938-be27-06a6037e81ec tempest-VolumesGetTest-1299330385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:29:34 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-114d8039-cbdf-4938-be27-06a6037e81ec tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c87fad8d-72b1-46c9-8f4d-89430cd393bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82766af6-7ecf-4cfe-8fc4-8932fe28e802', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:34 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-114d8039-cbdf-4938-be27-06a6037e81ec tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7960f4a-7f6e-44f9-ac2f-4f7d38d4fb89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:34 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-114d8039-cbdf-4938-be27-06a6037e81ec tempest-VolumesGetTest-1299330385 None] Volume volume-82766af6-7ecf-4cfe-8fc4-8932fe28e802 (82766af6-7ecf-4cfe-8fc4-8932fe28e802): created successfully
Feb 27 01:29:34 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-114d8039-cbdf-4938-be27-06a6037e81ec tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7960f4a-7f6e-44f9-ac2f-4f7d38d4fb89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:34 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-114d8039-cbdf-4938-be27-06a6037e81ec tempest-VolumesGetTest-1299330385 None] Flow 'volume_create_manager' (7a796813-2ea3-48d6-8f8d-d6a7ea53fe20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:29:34 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-114d8039-cbdf-4938-be27-06a6037e81ec tempest-VolumesGetTest-1299330385 None] Created volume successfully.
Feb 27 01:29:34 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-cf8657d7-9652-46d6-a868-e2bef6490a3e tempest-VolumesNegativeTest-891639816 None] Acquiring lock "cinder-4d6bca05-3f56-4a07-9d1b-711bc76b6e93-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:29:34 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-cf8657d7-9652-46d6-a868-e2bef6490a3e tempest-VolumesNegativeTest-891639816 None] Lock "cinder-4d6bca05-3f56-4a07-9d1b-711bc76b6e93-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:29:34 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-cf8657d7-9652-46d6-a868-e2bef6490a3e tempest-VolumesNegativeTest-891639816 None] Acquiring lock "cinder-quobyte-4d6bca05-3f56-4a07-9d1b-711bc76b6e93" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:29:34 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-cf8657d7-9652-46d6-a868-e2bef6490a3e tempest-VolumesNegativeTest-891639816 None] Lock "cinder-quobyte-4d6bca05-3f56-4a07-9d1b-711bc76b6e93" acquired by "delete_volume" :: waited 0.008s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:29:34 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2d6a9c-1114-4335-975d-5dee6aa07510]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:29:34 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-cf8657d7-9652-46d6-a868-e2bef6490a3e tempest-VolumesNegativeTest-891639816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-4d6bca05-3f56-4a07-9d1b-711bc76b6e93 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:35 devstack sudo[89815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-4d6bca05-3f56-4a07-9d1b-711bc76b6e93
Feb 27 01:29:35 devstack sudo[89815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:35 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-e666a665-9eff-4ec5-b466-b1d951f065a7 tempest-VolumesGetTest-1299330385 None] Acquiring lock "cinder-82766af6-7ecf-4cfe-8fc4-8932fe28e802-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:29:35 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-e666a665-9eff-4ec5-b466-b1d951f065a7 tempest-VolumesGetTest-1299330385 None] Lock "cinder-82766af6-7ecf-4cfe-8fc4-8932fe28e802-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:29:35 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-e666a665-9eff-4ec5-b466-b1d951f065a7 tempest-VolumesGetTest-1299330385 None] Acquiring lock "cinder-quobyte-82766af6-7ecf-4cfe-8fc4-8932fe28e802" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:29:35 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-e666a665-9eff-4ec5-b466-b1d951f065a7 tempest-VolumesGetTest-1299330385 None] Lock "cinder-quobyte-82766af6-7ecf-4cfe-8fc4-8932fe28e802" acquired by "delete_volume" :: waited 0.012s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:29:35 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5201d63-f6e3-4578-8e5a-944bfc4879fb]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:29:35 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-e666a665-9eff-4ec5-b466-b1d951f065a7 tempest-VolumesGetTest-1299330385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-82766af6-7ecf-4cfe-8fc4-8932fe28e802 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:35 devstack sudo[89815]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:35 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-cf8657d7-9652-46d6-a868-e2bef6490a3e tempest-VolumesNegativeTest-891639816 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-4d6bca05-3f56-4a07-9d1b-711bc76b6e93" returned: 0 in 0.523s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:35 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-cf8657d7-9652-46d6-a868-e2bef6490a3e tempest-VolumesNegativeTest-891639816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-4d6bca05-3f56-4a07-9d1b-711bc76b6e93 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:35 devstack sudo[89821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-4d6bca05-3f56-4a07-9d1b-711bc76b6e93
Feb 27 01:29:35 devstack sudo[89821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:35 devstack sudo[89820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-82766af6-7ecf-4cfe-8fc4-8932fe28e802
Feb 27 01:29:35 devstack sudo[89820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:36 devstack sudo[89820]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:36 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-e666a665-9eff-4ec5-b466-b1d951f065a7 tempest-VolumesGetTest-1299330385 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-82766af6-7ecf-4cfe-8fc4-8932fe28e802" returned: 0 in 0.556s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:36 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-e666a665-9eff-4ec5-b466-b1d951f065a7 tempest-VolumesGetTest-1299330385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-82766af6-7ecf-4cfe-8fc4-8932fe28e802 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:36 devstack sudo[89821]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:36 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-cf8657d7-9652-46d6-a868-e2bef6490a3e tempest-VolumesNegativeTest-891639816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-4d6bca05-3f56-4a07-9d1b-711bc76b6e93" returned: 0 in 0.529s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:36 devstack sudo[89828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-82766af6-7ecf-4cfe-8fc4-8932fe28e802
Feb 27 01:29:36 devstack sudo[89828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:36 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-cf8657d7-9652-46d6-a868-e2bef6490a3e tempest-VolumesNegativeTest-891639816 None] Lock "cinder-quobyte-4d6bca05-3f56-4a07-9d1b-711bc76b6e93" released by "delete_volume" :: held 1.087s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:29:36 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-cf8657d7-9652-46d6-a868-e2bef6490a3e tempest-VolumesNegativeTest-891639816 None] Created reservations ['f43f719d-5a8e-4549-b07e-dfc7422a9a57', '891dd874-1430-4171-bd2b-6b603a40f809', 'e74e1e88-c063-47c9-be0c-5e81d9b8c522', 'e87cf1cf-4289-4305-bb4d-127cad1d4454'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:29:36 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-cf8657d7-9652-46d6-a868-e2bef6490a3e tempest-VolumesNegativeTest-891639816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:36 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-cf8657d7-9652-46d6-a868-e2bef6490a3e tempest-VolumesNegativeTest-891639816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:29:36 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-cf8657d7-9652-46d6-a868-e2bef6490a3e tempest-VolumesNegativeTest-891639816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:29:36 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-cf8657d7-9652-46d6-a868-e2bef6490a3e tempest-VolumesNegativeTest-891639816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:29:36 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-cf8657d7-9652-46d6-a868-e2bef6490a3e tempest-VolumesNegativeTest-891639816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:29:36 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-cf8657d7-9652-46d6-a868-e2bef6490a3e tempest-VolumesNegativeTest-891639816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:36 devstack sudo[89830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:29:36 devstack sudo[89830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:36 devstack sudo[89828]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:36 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-e666a665-9eff-4ec5-b466-b1d951f065a7 tempest-VolumesGetTest-1299330385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-82766af6-7ecf-4cfe-8fc4-8932fe28e802" returned: 0 in 0.511s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:36 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-e666a665-9eff-4ec5-b466-b1d951f065a7 tempest-VolumesGetTest-1299330385 None] Lock "cinder-quobyte-82766af6-7ecf-4cfe-8fc4-8932fe28e802" released by "delete_volume" :: held 1.091s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:29:36 devstack sudo[89830]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:36 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-cf8657d7-9652-46d6-a868-e2bef6490a3e tempest-VolumesNegativeTest-891639816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.444s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:36 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-cf8657d7-9652-46d6-a868-e2bef6490a3e tempest-VolumesNegativeTest-891639816 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:29:36 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-e666a665-9eff-4ec5-b466-b1d951f065a7 tempest-VolumesGetTest-1299330385 None] Created reservations ['30a03bb8-90e9-4cf0-a1d6-7cca8c167f38', '25cddca9-fab1-4313-b846-64849503c76e', '25ed2692-0dfc-4f32-846a-ca40091aafe3', '6ad909b5-963f-429e-874c-799c82fabb1a'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:29:36 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-cf8657d7-9652-46d6-a868-e2bef6490a3e tempest-VolumesNegativeTest-891639816 None] Deleted volume successfully.
Feb 27 01:29:36 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-cf8657d7-9652-46d6-a868-e2bef6490a3e tempest-VolumesNegativeTest-891639816 None] Lock "cinder-4d6bca05-3f56-4a07-9d1b-711bc76b6e93-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:29:36 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-e666a665-9eff-4ec5-b466-b1d951f065a7 tempest-VolumesGetTest-1299330385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:36 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-e666a665-9eff-4ec5-b466-b1d951f065a7 tempest-VolumesGetTest-1299330385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:29:36 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-e666a665-9eff-4ec5-b466-b1d951f065a7 tempest-VolumesGetTest-1299330385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:29:36 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-e666a665-9eff-4ec5-b466-b1d951f065a7 tempest-VolumesGetTest-1299330385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:29:36 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-e666a665-9eff-4ec5-b466-b1d951f065a7 tempest-VolumesGetTest-1299330385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:29:36 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-e666a665-9eff-4ec5-b466-b1d951f065a7 tempest-VolumesGetTest-1299330385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:36 devstack sudo[89834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:29:36 devstack sudo[89834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:37 devstack sudo[89834]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-e666a665-9eff-4ec5-b466-b1d951f065a7 tempest-VolumesGetTest-1299330385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.474s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:37 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-e666a665-9eff-4ec5-b466-b1d951f065a7 tempest-VolumesGetTest-1299330385 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:29:37 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-e666a665-9eff-4ec5-b466-b1d951f065a7 tempest-VolumesGetTest-1299330385 None] Deleted volume successfully.
Feb 27 01:29:37 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-e666a665-9eff-4ec5-b466-b1d951f065a7 tempest-VolumesGetTest-1299330385 None] Lock "cinder-82766af6-7ecf-4cfe-8fc4-8932fe28e802-delete_volume" released by "delete_volume" :: held 1.727s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:29:37 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5a47a023-c51c-47f5-a34a-c8deef74558a tempest-VolumesGetTest-1299330385 None] Acquiring lock "cinder-71204c91-3819-4fd8-b7e3-5b4afdef2c4f-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:29:37 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5a47a023-c51c-47f5-a34a-c8deef74558a tempest-VolumesGetTest-1299330385 None] Lock "cinder-71204c91-3819-4fd8-b7e3-5b4afdef2c4f-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:29:37 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5a47a023-c51c-47f5-a34a-c8deef74558a tempest-VolumesGetTest-1299330385 None] Acquiring lock "cinder-quobyte-71204c91-3819-4fd8-b7e3-5b4afdef2c4f" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:29:37 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5a47a023-c51c-47f5-a34a-c8deef74558a tempest-VolumesGetTest-1299330385 None] Lock "cinder-quobyte-71204c91-3819-4fd8-b7e3-5b4afdef2c4f" acquired by "delete_volume" :: waited 0.012s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:29:37 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e4a167-99b0-4629-a216-0f7c9dc8891e]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:29:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5a47a023-c51c-47f5-a34a-c8deef74558a tempest-VolumesGetTest-1299330385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-71204c91-3819-4fd8-b7e3-5b4afdef2c4f {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:37 devstack sudo[89837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-71204c91-3819-4fd8-b7e3-5b4afdef2c4f
Feb 27 01:29:37 devstack sudo[89837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:38 devstack sudo[89837]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:38 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5a47a023-c51c-47f5-a34a-c8deef74558a tempest-VolumesGetTest-1299330385 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-71204c91-3819-4fd8-b7e3-5b4afdef2c4f" returned: 0 in 0.531s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:38 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5a47a023-c51c-47f5-a34a-c8deef74558a tempest-VolumesGetTest-1299330385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-71204c91-3819-4fd8-b7e3-5b4afdef2c4f {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:38 devstack sudo[89842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-71204c91-3819-4fd8-b7e3-5b4afdef2c4f
Feb 27 01:29:38 devstack sudo[89842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:38 devstack sudo[89842]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:38 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5a47a023-c51c-47f5-a34a-c8deef74558a tempest-VolumesGetTest-1299330385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-71204c91-3819-4fd8-b7e3-5b4afdef2c4f" returned: 0 in 0.511s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:38 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5a47a023-c51c-47f5-a34a-c8deef74558a tempest-VolumesGetTest-1299330385 None] Lock "cinder-quobyte-71204c91-3819-4fd8-b7e3-5b4afdef2c4f" released by "delete_volume" :: held 1.072s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:29:38 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-5a47a023-c51c-47f5-a34a-c8deef74558a tempest-VolumesGetTest-1299330385 None] Created reservations ['b688dee5-3139-4b2c-b8ad-114b036ad0dd', '95e3f4bc-a9ae-4ec7-9967-321f8462790b', '144d924c-e9d6-4a46-89d8-64866a32356c', '70bcf033-1563-45b8-9fac-e937bcedefc9'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:29:38 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-5a47a023-c51c-47f5-a34a-c8deef74558a tempest-VolumesGetTest-1299330385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:38 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-5a47a023-c51c-47f5-a34a-c8deef74558a tempest-VolumesGetTest-1299330385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:29:38 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-5a47a023-c51c-47f5-a34a-c8deef74558a tempest-VolumesGetTest-1299330385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:29:38 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-5a47a023-c51c-47f5-a34a-c8deef74558a tempest-VolumesGetTest-1299330385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:29:38 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-5a47a023-c51c-47f5-a34a-c8deef74558a tempest-VolumesGetTest-1299330385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:29:38 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5a47a023-c51c-47f5-a34a-c8deef74558a tempest-VolumesGetTest-1299330385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:38 devstack sudo[89845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:29:38 devstack sudo[89845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:39 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e0ff2a7-754c-4877-b59d-3b742cc8e617 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:29:39 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-2e0ff2a7-754c-4877-b59d-3b742cc8e617 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Flow 'volume_create_manager' (d23310e1-88ac-4b8d-9aff-d98329905ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:29:39 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-2e0ff2a7-754c-4877-b59d-3b742cc8e617 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eb71ff8-6ce5-4dc8-bb0d-ba52925f8634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:39 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-2e0ff2a7-754c-4877-b59d-3b742cc8e617 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eb71ff8-6ce5-4dc8-bb0d-ba52925f8634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:29:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1488048147',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=720861f5-a374-4bea-b602-8c718245139c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad51144fd6e143ec9f0691a3645c814a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:29:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:29:39Z,use_quota=True,user_id='9ebcb07f59c746d3a0f0f106069d133b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:39 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-2e0ff2a7-754c-4877-b59d-3b742cc8e617 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9641174a-45e0-452b-820a-9257ca133740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:39 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-2e0ff2a7-754c-4877-b59d-3b742cc8e617 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9641174a-45e0-452b-820a-9257ca133740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:39 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-2e0ff2a7-754c-4877-b59d-3b742cc8e617 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f4edd66-75ae-4178-939c-69dddf30717b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:39 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-2e0ff2a7-754c-4877-b59d-3b742cc8e617 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f4edd66-75ae-4178-939c-69dddf30717b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '720861f5-a374-4bea-b602-8c718245139c', 'volume_name': 'volume-720861f5-a374-4bea-b602-8c718245139c', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:39 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-2e0ff2a7-754c-4877-b59d-3b742cc8e617 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (208a9165-a2a2-4de2-b9b8-3a1b88b1b3d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:39 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-2e0ff2a7-754c-4877-b59d-3b742cc8e617 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (208a9165-a2a2-4de2-b9b8-3a1b88b1b3d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:39 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-2e0ff2a7-754c-4877-b59d-3b742cc8e617 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f123a876-df4a-47be-a98c-1110d83cd7ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:39 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-2e0ff2a7-754c-4877-b59d-3b742cc8e617 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Volume 720861f5-a374-4bea-b602-8c718245139c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-720861f5-a374-4bea-b602-8c718245139c', 'volume_size': 1}
Feb 27 01:29:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-2e0ff2a7-754c-4877-b59d-3b742cc8e617 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-2e0ff2a7-754c-4877-b59d-3b742cc8e617 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:29:39 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-2e0ff2a7-754c-4877-b59d-3b742cc8e617 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:29:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1488048147',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=720861f5-a374-4bea-b602-8c718245139c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad51144fd6e143ec9f0691a3645c814a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:29:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:29:39Z,use_quota=True,user_id='9ebcb07f59c746d3a0f0f106069d133b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:29:39 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-2e0ff2a7-754c-4877-b59d-3b742cc8e617 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Creating volume 720861f5-a374-4bea-b602-8c718245139c {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:29:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-2e0ff2a7-754c-4877-b59d-3b742cc8e617 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-2e0ff2a7-754c-4877-b59d-3b742cc8e617 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:29:39 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-2e0ff2a7-754c-4877-b59d-3b742cc8e617 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:29:39 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-2e0ff2a7-754c-4877-b59d-3b742cc8e617 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:29:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-2e0ff2a7-754c-4877-b59d-3b742cc8e617 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:29:39 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-2e0ff2a7-754c-4877-b59d-3b742cc8e617 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:29:39 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-2e0ff2a7-754c-4877-b59d-3b742cc8e617 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:29:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-2e0ff2a7-754c-4877-b59d-3b742cc8e617 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-720861f5-a374-4bea-b602-8c718245139c 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:39 devstack sudo[89847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-720861f5-a374-4bea-b602-8c718245139c 1073741824
Feb 27 01:29:39 devstack sudo[89847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:39 devstack sudo[89845]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5a47a023-c51c-47f5-a34a-c8deef74558a tempest-VolumesGetTest-1299330385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.491s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:39 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-5a47a023-c51c-47f5-a34a-c8deef74558a tempest-VolumesGetTest-1299330385 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:29:39 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-5a47a023-c51c-47f5-a34a-c8deef74558a tempest-VolumesGetTest-1299330385 None] Deleted volume successfully.
Feb 27 01:29:39 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5a47a023-c51c-47f5-a34a-c8deef74558a tempest-VolumesGetTest-1299330385 None] Lock "cinder-71204c91-3819-4fd8-b7e3-5b4afdef2c4f-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:29:39 devstack sudo[89847]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-2e0ff2a7-754c-4877-b59d-3b742cc8e617 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-720861f5-a374-4bea-b602-8c718245139c 1073741824" returned: 0 in 0.519s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-2e0ff2a7-754c-4877-b59d-3b742cc8e617 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-720861f5-a374-4bea-b602-8c718245139c {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:39 devstack sudo[89853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-720861f5-a374-4bea-b602-8c718245139c
Feb 27 01:29:39 devstack sudo[89853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:39 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-0ae79d73-ed3b-4e4b-b6d1-73e53a6d2f8f tempest-VolumesGetTest-1299330385 None] Acquiring lock "cinder-9db09e36-e368-4def-8ba2-79706a8e29c4-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:29:39 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-0ae79d73-ed3b-4e4b-b6d1-73e53a6d2f8f tempest-VolumesGetTest-1299330385 None] Lock "cinder-9db09e36-e368-4def-8ba2-79706a8e29c4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:29:40 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-0ae79d73-ed3b-4e4b-b6d1-73e53a6d2f8f tempest-VolumesGetTest-1299330385 None] Acquiring lock "cinder-quobyte-9db09e36-e368-4def-8ba2-79706a8e29c4" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:29:40 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-0ae79d73-ed3b-4e4b-b6d1-73e53a6d2f8f tempest-VolumesGetTest-1299330385 None] Lock "cinder-quobyte-9db09e36-e368-4def-8ba2-79706a8e29c4" acquired by "delete_volume" :: waited 0.013s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:29:40 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ffab4f6-34e0-475f-8418-57eb7674a3da]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:29:40 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0ae79d73-ed3b-4e4b-b6d1-73e53a6d2f8f tempest-VolumesGetTest-1299330385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9db09e36-e368-4def-8ba2-79706a8e29c4 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:40 devstack sudo[89855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9db09e36-e368-4def-8ba2-79706a8e29c4
Feb 27 01:29:40 devstack sudo[89855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:40 devstack sudo[89853]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:40 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-2e0ff2a7-754c-4877-b59d-3b742cc8e617 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-720861f5-a374-4bea-b602-8c718245139c" returned: 0 in 0.476s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:40 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-2e0ff2a7-754c-4877-b59d-3b742cc8e617 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:29:40 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-2e0ff2a7-754c-4877-b59d-3b742cc8e617 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:29:40 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-2e0ff2a7-754c-4877-b59d-3b742cc8e617 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f123a876-df4a-47be-a98c-1110d83cd7ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-720861f5-a374-4bea-b602-8c718245139c', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:40 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-2e0ff2a7-754c-4877-b59d-3b742cc8e617 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bfcb9f1-5a8d-459e-ae0d-83bcbd1a5fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:40 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-2e0ff2a7-754c-4877-b59d-3b742cc8e617 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Volume volume-720861f5-a374-4bea-b602-8c718245139c (720861f5-a374-4bea-b602-8c718245139c): created successfully
Feb 27 01:29:40 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-2e0ff2a7-754c-4877-b59d-3b742cc8e617 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bfcb9f1-5a8d-459e-ae0d-83bcbd1a5fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:40 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-2e0ff2a7-754c-4877-b59d-3b742cc8e617 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Flow 'volume_create_manager' (d23310e1-88ac-4b8d-9aff-d98329905ddc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:29:40 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-2e0ff2a7-754c-4877-b59d-3b742cc8e617 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Created volume successfully.
Feb 27 01:29:40 devstack sudo[89855]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:40 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0ae79d73-ed3b-4e4b-b6d1-73e53a6d2f8f tempest-VolumesGetTest-1299330385 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9db09e36-e368-4def-8ba2-79706a8e29c4" returned: 0 in 0.528s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:40 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0ae79d73-ed3b-4e4b-b6d1-73e53a6d2f8f tempest-VolumesGetTest-1299330385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9db09e36-e368-4def-8ba2-79706a8e29c4 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:40 devstack sudo[89861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9db09e36-e368-4def-8ba2-79706a8e29c4
Feb 27 01:29:40 devstack sudo[89861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:40 devstack sudo[89861]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:40 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0ae79d73-ed3b-4e4b-b6d1-73e53a6d2f8f tempest-VolumesGetTest-1299330385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-9db09e36-e368-4def-8ba2-79706a8e29c4" returned: 0 in 0.430s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:41 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-0ae79d73-ed3b-4e4b-b6d1-73e53a6d2f8f tempest-VolumesGetTest-1299330385 None] Lock "cinder-quobyte-9db09e36-e368-4def-8ba2-79706a8e29c4" released by "delete_volume" :: held 0.989s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:29:41 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-0ae79d73-ed3b-4e4b-b6d1-73e53a6d2f8f tempest-VolumesGetTest-1299330385 None] Created reservations ['eb9e401e-07ad-4785-b9f6-237ca78b70d7', '4d7cdd02-77f7-4a43-a8a7-04c9a6ded636', 'bc3f23a8-7652-47c2-8904-6249ff33b2aa', '165e344e-ee27-465f-9280-6665c81978ba'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:29:41 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-0ae79d73-ed3b-4e4b-b6d1-73e53a6d2f8f tempest-VolumesGetTest-1299330385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:41 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-0ae79d73-ed3b-4e4b-b6d1-73e53a6d2f8f tempest-VolumesGetTest-1299330385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:29:41 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-0ae79d73-ed3b-4e4b-b6d1-73e53a6d2f8f tempest-VolumesGetTest-1299330385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:29:41 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-0ae79d73-ed3b-4e4b-b6d1-73e53a6d2f8f tempest-VolumesGetTest-1299330385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:29:41 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-0ae79d73-ed3b-4e4b-b6d1-73e53a6d2f8f tempest-VolumesGetTest-1299330385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:29:41 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0ae79d73-ed3b-4e4b-b6d1-73e53a6d2f8f tempest-VolumesGetTest-1299330385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:41 devstack sudo[89864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:29:41 devstack sudo[89864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:41 devstack sudo[89864]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:41 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0ae79d73-ed3b-4e4b-b6d1-73e53a6d2f8f tempest-VolumesGetTest-1299330385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.498s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:41 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-0ae79d73-ed3b-4e4b-b6d1-73e53a6d2f8f tempest-VolumesGetTest-1299330385 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:29:41 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-0ae79d73-ed3b-4e4b-b6d1-73e53a6d2f8f tempest-VolumesGetTest-1299330385 None] Deleted volume successfully.
Feb 27 01:29:41 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-0ae79d73-ed3b-4e4b-b6d1-73e53a6d2f8f tempest-VolumesGetTest-1299330385 None] Lock "cinder-9db09e36-e368-4def-8ba2-79706a8e29c4-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:29:41 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-98ba44ba-9401-4017-bddf-20476c0a25bd tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:29:41 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-98ba44ba-9401-4017-bddf-20476c0a25bd tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Flow 'volume_create_manager' (2609f622-7eca-4f40-87a6-552db6ae0048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:29:41 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-98ba44ba-9401-4017-bddf-20476c0a25bd tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba7523e4-69d7-4a50-91dd-8828493bf504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:41 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-98ba44ba-9401-4017-bddf-20476c0a25bd tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba7523e4-69d7-4a50-91dd-8828493bf504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:29:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2037758205',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be50a4f5-2bc8-476d-85df-653a6416244f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad51144fd6e143ec9f0691a3645c814a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:29:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:29:42Z,use_quota=True,user_id='9ebcb07f59c746d3a0f0f106069d133b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:41 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-98ba44ba-9401-4017-bddf-20476c0a25bd tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (207122ef-47c1-46e7-84c1-c37717209745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:41 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-98ba44ba-9401-4017-bddf-20476c0a25bd tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (207122ef-47c1-46e7-84c1-c37717209745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:41 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-98ba44ba-9401-4017-bddf-20476c0a25bd tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79778ce7-3556-4b6f-a647-b3595c4c3ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:41 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-98ba44ba-9401-4017-bddf-20476c0a25bd tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79778ce7-3556-4b6f-a647-b3595c4c3ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be50a4f5-2bc8-476d-85df-653a6416244f', 'volume_name': 'volume-be50a4f5-2bc8-476d-85df-653a6416244f', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:41 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-98ba44ba-9401-4017-bddf-20476c0a25bd tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1f4e72d-c917-4e50-b058-6b0867ce3230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:41 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-98ba44ba-9401-4017-bddf-20476c0a25bd tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1f4e72d-c917-4e50-b058-6b0867ce3230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:41 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-98ba44ba-9401-4017-bddf-20476c0a25bd tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3053a0a5-3d0f-44c8-bd44-614a5c39295a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:41 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-98ba44ba-9401-4017-bddf-20476c0a25bd tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Volume be50a4f5-2bc8-476d-85df-653a6416244f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be50a4f5-2bc8-476d-85df-653a6416244f', 'volume_size': 1}
Feb 27 01:29:41 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-98ba44ba-9401-4017-bddf-20476c0a25bd tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:41 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-98ba44ba-9401-4017-bddf-20476c0a25bd tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:29:41 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-98ba44ba-9401-4017-bddf-20476c0a25bd tempest-CreateVolumesFromSourceVolumeTest-509922347 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:29:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2037758205',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be50a4f5-2bc8-476d-85df-653a6416244f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad51144fd6e143ec9f0691a3645c814a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:29:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:29:42Z,use_quota=True,user_id='9ebcb07f59c746d3a0f0f106069d133b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:29:41 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-98ba44ba-9401-4017-bddf-20476c0a25bd tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Creating volume be50a4f5-2bc8-476d-85df-653a6416244f {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:29:41 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-98ba44ba-9401-4017-bddf-20476c0a25bd tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:41 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-98ba44ba-9401-4017-bddf-20476c0a25bd tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:29:41 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-98ba44ba-9401-4017-bddf-20476c0a25bd tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:29:41 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-98ba44ba-9401-4017-bddf-20476c0a25bd tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:29:41 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-98ba44ba-9401-4017-bddf-20476c0a25bd tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:29:41 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-98ba44ba-9401-4017-bddf-20476c0a25bd tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:29:41 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-98ba44ba-9401-4017-bddf-20476c0a25bd tempest-CreateVolumesFromSourceVolumeTest-509922347 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:29:41 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-98ba44ba-9401-4017-bddf-20476c0a25bd tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-be50a4f5-2bc8-476d-85df-653a6416244f 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:41 devstack sudo[89867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-be50a4f5-2bc8-476d-85df-653a6416244f 1073741824
Feb 27 01:29:41 devstack sudo[89867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-9737cde6-d0af-4d3f-8e1e-ee06c82cfa63 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-9737cde6-d0af-4d3f-8e1e-ee06c82cfa63 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Flow 'volume_create_manager' (4e5d8f73-916a-42ee-a100-9934c8e2aa3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-9737cde6-d0af-4d3f-8e1e-ee06c82cfa63 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77696dc5-df59-4fae-9132-b67c68303191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-9737cde6-d0af-4d3f-8e1e-ee06c82cfa63 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77696dc5-df59-4fae-9132-b67c68303191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:29:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-654201744',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f08018c-ff95-4db8-bcf7-d84720d0a6c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad51144fd6e143ec9f0691a3645c814a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:29:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:29:42Z,use_quota=True,user_id='9ebcb07f59c746d3a0f0f106069d133b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-9737cde6-d0af-4d3f-8e1e-ee06c82cfa63 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13b86935-6392-4a0d-9689-42171524dc70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-9737cde6-d0af-4d3f-8e1e-ee06c82cfa63 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13b86935-6392-4a0d-9689-42171524dc70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-9737cde6-d0af-4d3f-8e1e-ee06c82cfa63 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29473e93-c77c-482b-a788-8382ab2a6c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-9737cde6-d0af-4d3f-8e1e-ee06c82cfa63 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29473e93-c77c-482b-a788-8382ab2a6c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f08018c-ff95-4db8-bcf7-d84720d0a6c8', 'volume_name': 'volume-8f08018c-ff95-4db8-bcf7-d84720d0a6c8', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-9737cde6-d0af-4d3f-8e1e-ee06c82cfa63 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8098f9b1-6c83-4f33-83e7-5dd347da4323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-9737cde6-d0af-4d3f-8e1e-ee06c82cfa63 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8098f9b1-6c83-4f33-83e7-5dd347da4323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-9737cde6-d0af-4d3f-8e1e-ee06c82cfa63 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b27ae493-0601-4515-a5bb-5b9e0a937800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:42 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-9737cde6-d0af-4d3f-8e1e-ee06c82cfa63 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Volume 8f08018c-ff95-4db8-bcf7-d84720d0a6c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f08018c-ff95-4db8-bcf7-d84720d0a6c8', 'volume_size': 1}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-9737cde6-d0af-4d3f-8e1e-ee06c82cfa63 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-989c63f4-b323-4ac9-9bd6-4bb0868b387c tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-989c63f4-b323-4ac9-9bd6-4bb0868b387c tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Flow 'volume_create_manager' (e0f197c0-7892-4e59-a798-2be772312783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-989c63f4-b323-4ac9-9bd6-4bb0868b387c tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fe208f2-a2db-4765-8853-905178adee27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-989c63f4-b323-4ac9-9bd6-4bb0868b387c tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fe208f2-a2db-4765-8853-905178adee27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:29:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1970014648',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dce80fb2-852a-4e5b-b957-454f04576351,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad51144fd6e143ec9f0691a3645c814a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:29:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:29:42Z,use_quota=True,user_id='9ebcb07f59c746d3a0f0f106069d133b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-989c63f4-b323-4ac9-9bd6-4bb0868b387c tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4aafaee-5588-4437-9526-70f31e74a82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-989c63f4-b323-4ac9-9bd6-4bb0868b387c tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4aafaee-5588-4437-9526-70f31e74a82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-989c63f4-b323-4ac9-9bd6-4bb0868b387c tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65f4a6e6-0f03-40a8-b311-327c09df3529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-989c63f4-b323-4ac9-9bd6-4bb0868b387c tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65f4a6e6-0f03-40a8-b311-327c09df3529) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dce80fb2-852a-4e5b-b957-454f04576351', 'volume_name': 'volume-dce80fb2-852a-4e5b-b957-454f04576351', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-989c63f4-b323-4ac9-9bd6-4bb0868b387c tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7310cf0-8586-48b8-9be5-2b728a466539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-989c63f4-b323-4ac9-9bd6-4bb0868b387c tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7310cf0-8586-48b8-9be5-2b728a466539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:42 devstack sudo[89867]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-989c63f4-b323-4ac9-9bd6-4bb0868b387c tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d71ca9e7-c3c4-400c-8191-f37793793b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:42 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-989c63f4-b323-4ac9-9bd6-4bb0868b387c tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Volume dce80fb2-852a-4e5b-b957-454f04576351: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dce80fb2-852a-4e5b-b957-454f04576351', 'volume_size': 1}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-989c63f4-b323-4ac9-9bd6-4bb0868b387c tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-98ba44ba-9401-4017-bddf-20476c0a25bd tempest-CreateVolumesFromSourceVolumeTest-509922347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-be50a4f5-2bc8-476d-85df-653a6416244f 1073741824" returned: 0 in 0.627s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-98ba44ba-9401-4017-bddf-20476c0a25bd tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-be50a4f5-2bc8-476d-85df-653a6416244f {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:42 devstack sudo[89872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-be50a4f5-2bc8-476d-85df-653a6416244f
Feb 27 01:29:42 devstack sudo[89872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-94686742-c4ec-4236-8e07-52f4716552e0 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-94686742-c4ec-4236-8e07-52f4716552e0 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Flow 'volume_create_manager' (6f5fc959-e732-409d-a7e6-c6f892a9a678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-94686742-c4ec-4236-8e07-52f4716552e0 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94b2a4dc-c25d-4410-9ebc-61a34612892f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-94686742-c4ec-4236-8e07-52f4716552e0 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94b2a4dc-c25d-4410-9ebc-61a34612892f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:29:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-375760999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=827ef46e-f1f3-4a13-b262-283f813db6cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad51144fd6e143ec9f0691a3645c814a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:29:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:29:42Z,use_quota=True,user_id='9ebcb07f59c746d3a0f0f106069d133b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-94686742-c4ec-4236-8e07-52f4716552e0 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36b0247b-99dc-4c05-82bd-37d554a07114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-94686742-c4ec-4236-8e07-52f4716552e0 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36b0247b-99dc-4c05-82bd-37d554a07114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-94686742-c4ec-4236-8e07-52f4716552e0 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93887aaa-c9e3-4a4d-bfe1-172c9095addf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-94686742-c4ec-4236-8e07-52f4716552e0 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93887aaa-c9e3-4a4d-bfe1-172c9095addf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '827ef46e-f1f3-4a13-b262-283f813db6cd', 'volume_name': 'volume-827ef46e-f1f3-4a13-b262-283f813db6cd', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-94686742-c4ec-4236-8e07-52f4716552e0 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdc9a445-448c-4d3b-a71b-56d419a6fa28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-94686742-c4ec-4236-8e07-52f4716552e0 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdc9a445-448c-4d3b-a71b-56d419a6fa28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-94686742-c4ec-4236-8e07-52f4716552e0 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (377b824d-b119-45ae-a979-0f3dbaa9ce36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:42 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-94686742-c4ec-4236-8e07-52f4716552e0 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Volume 827ef46e-f1f3-4a13-b262-283f813db6cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-827ef46e-f1f3-4a13-b262-283f813db6cd', 'volume_size': 1}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-94686742-c4ec-4236-8e07-52f4716552e0 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a68c69e-af58-4aa5-aafa-94a56bc65218 tempest-VolumesGetTest-1299330385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7a68c69e-af58-4aa5-aafa-94a56bc65218 tempest-VolumesGetTest-1299330385 None] Flow 'volume_create_manager' (e1167a15-c004-405a-8557-489671ef40a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7a68c69e-af58-4aa5-aafa-94a56bc65218 tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e109c55-f6d4-4102-8579-8f0e71f9ff2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7a68c69e-af58-4aa5-aafa-94a56bc65218 tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e109c55-f6d4-4102-8579-8f0e71f9ff2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:29:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1760294564',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=768708c8-91d9-4f9e-845a-baae50959a89,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='62820bf75832490faca5bc43e4724911',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:29:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:29:43Z,use_quota=True,user_id='127cb18bec0a41a9bc4186e2ee63b6a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7a68c69e-af58-4aa5-aafa-94a56bc65218 tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c049af2-c9a2-42e6-9121-9cef081d58a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7a68c69e-af58-4aa5-aafa-94a56bc65218 tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c049af2-c9a2-42e6-9121-9cef081d58a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7a68c69e-af58-4aa5-aafa-94a56bc65218 tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4663e3fc-9eb9-4410-a4b2-1be4145de807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG cinder.image.glance [None req-7a68c69e-af58-4aa5-aafa-94a56bc65218 tempest-VolumesGetTest-1299330385 None] Creating Keystone auth plugin from conf {{(pid=83106) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-f74603e4-b4a5-490a-9098-3bb0580fe481 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-f74603e4-b4a5-490a-9098-3bb0580fe481 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Flow 'volume_create_manager' (361a488e-3fa7-4c00-85aa-a4d54dac391b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-f74603e4-b4a5-490a-9098-3bb0580fe481 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dc78f52-8e2b-4e45-aed8-9ccc59ce5210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-f74603e4-b4a5-490a-9098-3bb0580fe481 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dc78f52-8e2b-4e45-aed8-9ccc59ce5210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:29:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-58409524',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=411c0b8c-afec-417b-9dbd-3e6d15b67af8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad51144fd6e143ec9f0691a3645c814a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:29:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:29:43Z,use_quota=True,user_id='9ebcb07f59c746d3a0f0f106069d133b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-f74603e4-b4a5-490a-9098-3bb0580fe481 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19712e12-a86a-4a17-8d99-9b5264915c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-f74603e4-b4a5-490a-9098-3bb0580fe481 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19712e12-a86a-4a17-8d99-9b5264915c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-f74603e4-b4a5-490a-9098-3bb0580fe481 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed644200-6873-4c54-99aa-2ed3d8712ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-f74603e4-b4a5-490a-9098-3bb0580fe481 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed644200-6873-4c54-99aa-2ed3d8712ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '411c0b8c-afec-417b-9dbd-3e6d15b67af8', 'volume_name': 'volume-411c0b8c-afec-417b-9dbd-3e6d15b67af8', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-f74603e4-b4a5-490a-9098-3bb0580fe481 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (381515b7-3a0e-401e-96ec-ad02215dcbf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-f74603e4-b4a5-490a-9098-3bb0580fe481 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (381515b7-3a0e-401e-96ec-ad02215dcbf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-f74603e4-b4a5-490a-9098-3bb0580fe481 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5216a59c-90ca-4956-b927-b5029a3f1d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:42 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-f74603e4-b4a5-490a-9098-3bb0580fe481 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Volume 411c0b8c-afec-417b-9dbd-3e6d15b67af8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-411c0b8c-afec-417b-9dbd-3e6d15b67af8', 'volume_size': 1}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-f74603e4-b4a5-490a-9098-3bb0580fe481 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:42 devstack sudo[89872]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-98ba44ba-9401-4017-bddf-20476c0a25bd tempest-CreateVolumesFromSourceVolumeTest-509922347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-be50a4f5-2bc8-476d-85df-653a6416244f" returned: 0 in 0.539s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-98ba44ba-9401-4017-bddf-20476c0a25bd tempest-CreateVolumesFromSourceVolumeTest-509922347 None] <== create_volume: return (1192ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-98ba44ba-9401-4017-bddf-20476c0a25bd tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.195s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-9737cde6-d0af-4d3f-8e1e-ee06c82cfa63 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.755s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-9737cde6-d0af-4d3f-8e1e-ee06c82cfa63 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:29:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-654201744',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f08018c-ff95-4db8-bcf7-d84720d0a6c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad51144fd6e143ec9f0691a3645c814a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:29:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:29:42Z,use_quota=True,user_id='9ebcb07f59c746d3a0f0f106069d133b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-9737cde6-d0af-4d3f-8e1e-ee06c82cfa63 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Creating volume 8f08018c-ff95-4db8-bcf7-d84720d0a6c8 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-9737cde6-d0af-4d3f-8e1e-ee06c82cfa63 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-9737cde6-d0af-4d3f-8e1e-ee06c82cfa63 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-9737cde6-d0af-4d3f-8e1e-ee06c82cfa63 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-9737cde6-d0af-4d3f-8e1e-ee06c82cfa63 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-9737cde6-d0af-4d3f-8e1e-ee06c82cfa63 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-9737cde6-d0af-4d3f-8e1e-ee06c82cfa63 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:29:42 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-9737cde6-d0af-4d3f-8e1e-ee06c82cfa63 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9737cde6-d0af-4d3f-8e1e-ee06c82cfa63 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8f08018c-ff95-4db8-bcf7-d84720d0a6c8 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7a68c69e-af58-4aa5-aafa-94a56bc65218 tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4663e3fc-9eb9-4410-a4b2-1be4145de807) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '768708c8-91d9-4f9e-845a-baae50959a89', 'volume_name': 'volume-768708c8-91d9-4f9e-845a-baae50959a89', 'volume_size': 1, 'image_id': '4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd105600f18404a29b5061e7b75a5bfe1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca', 'created_at': datetime.datetime(2026, 2, 27, 0, 17, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 17, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f07e8c55f30>}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:42 devstack sudo[89876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8f08018c-ff95-4db8-bcf7-d84720d0a6c8 1073741824
Feb 27 01:29:42 devstack sudo[89876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7a68c69e-af58-4aa5-aafa-94a56bc65218 tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf95bfd1-b4bb-424f-baf0-34555ff6444d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7a68c69e-af58-4aa5-aafa-94a56bc65218 tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf95bfd1-b4bb-424f-baf0-34555ff6444d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7a68c69e-af58-4aa5-aafa-94a56bc65218 tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd56f239-89d6-4c1e-8e76-db1098b26e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:42 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-7a68c69e-af58-4aa5-aafa-94a56bc65218 tempest-VolumesGetTest-1299330385 None] Volume 768708c8-91d9-4f9e-845a-baae50959a89: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-768708c8-91d9-4f9e-845a-baae50959a89', 'volume_size': 1, 'image_id': '4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd105600f18404a29b5061e7b75a5bfe1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca', 'created_at': datetime.datetime(2026, 2, 27, 0, 17, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 17, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f07e8c55f30>}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a68c69e-af58-4aa5-aafa-94a56bc65218 tempest-VolumesGetTest-1299330385 None] Trying to clone 768708c8-91d9-4f9e-845a-baae50959a89 from image 4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca at location (None, [{'url': 'file:///opt/stack/data/glance/images/4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca', 'metadata': {}}]). {{(pid=83106) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-98ba44ba-9401-4017-bddf-20476c0a25bd tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3053a0a5-3d0f-44c8-bd44-614a5c39295a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be50a4f5-2bc8-476d-85df-653a6416244f', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:42 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-98ba44ba-9401-4017-bddf-20476c0a25bd tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c1504d7-90cf-48f7-ba0e-d709b27a3fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:43 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-98ba44ba-9401-4017-bddf-20476c0a25bd tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Volume volume-be50a4f5-2bc8-476d-85df-653a6416244f (be50a4f5-2bc8-476d-85df-653a6416244f): created successfully
Feb 27 01:29:43 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-98ba44ba-9401-4017-bddf-20476c0a25bd tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c1504d7-90cf-48f7-ba0e-d709b27a3fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:43 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-98ba44ba-9401-4017-bddf-20476c0a25bd tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Flow 'volume_create_manager' (2609f622-7eca-4f40-87a6-552db6ae0048) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:29:43 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-98ba44ba-9401-4017-bddf-20476c0a25bd tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Created volume successfully.
Feb 27 01:29:43 devstack cinder-volume[83106]: DEBUG cinder.image.image_utils [None req-7a68c69e-af58-4aa5-aafa-94a56bc65218 tempest-VolumesGetTest-1299330385 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_skalglp6devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83106) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Feb 27 01:29:43 devstack cinder-volume[83106]: INFO cinder.image.image_utils [None req-7a68c69e-af58-4aa5-aafa-94a56bc65218 tempest-VolumesGetTest-1299330385 None] Image download 20.69 MB at 20.69 MB/s
Feb 27 01:29:43 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa074fa-f81d-4d4e-a48a-e66df45781a7]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:29:43 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7a68c69e-af58-4aa5-aafa-94a56bc65218 tempest-VolumesGetTest-1299330385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_skalglp6devstack@QuobyteHD {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:43 devstack sudo[89879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_skalglp6devstack@QuobyteHD
Feb 27 01:29:43 devstack sudo[89879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:43 devstack sudo[89876]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:43 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9737cde6-d0af-4d3f-8e1e-ee06c82cfa63 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8f08018c-ff95-4db8-bcf7-d84720d0a6c8 1073741824" returned: 0 in 0.590s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:43 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9737cde6-d0af-4d3f-8e1e-ee06c82cfa63 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8f08018c-ff95-4db8-bcf7-d84720d0a6c8 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:43 devstack sudo[89884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8f08018c-ff95-4db8-bcf7-d84720d0a6c8
Feb 27 01:29:43 devstack sudo[89884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:43 devstack sudo[89879]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:43 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7a68c69e-af58-4aa5-aafa-94a56bc65218 tempest-VolumesGetTest-1299330385 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_skalglp6devstack@QuobyteHD" returned: 0 in 0.492s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:43 devstack cinder-volume[83106]: DEBUG cinder.image.image_utils [None req-7a68c69e-af58-4aa5-aafa-94a56bc65218 tempest-VolumesGetTest-1299330385 None] Temporary image 4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca is fetched for user 127cb18bec0a41a9bc4186e2ee63b6a9. {{(pid=83106) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Feb 27 01:29:43 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[727c3533-f8e1-4819-9af2-ba8f06c4176d]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:29:43 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7a68c69e-af58-4aa5-aafa-94a56bc65218 tempest-VolumesGetTest-1299330385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_skalglp6devstack@QuobyteHD {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:43 devstack sudo[89889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_skalglp6devstack@QuobyteHD
Feb 27 01:29:43 devstack sudo[89889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:44 devstack sudo[89884]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:44 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9737cde6-d0af-4d3f-8e1e-ee06c82cfa63 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8f08018c-ff95-4db8-bcf7-d84720d0a6c8" returned: 0 in 0.513s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:44 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-9737cde6-d0af-4d3f-8e1e-ee06c82cfa63 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:29:44 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-9737cde6-d0af-4d3f-8e1e-ee06c82cfa63 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:29:44 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-989c63f4-b323-4ac9-9bd6-4bb0868b387c tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.714s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:29:44 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-989c63f4-b323-4ac9-9bd6-4bb0868b387c tempest-CreateVolumesFromSourceVolumeTest-509922347 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:29:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1970014648',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dce80fb2-852a-4e5b-b957-454f04576351,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad51144fd6e143ec9f0691a3645c814a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:29:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:29:42Z,use_quota=True,user_id='9ebcb07f59c746d3a0f0f106069d133b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:29:44 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-989c63f4-b323-4ac9-9bd6-4bb0868b387c tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Creating volume dce80fb2-852a-4e5b-b957-454f04576351 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:29:44 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-989c63f4-b323-4ac9-9bd6-4bb0868b387c tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:44 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-989c63f4-b323-4ac9-9bd6-4bb0868b387c tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:29:44 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-989c63f4-b323-4ac9-9bd6-4bb0868b387c tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:29:44 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-989c63f4-b323-4ac9-9bd6-4bb0868b387c tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:29:44 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-989c63f4-b323-4ac9-9bd6-4bb0868b387c tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:29:44 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-989c63f4-b323-4ac9-9bd6-4bb0868b387c tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:29:44 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-989c63f4-b323-4ac9-9bd6-4bb0868b387c tempest-CreateVolumesFromSourceVolumeTest-509922347 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:29:44 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-989c63f4-b323-4ac9-9bd6-4bb0868b387c tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dce80fb2-852a-4e5b-b957-454f04576351 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:44 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-9737cde6-d0af-4d3f-8e1e-ee06c82cfa63 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b27ae493-0601-4515-a5bb-5b9e0a937800) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f08018c-ff95-4db8-bcf7-d84720d0a6c8', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:44 devstack sudo[89892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dce80fb2-852a-4e5b-b957-454f04576351 1073741824
Feb 27 01:29:44 devstack sudo[89892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:44 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-9737cde6-d0af-4d3f-8e1e-ee06c82cfa63 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93495755-1108-4caa-ad8b-5cfbeb72a65b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:44 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-9737cde6-d0af-4d3f-8e1e-ee06c82cfa63 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Volume volume-8f08018c-ff95-4db8-bcf7-d84720d0a6c8 (8f08018c-ff95-4db8-bcf7-d84720d0a6c8): created successfully
Feb 27 01:29:44 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-9737cde6-d0af-4d3f-8e1e-ee06c82cfa63 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93495755-1108-4caa-ad8b-5cfbeb72a65b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:44 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-9737cde6-d0af-4d3f-8e1e-ee06c82cfa63 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Flow 'volume_create_manager' (4e5d8f73-916a-42ee-a100-9934c8e2aa3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:29:44 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-9737cde6-d0af-4d3f-8e1e-ee06c82cfa63 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Created volume successfully.
Feb 27 01:29:44 devstack sudo[89889]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:44 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7a68c69e-af58-4aa5-aafa-94a56bc65218 tempest-VolumesGetTest-1299330385 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_skalglp6devstack@QuobyteHD" returned: 0 in 0.569s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:44 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-7a68c69e-af58-4aa5-aafa-94a56bc65218 tempest-VolumesGetTest-1299330385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:44 devstack sudo[89892]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:44 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-989c63f4-b323-4ac9-9bd6-4bb0868b387c tempest-CreateVolumesFromSourceVolumeTest-509922347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dce80fb2-852a-4e5b-b957-454f04576351 1073741824" returned: 0 in 0.593s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:44 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-989c63f4-b323-4ac9-9bd6-4bb0868b387c tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dce80fb2-852a-4e5b-b957-454f04576351 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:44 devstack sudo[89900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dce80fb2-852a-4e5b-b957-454f04576351
Feb 27 01:29:44 devstack sudo[89900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:45 devstack sudo[89900]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:45 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-989c63f4-b323-4ac9-9bd6-4bb0868b387c tempest-CreateVolumesFromSourceVolumeTest-509922347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dce80fb2-852a-4e5b-b957-454f04576351" returned: 0 in 0.484s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:45 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-989c63f4-b323-4ac9-9bd6-4bb0868b387c tempest-CreateVolumesFromSourceVolumeTest-509922347 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:29:45 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-989c63f4-b323-4ac9-9bd6-4bb0868b387c tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:29:45 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-94686742-c4ec-4236-8e07-52f4716552e0 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.584s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:29:45 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-94686742-c4ec-4236-8e07-52f4716552e0 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:29:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-375760999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=827ef46e-f1f3-4a13-b262-283f813db6cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad51144fd6e143ec9f0691a3645c814a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:29:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:29:42Z,use_quota=True,user_id='9ebcb07f59c746d3a0f0f106069d133b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:29:45 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-94686742-c4ec-4236-8e07-52f4716552e0 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Creating volume 827ef46e-f1f3-4a13-b262-283f813db6cd {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:29:45 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-94686742-c4ec-4236-8e07-52f4716552e0 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:45 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-94686742-c4ec-4236-8e07-52f4716552e0 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:29:45 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-94686742-c4ec-4236-8e07-52f4716552e0 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:29:45 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-94686742-c4ec-4236-8e07-52f4716552e0 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:29:45 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-94686742-c4ec-4236-8e07-52f4716552e0 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:29:45 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-94686742-c4ec-4236-8e07-52f4716552e0 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:29:45 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-94686742-c4ec-4236-8e07-52f4716552e0 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:29:45 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-94686742-c4ec-4236-8e07-52f4716552e0 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-827ef46e-f1f3-4a13-b262-283f813db6cd 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:45 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-989c63f4-b323-4ac9-9bd6-4bb0868b387c tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d71ca9e7-c3c4-400c-8191-f37793793b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dce80fb2-852a-4e5b-b957-454f04576351', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:45 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-989c63f4-b323-4ac9-9bd6-4bb0868b387c tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (037b111e-a70e-442f-88d8-e0b53f2190d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:45 devstack sudo[89903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-827ef46e-f1f3-4a13-b262-283f813db6cd 1073741824
Feb 27 01:29:45 devstack sudo[89903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:45 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-989c63f4-b323-4ac9-9bd6-4bb0868b387c tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Volume volume-dce80fb2-852a-4e5b-b957-454f04576351 (dce80fb2-852a-4e5b-b957-454f04576351): created successfully
Feb 27 01:29:45 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-989c63f4-b323-4ac9-9bd6-4bb0868b387c tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (037b111e-a70e-442f-88d8-e0b53f2190d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:45 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-989c63f4-b323-4ac9-9bd6-4bb0868b387c tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Flow 'volume_create_manager' (e0f197c0-7892-4e59-a798-2be772312783) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:29:45 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-989c63f4-b323-4ac9-9bd6-4bb0868b387c tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Created volume successfully.
Feb 27 01:29:45 devstack sudo[89903]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:45 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-94686742-c4ec-4236-8e07-52f4716552e0 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-827ef46e-f1f3-4a13-b262-283f813db6cd 1073741824" returned: 0 in 0.489s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:45 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-94686742-c4ec-4236-8e07-52f4716552e0 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-827ef46e-f1f3-4a13-b262-283f813db6cd {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:45 devstack sudo[89908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-827ef46e-f1f3-4a13-b262-283f813db6cd
Feb 27 01:29:45 devstack sudo[89908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:46 devstack sudo[89908]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:46 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-94686742-c4ec-4236-8e07-52f4716552e0 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-827ef46e-f1f3-4a13-b262-283f813db6cd" returned: 0 in 0.472s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:46 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-94686742-c4ec-4236-8e07-52f4716552e0 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:29:46 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-94686742-c4ec-4236-8e07-52f4716552e0 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:29:46 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-f74603e4-b4a5-490a-9098-3bb0580fe481 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.389s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:29:46 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-f74603e4-b4a5-490a-9098-3bb0580fe481 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:29:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-58409524',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=411c0b8c-afec-417b-9dbd-3e6d15b67af8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad51144fd6e143ec9f0691a3645c814a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:29:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:29:43Z,use_quota=True,user_id='9ebcb07f59c746d3a0f0f106069d133b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:29:46 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-f74603e4-b4a5-490a-9098-3bb0580fe481 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Creating volume 411c0b8c-afec-417b-9dbd-3e6d15b67af8 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:29:46 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-f74603e4-b4a5-490a-9098-3bb0580fe481 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:46 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-f74603e4-b4a5-490a-9098-3bb0580fe481 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:29:46 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-f74603e4-b4a5-490a-9098-3bb0580fe481 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:29:46 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-f74603e4-b4a5-490a-9098-3bb0580fe481 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:29:46 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-f74603e4-b4a5-490a-9098-3bb0580fe481 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:29:46 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-f74603e4-b4a5-490a-9098-3bb0580fe481 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:29:46 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-f74603e4-b4a5-490a-9098-3bb0580fe481 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:29:46 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-f74603e4-b4a5-490a-9098-3bb0580fe481 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-411c0b8c-afec-417b-9dbd-3e6d15b67af8 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:46 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-94686742-c4ec-4236-8e07-52f4716552e0 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (377b824d-b119-45ae-a979-0f3dbaa9ce36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-827ef46e-f1f3-4a13-b262-283f813db6cd', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:46 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-94686742-c4ec-4236-8e07-52f4716552e0 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82b4a187-367e-4dbb-840c-15dffe871c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:46 devstack sudo[89911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-411c0b8c-afec-417b-9dbd-3e6d15b67af8 1073741824
Feb 27 01:29:46 devstack sudo[89911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:46 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-94686742-c4ec-4236-8e07-52f4716552e0 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Volume volume-827ef46e-f1f3-4a13-b262-283f813db6cd (827ef46e-f1f3-4a13-b262-283f813db6cd): created successfully
Feb 27 01:29:46 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-94686742-c4ec-4236-8e07-52f4716552e0 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82b4a187-367e-4dbb-840c-15dffe871c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:46 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-94686742-c4ec-4236-8e07-52f4716552e0 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Flow 'volume_create_manager' (6f5fc959-e732-409d-a7e6-c6f892a9a678) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:29:46 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-94686742-c4ec-4236-8e07-52f4716552e0 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Created volume successfully.
Feb 27 01:29:46 devstack sudo[89911]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:46 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-f74603e4-b4a5-490a-9098-3bb0580fe481 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-411c0b8c-afec-417b-9dbd-3e6d15b67af8 1073741824" returned: 0 in 0.488s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:46 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-f74603e4-b4a5-490a-9098-3bb0580fe481 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-411c0b8c-afec-417b-9dbd-3e6d15b67af8 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:46 devstack sudo[89916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-411c0b8c-afec-417b-9dbd-3e6d15b67af8
Feb 27 01:29:46 devstack sudo[89916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:47 devstack sudo[89916]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:47 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-f74603e4-b4a5-490a-9098-3bb0580fe481 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-411c0b8c-afec-417b-9dbd-3e6d15b67af8" returned: 0 in 0.470s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:47 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-f74603e4-b4a5-490a-9098-3bb0580fe481 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:29:47 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-f74603e4-b4a5-490a-9098-3bb0580fe481 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:29:47 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-7a68c69e-af58-4aa5-aafa-94a56bc65218 tempest-VolumesGetTest-1299330385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.874s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:29:47 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-7a68c69e-af58-4aa5-aafa-94a56bc65218 tempest-VolumesGetTest-1299330385 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:29:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1760294564',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=768708c8-91d9-4f9e-845a-baae50959a89,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='62820bf75832490faca5bc43e4724911',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:29:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:29:43Z,use_quota=True,user_id='127cb18bec0a41a9bc4186e2ee63b6a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:29:47 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-7a68c69e-af58-4aa5-aafa-94a56bc65218 tempest-VolumesGetTest-1299330385 None] Creating volume 768708c8-91d9-4f9e-845a-baae50959a89 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:29:47 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-7a68c69e-af58-4aa5-aafa-94a56bc65218 tempest-VolumesGetTest-1299330385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:47 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-7a68c69e-af58-4aa5-aafa-94a56bc65218 tempest-VolumesGetTest-1299330385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:29:47 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-7a68c69e-af58-4aa5-aafa-94a56bc65218 tempest-VolumesGetTest-1299330385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:29:47 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-7a68c69e-af58-4aa5-aafa-94a56bc65218 tempest-VolumesGetTest-1299330385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:29:47 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-7a68c69e-af58-4aa5-aafa-94a56bc65218 tempest-VolumesGetTest-1299330385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:29:47 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-7a68c69e-af58-4aa5-aafa-94a56bc65218 tempest-VolumesGetTest-1299330385 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:29:47 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-7a68c69e-af58-4aa5-aafa-94a56bc65218 tempest-VolumesGetTest-1299330385 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:29:47 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7a68c69e-af58-4aa5-aafa-94a56bc65218 tempest-VolumesGetTest-1299330385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-768708c8-91d9-4f9e-845a-baae50959a89 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:47 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-f74603e4-b4a5-490a-9098-3bb0580fe481 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5216a59c-90ca-4956-b927-b5029a3f1d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-411c0b8c-afec-417b-9dbd-3e6d15b67af8', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:47 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-f74603e4-b4a5-490a-9098-3bb0580fe481 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c237b658-4e2d-4c95-8f42-0e86e23e0118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:47 devstack sudo[89919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-768708c8-91d9-4f9e-845a-baae50959a89 1073741824
Feb 27 01:29:47 devstack sudo[89919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:47 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-f74603e4-b4a5-490a-9098-3bb0580fe481 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Volume volume-411c0b8c-afec-417b-9dbd-3e6d15b67af8 (411c0b8c-afec-417b-9dbd-3e6d15b67af8): created successfully
Feb 27 01:29:47 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-f74603e4-b4a5-490a-9098-3bb0580fe481 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c237b658-4e2d-4c95-8f42-0e86e23e0118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:47 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-f74603e4-b4a5-490a-9098-3bb0580fe481 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Flow 'volume_create_manager' (361a488e-3fa7-4c00-85aa-a4d54dac391b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:29:47 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-f74603e4-b4a5-490a-9098-3bb0580fe481 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Created volume successfully.
Feb 27 01:29:47 devstack sudo[89919]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:47 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7a68c69e-af58-4aa5-aafa-94a56bc65218 tempest-VolumesGetTest-1299330385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-768708c8-91d9-4f9e-845a-baae50959a89 1073741824" returned: 0 in 0.462s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:47 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7a68c69e-af58-4aa5-aafa-94a56bc65218 tempest-VolumesGetTest-1299330385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-768708c8-91d9-4f9e-845a-baae50959a89 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:47 devstack sudo[89924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-768708c8-91d9-4f9e-845a-baae50959a89
Feb 27 01:29:47 devstack sudo[89924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:48 devstack sudo[89924]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:48 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7a68c69e-af58-4aa5-aafa-94a56bc65218 tempest-VolumesGetTest-1299330385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-768708c8-91d9-4f9e-845a-baae50959a89" returned: 0 in 0.441s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:48 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-7a68c69e-af58-4aa5-aafa-94a56bc65218 tempest-VolumesGetTest-1299330385 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:29:48 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-7a68c69e-af58-4aa5-aafa-94a56bc65218 tempest-VolumesGetTest-1299330385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:29:48 devstack cinder-volume[83106]: DEBUG cinder.volume.volume_utils [None req-7a68c69e-af58-4aa5-aafa-94a56bc65218 tempest-VolumesGetTest-1299330385 None] Attempting download of 4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca ((None, [{'url': 'file:///opt/stack/data/glance/images/4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca', 'metadata': {}}])) to volume 768708c8-91d9-4f9e-845a-baae50959a89. {{(pid=83106) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Feb 27 01:29:48 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb81043-252c-46a4-a292-6304c93e772a]: (4, 'raw') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:29:48 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7a68c69e-af58-4aa5-aafa-94a56bc65218 tempest-VolumesGetTest-1299330385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_a5gwjrpv {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:48 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-928d4add-98c4-4985-917a-01e500dfb319 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Acquiring lock "cinder-411c0b8c-afec-417b-9dbd-3e6d15b67af8-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:29:48 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-928d4add-98c4-4985-917a-01e500dfb319 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Lock "cinder-411c0b8c-afec-417b-9dbd-3e6d15b67af8-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:29:48 devstack sudo[89927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_a5gwjrpv
Feb 27 01:29:48 devstack sudo[89927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:48 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-928d4add-98c4-4985-917a-01e500dfb319 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Acquiring lock "cinder-quobyte-411c0b8c-afec-417b-9dbd-3e6d15b67af8" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:29:48 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-928d4add-98c4-4985-917a-01e500dfb319 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Lock "cinder-quobyte-411c0b8c-afec-417b-9dbd-3e6d15b67af8" acquired by "delete_volume" :: waited 0.012s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:29:48 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e880491-96ed-451e-aac0-2d73482b692b]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:29:48 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-928d4add-98c4-4985-917a-01e500dfb319 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-411c0b8c-afec-417b-9dbd-3e6d15b67af8 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:48 devstack sudo[89929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-411c0b8c-afec-417b-9dbd-3e6d15b67af8
Feb 27 01:29:48 devstack sudo[89929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:48 devstack sudo[89927]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:48 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7a68c69e-af58-4aa5-aafa-94a56bc65218 tempest-VolumesGetTest-1299330385 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_a5gwjrpv" returned: 0 in 0.480s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:48 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7a68c69e-af58-4aa5-aafa-94a56bc65218 tempest-VolumesGetTest-1299330385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_a5gwjrpv {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:48 devstack sudo[89933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_a5gwjrpv
Feb 27 01:29:48 devstack sudo[89933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:48 devstack sudo[89929]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:48 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-928d4add-98c4-4985-917a-01e500dfb319 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-411c0b8c-afec-417b-9dbd-3e6d15b67af8" returned: 0 in 0.576s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:48 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-928d4add-98c4-4985-917a-01e500dfb319 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-411c0b8c-afec-417b-9dbd-3e6d15b67af8 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:48 devstack sudo[89938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-411c0b8c-afec-417b-9dbd-3e6d15b67af8
Feb 27 01:29:48 devstack sudo[89938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:49 devstack sudo[89933]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7a68c69e-af58-4aa5-aafa-94a56bc65218 tempest-VolumesGetTest-1299330385 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_a5gwjrpv" returned: 1 in 0.504s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7a68c69e-af58-4aa5-aafa-94a56bc65218 tempest-VolumesGetTest-1299330385 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_a5gwjrpv' failed. Not Retrying. {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 27 01:29:49 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[5076b2cf-cfcb-46a0-a76e-dbb84002ed15]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:29:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7a68c69e-af58-4aa5-aafa-94a56bc65218 tempest-VolumesGetTest-1299330385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_skalglp6devstack@QuobyteHD {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:49 devstack sudo[89942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_skalglp6devstack@QuobyteHD
Feb 27 01:29:49 devstack sudo[89942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:49 devstack sudo[89938]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-928d4add-98c4-4985-917a-01e500dfb319 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-411c0b8c-afec-417b-9dbd-3e6d15b67af8" returned: 0 in 0.497s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:49 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-928d4add-98c4-4985-917a-01e500dfb319 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Lock "cinder-quobyte-411c0b8c-afec-417b-9dbd-3e6d15b67af8" released by "delete_volume" :: held 1.101s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:29:49 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-928d4add-98c4-4985-917a-01e500dfb319 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Created reservations ['df482cce-1d77-46de-a8f9-6152fdb347af', '500937b7-24e2-4dc9-8953-d104ea6fa277', 'ad28b653-91e6-4e65-8d25-898118bce23b', '740835ba-74d0-4be1-87a5-78b5ce5a2348'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:29:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-928d4add-98c4-4985-917a-01e500dfb319 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-928d4add-98c4-4985-917a-01e500dfb319 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:29:49 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-928d4add-98c4-4985-917a-01e500dfb319 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:29:49 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-928d4add-98c4-4985-917a-01e500dfb319 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:29:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-928d4add-98c4-4985-917a-01e500dfb319 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:29:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-928d4add-98c4-4985-917a-01e500dfb319 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:49 devstack sudo[89945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:29:49 devstack sudo[89945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:49 devstack sudo[89942]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7a68c69e-af58-4aa5-aafa-94a56bc65218 tempest-VolumesGetTest-1299330385 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_skalglp6devstack@QuobyteHD" returned: 0 in 0.605s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:49 devstack cinder-volume[83106]: DEBUG cinder.image.image_utils [None req-7a68c69e-af58-4aa5-aafa-94a56bc65218 tempest-VolumesGetTest-1299330385 None] 4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca was qcow2, converting to raw {{(pid=83106) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Feb 27 01:29:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7a68c69e-af58-4aa5-aafa-94a56bc65218 tempest-VolumesGetTest-1299330385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_skalglp6devstack@QuobyteHD /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-768708c8-91d9-4f9e-845a-baae50959a89 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:49 devstack sudo[89950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_skalglp6devstack@QuobyteHD /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-768708c8-91d9-4f9e-845a-baae50959a89
Feb 27 01:29:49 devstack sudo[89950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:50 devstack sudo[89945]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:50 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-928d4add-98c4-4985-917a-01e500dfb319 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.475s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:50 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-928d4add-98c4-4985-917a-01e500dfb319 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:29:50 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-928d4add-98c4-4985-917a-01e500dfb319 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Deleted volume successfully.
Feb 27 01:29:50 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-928d4add-98c4-4985-917a-01e500dfb319 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Lock "cinder-411c0b8c-afec-417b-9dbd-3e6d15b67af8-delete_volume" released by "delete_volume" :: held 1.775s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:29:50 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-580752f5-bbf4-4a72-a950-6aa87e2faeee tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Acquiring lock "cinder-827ef46e-f1f3-4a13-b262-283f813db6cd-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:29:50 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-580752f5-bbf4-4a72-a950-6aa87e2faeee tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Lock "cinder-827ef46e-f1f3-4a13-b262-283f813db6cd-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:29:50 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-580752f5-bbf4-4a72-a950-6aa87e2faeee tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Acquiring lock "cinder-quobyte-827ef46e-f1f3-4a13-b262-283f813db6cd" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:29:50 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-580752f5-bbf4-4a72-a950-6aa87e2faeee tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Lock "cinder-quobyte-827ef46e-f1f3-4a13-b262-283f813db6cd" acquired by "delete_volume" :: waited 0.012s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:29:50 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[50bbf143-5ebd-4db8-a6bd-bf5bdb14f1ab]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:29:50 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-580752f5-bbf4-4a72-a950-6aa87e2faeee tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-827ef46e-f1f3-4a13-b262-283f813db6cd {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:50 devstack sudo[89964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-827ef46e-f1f3-4a13-b262-283f813db6cd
Feb 27 01:29:50 devstack sudo[89964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:50 devstack sudo[89950]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:50 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7a68c69e-af58-4aa5-aafa-94a56bc65218 tempest-VolumesGetTest-1299330385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_skalglp6devstack@QuobyteHD /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-768708c8-91d9-4f9e-845a-baae50959a89" returned: 0 in 0.966s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:50 devstack cinder-volume[83106]: DEBUG cinder.image.image_utils [None req-7a68c69e-af58-4aa5-aafa-94a56bc65218 tempest-VolumesGetTest-1299330385 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca_skalglp6devstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-768708c8-91d9-4f9e-845a-baae50959a89 {{(pid=83106) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 27 01:29:50 devstack cinder-volume[83106]: INFO cinder.image.image_utils [None req-7a68c69e-af58-4aa5-aafa-94a56bc65218 tempest-VolumesGetTest-1299330385 None] Converted 112.00 MB image at 112.00 MB/s
Feb 27 01:29:50 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7a68c69e-af58-4aa5-aafa-94a56bc65218 tempest-VolumesGetTest-1299330385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-768708c8-91d9-4f9e-845a-baae50959a89 1G {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:50 devstack sudo[89966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-768708c8-91d9-4f9e-845a-baae50959a89 1G
Feb 27 01:29:50 devstack sudo[89966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:51 devstack sudo[89964]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:51 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-580752f5-bbf4-4a72-a950-6aa87e2faeee tempest-CreateVolumesFromSourceVolumeTest-509922347 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-827ef46e-f1f3-4a13-b262-283f813db6cd" returned: 0 in 0.587s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:51 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-580752f5-bbf4-4a72-a950-6aa87e2faeee tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-827ef46e-f1f3-4a13-b262-283f813db6cd {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:51 devstack sudo[89971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-827ef46e-f1f3-4a13-b262-283f813db6cd
Feb 27 01:29:51 devstack sudo[89971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:51 devstack sudo[89966]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:51 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7a68c69e-af58-4aa5-aafa-94a56bc65218 tempest-VolumesGetTest-1299330385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-768708c8-91d9-4f9e-845a-baae50959a89 1G" returned: 0 in 0.506s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:51 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b35fb1-74de-4055-91df-b294d678fbc5]: (4, 'raw') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:29:51 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7a68c69e-af58-4aa5-aafa-94a56bc65218 tempest-VolumesGetTest-1299330385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-768708c8-91d9-4f9e-845a-baae50959a89 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:51 devstack sudo[89976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-768708c8-91d9-4f9e-845a-baae50959a89
Feb 27 01:29:51 devstack sudo[89976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:51 devstack sudo[89971]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:51 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-580752f5-bbf4-4a72-a950-6aa87e2faeee tempest-CreateVolumesFromSourceVolumeTest-509922347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-827ef46e-f1f3-4a13-b262-283f813db6cd" returned: 0 in 0.476s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:51 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-580752f5-bbf4-4a72-a950-6aa87e2faeee tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Lock "cinder-quobyte-827ef46e-f1f3-4a13-b262-283f813db6cd" released by "delete_volume" :: held 1.094s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:29:51 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-580752f5-bbf4-4a72-a950-6aa87e2faeee tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Created reservations ['f0c27744-464c-404d-bba4-1b2a34b8abee', '029d7f21-0238-4e82-8473-d29b26ea0772', '53e3cb04-6422-486a-b9df-fc13be8189b0', '04cc3a6f-bfbe-4b32-9d9a-a5ce32bcdfa0'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:29:51 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-580752f5-bbf4-4a72-a950-6aa87e2faeee tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:51 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-580752f5-bbf4-4a72-a950-6aa87e2faeee tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:29:51 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-580752f5-bbf4-4a72-a950-6aa87e2faeee tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:29:51 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-580752f5-bbf4-4a72-a950-6aa87e2faeee tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:29:51 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-580752f5-bbf4-4a72-a950-6aa87e2faeee tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:29:51 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-580752f5-bbf4-4a72-a950-6aa87e2faeee tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:51 devstack sudo[89979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:29:51 devstack sudo[89979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:51 devstack sudo[89976]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:51 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7a68c69e-af58-4aa5-aafa-94a56bc65218 tempest-VolumesGetTest-1299330385 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-768708c8-91d9-4f9e-845a-baae50959a89" returned: 0 in 0.510s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:51 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7a68c69e-af58-4aa5-aafa-94a56bc65218 tempest-VolumesGetTest-1299330385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-768708c8-91d9-4f9e-845a-baae50959a89 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:51 devstack sudo[89983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-768708c8-91d9-4f9e-845a-baae50959a89
Feb 27 01:29:51 devstack sudo[89983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:52 devstack sudo[89979]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:52 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-580752f5-bbf4-4a72-a950-6aa87e2faeee tempest-CreateVolumesFromSourceVolumeTest-509922347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.476s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:52 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-580752f5-bbf4-4a72-a950-6aa87e2faeee tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:29:52 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-580752f5-bbf4-4a72-a950-6aa87e2faeee tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Deleted volume successfully.
Feb 27 01:29:52 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-580752f5-bbf4-4a72-a950-6aa87e2faeee tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Lock "cinder-827ef46e-f1f3-4a13-b262-283f813db6cd-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:29:52 devstack sudo[89983]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:52 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7a68c69e-af58-4aa5-aafa-94a56bc65218 tempest-VolumesGetTest-1299330385 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-768708c8-91d9-4f9e-845a-baae50959a89" returned: 1 in 0.499s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:52 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7a68c69e-af58-4aa5-aafa-94a56bc65218 tempest-VolumesGetTest-1299330385 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-768708c8-91d9-4f9e-845a-baae50959a89' failed. Not Retrying. {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 27 01:29:52 devstack cinder-volume[83106]: DEBUG cinder.volume.volume_utils [None req-7a68c69e-af58-4aa5-aafa-94a56bc65218 tempest-VolumesGetTest-1299330385 None] Downloaded image 4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca ((None, [{'url': 'file:///opt/stack/data/glance/images/4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca', 'metadata': {}}])) to volume 768708c8-91d9-4f9e-845a-baae50959a89 successfully. {{(pid=83106) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Feb 27 01:29:52 devstack cinder-volume[83106]: DEBUG cinder.image.image_utils [None req-7a68c69e-af58-4aa5-aafa-94a56bc65218 tempest-VolumesGetTest-1299330385 None] Temporary image 4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca for user 127cb18bec0a41a9bc4186e2ee63b6a9 is deleted. {{(pid=83106) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Feb 27 01:29:52 devstack cinder-volume[83106]: DEBUG cinder.volume.volume_utils [None req-7a68c69e-af58-4aa5-aafa-94a56bc65218 tempest-VolumesGetTest-1299330385 None] Marking volume 768708c8-91d9-4f9e-845a-baae50959a89 as bootable. {{(pid=83106) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Feb 27 01:29:52 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a68c69e-af58-4aa5-aafa-94a56bc65218 tempest-VolumesGetTest-1299330385 None] Copying metadata from image 4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca to 768708c8-91d9-4f9e-845a-baae50959a89. {{(pid=83106) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Feb 27 01:29:52 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a68c69e-af58-4aa5-aafa-94a56bc65218 tempest-VolumesGetTest-1299330385 None] Creating volume glance metadata for volume 768708c8-91d9-4f9e-845a-baae50959a89 backed by image 4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83106) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Feb 27 01:29:52 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7a68c69e-af58-4aa5-aafa-94a56bc65218 tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd56f239-89d6-4c1e-8e76-db1098b26e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-768708c8-91d9-4f9e-845a-baae50959a89', 'volume_size': 1, 'image_id': '4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd105600f18404a29b5061e7b75a5bfe1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca', 'created_at': datetime.datetime(2026, 2, 27, 0, 17, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 17, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4dfcc97a-7d97-4dac-ad9f-bdd75622e2ca/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f07e8c55f30>}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:52 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7a68c69e-af58-4aa5-aafa-94a56bc65218 tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8bd0afa-3c5d-4d75-a382-5f8e489da6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:52 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-7a68c69e-af58-4aa5-aafa-94a56bc65218 tempest-VolumesGetTest-1299330385 None] Volume volume-768708c8-91d9-4f9e-845a-baae50959a89 (768708c8-91d9-4f9e-845a-baae50959a89): created successfully
Feb 27 01:29:52 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7a68c69e-af58-4aa5-aafa-94a56bc65218 tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8bd0afa-3c5d-4d75-a382-5f8e489da6c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:52 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7a68c69e-af58-4aa5-aafa-94a56bc65218 tempest-VolumesGetTest-1299330385 None] Flow 'volume_create_manager' (e1167a15-c004-405a-8557-489671ef40a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:29:52 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-7a68c69e-af58-4aa5-aafa-94a56bc65218 tempest-VolumesGetTest-1299330385 None] Created volume successfully.
Feb 27 01:29:52 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-8d52261d-93db-4065-a1e3-d81df2dd4c3b tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Acquiring lock "cinder-dce80fb2-852a-4e5b-b957-454f04576351-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:29:52 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-8d52261d-93db-4065-a1e3-d81df2dd4c3b tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Lock "cinder-dce80fb2-852a-4e5b-b957-454f04576351-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:29:52 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-8d52261d-93db-4065-a1e3-d81df2dd4c3b tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Acquiring lock "cinder-quobyte-dce80fb2-852a-4e5b-b957-454f04576351" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:29:52 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-8d52261d-93db-4065-a1e3-d81df2dd4c3b tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Lock "cinder-quobyte-dce80fb2-852a-4e5b-b957-454f04576351" acquired by "delete_volume" :: waited 0.007s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:29:52 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[50cbbe0d-cf44-4a00-9298-4951e10fc015]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:29:52 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-8d52261d-93db-4065-a1e3-d81df2dd4c3b tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dce80fb2-852a-4e5b-b957-454f04576351 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:52 devstack sudo[89989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dce80fb2-852a-4e5b-b957-454f04576351
Feb 27 01:29:52 devstack sudo[89989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:53 devstack sudo[89989]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:53 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-8d52261d-93db-4065-a1e3-d81df2dd4c3b tempest-CreateVolumesFromSourceVolumeTest-509922347 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dce80fb2-852a-4e5b-b957-454f04576351" returned: 0 in 0.490s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:53 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-8d52261d-93db-4065-a1e3-d81df2dd4c3b tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dce80fb2-852a-4e5b-b957-454f04576351 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:53 devstack sudo[89995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dce80fb2-852a-4e5b-b957-454f04576351
Feb 27 01:29:53 devstack sudo[89995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:53 devstack sudo[89995]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:53 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-8d52261d-93db-4065-a1e3-d81df2dd4c3b tempest-CreateVolumesFromSourceVolumeTest-509922347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dce80fb2-852a-4e5b-b957-454f04576351" returned: 0 in 0.409s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:53 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-8d52261d-93db-4065-a1e3-d81df2dd4c3b tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Lock "cinder-quobyte-dce80fb2-852a-4e5b-b957-454f04576351" released by "delete_volume" :: held 0.928s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:29:53 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-8d52261d-93db-4065-a1e3-d81df2dd4c3b tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Created reservations ['c1386446-a1e2-4a63-b14e-d5c8864a71df', 'e1f33df7-d0e7-46fe-8513-b60494bdb0fa', '229ce30e-61f6-4030-915a-14b82134e03f', 'b327201c-1e7f-4b65-b129-e4c17a077962'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:29:53 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-8d52261d-93db-4065-a1e3-d81df2dd4c3b tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:53 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-8d52261d-93db-4065-a1e3-d81df2dd4c3b tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:29:53 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-8d52261d-93db-4065-a1e3-d81df2dd4c3b tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:29:53 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-8d52261d-93db-4065-a1e3-d81df2dd4c3b tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:29:53 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-8d52261d-93db-4065-a1e3-d81df2dd4c3b tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:29:53 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-8d52261d-93db-4065-a1e3-d81df2dd4c3b tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:53 devstack sudo[89998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:29:53 devstack sudo[89998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:53 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-735ad810-9b5d-4472-8696-de8e33a57ff4 tempest-VolumesGetTest-1299330385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:29:53 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-735ad810-9b5d-4472-8696-de8e33a57ff4 tempest-VolumesGetTest-1299330385 None] Flow 'volume_create_manager' (05fd2365-4477-4c15-b3eb-4560b9ae4369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:29:53 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-735ad810-9b5d-4472-8696-de8e33a57ff4 tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (910f1592-f095-4166-a747-60e1477800a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:53 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-735ad810-9b5d-4472-8696-de8e33a57ff4 tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (910f1592-f095-4166-a747-60e1477800a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:29:54Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-256409562',display_name='tempest-VolumesGetTest-Volume-1416897501',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d9d760a-00d9-4e7f-8c87-d259aebb3e0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62820bf75832490faca5bc43e4724911',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:29:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:29:54Z,use_quota=True,user_id='127cb18bec0a41a9bc4186e2ee63b6a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:53 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-735ad810-9b5d-4472-8696-de8e33a57ff4 tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87c1f2b3-5c36-4844-943f-3507e62d55c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:53 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-735ad810-9b5d-4472-8696-de8e33a57ff4 tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87c1f2b3-5c36-4844-943f-3507e62d55c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:53 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-735ad810-9b5d-4472-8696-de8e33a57ff4 tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0554d8cd-2be1-4173-907b-ff6b628e13c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:53 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-735ad810-9b5d-4472-8696-de8e33a57ff4 tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0554d8cd-2be1-4173-907b-ff6b628e13c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d9d760a-00d9-4e7f-8c87-d259aebb3e0f', 'volume_name': 'volume-0d9d760a-00d9-4e7f-8c87-d259aebb3e0f', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:53 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-735ad810-9b5d-4472-8696-de8e33a57ff4 tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d806b9e-9aac-43ad-8a79-492a83ab26b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:53 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-735ad810-9b5d-4472-8696-de8e33a57ff4 tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d806b9e-9aac-43ad-8a79-492a83ab26b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:53 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-735ad810-9b5d-4472-8696-de8e33a57ff4 tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7406a679-d4d3-4c17-ae97-482ffdf4fd05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:53 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-735ad810-9b5d-4472-8696-de8e33a57ff4 tempest-VolumesGetTest-1299330385 None] Volume 0d9d760a-00d9-4e7f-8c87-d259aebb3e0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d9d760a-00d9-4e7f-8c87-d259aebb3e0f', 'volume_size': 1}
Feb 27 01:29:53 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-735ad810-9b5d-4472-8696-de8e33a57ff4 tempest-VolumesGetTest-1299330385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:53 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-735ad810-9b5d-4472-8696-de8e33a57ff4 tempest-VolumesGetTest-1299330385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:29:53 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-735ad810-9b5d-4472-8696-de8e33a57ff4 tempest-VolumesGetTest-1299330385 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:29:54Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-256409562',display_name='tempest-VolumesGetTest-Volume-1416897501',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d9d760a-00d9-4e7f-8c87-d259aebb3e0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62820bf75832490faca5bc43e4724911',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:29:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:29:54Z,use_quota=True,user_id='127cb18bec0a41a9bc4186e2ee63b6a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:29:53 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-735ad810-9b5d-4472-8696-de8e33a57ff4 tempest-VolumesGetTest-1299330385 None] Creating volume 0d9d760a-00d9-4e7f-8c87-d259aebb3e0f {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:29:53 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-735ad810-9b5d-4472-8696-de8e33a57ff4 tempest-VolumesGetTest-1299330385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:53 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-735ad810-9b5d-4472-8696-de8e33a57ff4 tempest-VolumesGetTest-1299330385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:29:53 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-735ad810-9b5d-4472-8696-de8e33a57ff4 tempest-VolumesGetTest-1299330385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:29:53 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-735ad810-9b5d-4472-8696-de8e33a57ff4 tempest-VolumesGetTest-1299330385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:29:53 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-735ad810-9b5d-4472-8696-de8e33a57ff4 tempest-VolumesGetTest-1299330385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:29:53 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-735ad810-9b5d-4472-8696-de8e33a57ff4 tempest-VolumesGetTest-1299330385 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:29:53 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-735ad810-9b5d-4472-8696-de8e33a57ff4 tempest-VolumesGetTest-1299330385 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:29:53 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-735ad810-9b5d-4472-8696-de8e33a57ff4 tempest-VolumesGetTest-1299330385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0d9d760a-00d9-4e7f-8c87-d259aebb3e0f 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:53 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-8e906b58-e6e2-4676-adca-ca9fffcc39ea tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Acquiring lock "cinder-8f08018c-ff95-4db8-bcf7-d84720d0a6c8-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:29:53 devstack sudo[90000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0d9d760a-00d9-4e7f-8c87-d259aebb3e0f 1073741824
Feb 27 01:29:53 devstack sudo[90000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:53 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-8e906b58-e6e2-4676-adca-ca9fffcc39ea tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Lock "cinder-8f08018c-ff95-4db8-bcf7-d84720d0a6c8-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:29:53 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-8e906b58-e6e2-4676-adca-ca9fffcc39ea tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Acquiring lock "cinder-quobyte-8f08018c-ff95-4db8-bcf7-d84720d0a6c8" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:29:53 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-8e906b58-e6e2-4676-adca-ca9fffcc39ea tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Lock "cinder-quobyte-8f08018c-ff95-4db8-bcf7-d84720d0a6c8" acquired by "delete_volume" :: waited 0.007s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:29:53 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c2145b-8694-4637-a5a5-cf29248fa9be]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:29:53 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-8e906b58-e6e2-4676-adca-ca9fffcc39ea tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8f08018c-ff95-4db8-bcf7-d84720d0a6c8 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:54 devstack sudo[90002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8f08018c-ff95-4db8-bcf7-d84720d0a6c8
Feb 27 01:29:54 devstack sudo[90002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:54 devstack sudo[89998]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:54 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-8d52261d-93db-4065-a1e3-d81df2dd4c3b tempest-CreateVolumesFromSourceVolumeTest-509922347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.583s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:54 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-8d52261d-93db-4065-a1e3-d81df2dd4c3b tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:29:54 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-8d52261d-93db-4065-a1e3-d81df2dd4c3b tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Deleted volume successfully.
Feb 27 01:29:54 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-8d52261d-93db-4065-a1e3-d81df2dd4c3b tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Lock "cinder-dce80fb2-852a-4e5b-b957-454f04576351-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:29:54 devstack sudo[90000]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:54 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-735ad810-9b5d-4472-8696-de8e33a57ff4 tempest-VolumesGetTest-1299330385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0d9d760a-00d9-4e7f-8c87-d259aebb3e0f 1073741824" returned: 0 in 0.573s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:54 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-735ad810-9b5d-4472-8696-de8e33a57ff4 tempest-VolumesGetTest-1299330385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0d9d760a-00d9-4e7f-8c87-d259aebb3e0f {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:54 devstack sudo[90011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0d9d760a-00d9-4e7f-8c87-d259aebb3e0f
Feb 27 01:29:54 devstack sudo[90011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:54 devstack sudo[90002]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:54 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-8e906b58-e6e2-4676-adca-ca9fffcc39ea tempest-CreateVolumesFromSourceVolumeTest-509922347 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8f08018c-ff95-4db8-bcf7-d84720d0a6c8" returned: 0 in 0.576s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:54 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-8e906b58-e6e2-4676-adca-ca9fffcc39ea tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8f08018c-ff95-4db8-bcf7-d84720d0a6c8 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:54 devstack sudo[90013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8f08018c-ff95-4db8-bcf7-d84720d0a6c8
Feb 27 01:29:54 devstack sudo[90013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:54 devstack sudo[90011]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:54 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-735ad810-9b5d-4472-8696-de8e33a57ff4 tempest-VolumesGetTest-1299330385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0d9d760a-00d9-4e7f-8c87-d259aebb3e0f" returned: 0 in 0.497s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:54 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-735ad810-9b5d-4472-8696-de8e33a57ff4 tempest-VolumesGetTest-1299330385 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:29:54 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-735ad810-9b5d-4472-8696-de8e33a57ff4 tempest-VolumesGetTest-1299330385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:29:54 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-735ad810-9b5d-4472-8696-de8e33a57ff4 tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7406a679-d4d3-4c17-ae97-482ffdf4fd05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d9d760a-00d9-4e7f-8c87-d259aebb3e0f', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:54 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-735ad810-9b5d-4472-8696-de8e33a57ff4 tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (179b7fc5-1827-4d11-a645-8ab1e62a14f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:29:54 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-735ad810-9b5d-4472-8696-de8e33a57ff4 tempest-VolumesGetTest-1299330385 None] Volume volume-0d9d760a-00d9-4e7f-8c87-d259aebb3e0f (0d9d760a-00d9-4e7f-8c87-d259aebb3e0f): created successfully
Feb 27 01:29:55 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-735ad810-9b5d-4472-8696-de8e33a57ff4 tempest-VolumesGetTest-1299330385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (179b7fc5-1827-4d11-a645-8ab1e62a14f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:29:55 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-735ad810-9b5d-4472-8696-de8e33a57ff4 tempest-VolumesGetTest-1299330385 None] Flow 'volume_create_manager' (05fd2365-4477-4c15-b3eb-4560b9ae4369) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:29:55 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-735ad810-9b5d-4472-8696-de8e33a57ff4 tempest-VolumesGetTest-1299330385 None] Created volume successfully.
Feb 27 01:29:55 devstack sudo[90013]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-8e906b58-e6e2-4676-adca-ca9fffcc39ea tempest-CreateVolumesFromSourceVolumeTest-509922347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8f08018c-ff95-4db8-bcf7-d84720d0a6c8" returned: 0 in 0.503s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:55 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-8e906b58-e6e2-4676-adca-ca9fffcc39ea tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Lock "cinder-quobyte-8f08018c-ff95-4db8-bcf7-d84720d0a6c8" released by "delete_volume" :: held 1.103s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:29:55 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-8e906b58-e6e2-4676-adca-ca9fffcc39ea tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Created reservations ['35dfd434-d1f4-44ed-89b6-864d0e92815b', '7a59fbea-6175-4846-8053-db4e3027468a', '5610b031-a34a-4870-8338-264acff3121d', 'ec998b42-bb7e-49e2-847e-38ee51b1f069'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:29:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-8e906b58-e6e2-4676-adca-ca9fffcc39ea tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-8e906b58-e6e2-4676-adca-ca9fffcc39ea tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:29:55 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-8e906b58-e6e2-4676-adca-ca9fffcc39ea tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:29:55 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-8e906b58-e6e2-4676-adca-ca9fffcc39ea tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:29:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-8e906b58-e6e2-4676-adca-ca9fffcc39ea tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:29:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-8e906b58-e6e2-4676-adca-ca9fffcc39ea tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:55 devstack sudo[90017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:29:55 devstack sudo[90017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:55 devstack sudo[90017]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-8e906b58-e6e2-4676-adca-ca9fffcc39ea tempest-CreateVolumesFromSourceVolumeTest-509922347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.468s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:55 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-8e906b58-e6e2-4676-adca-ca9fffcc39ea tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:29:55 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-8e906b58-e6e2-4676-adca-ca9fffcc39ea tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Deleted volume successfully.
Feb 27 01:29:55 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-8e906b58-e6e2-4676-adca-ca9fffcc39ea tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Lock "cinder-8f08018c-ff95-4db8-bcf7-d84720d0a6c8-delete_volume" released by "delete_volume" :: held 1.709s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:29:56 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-a66d7013-0e0f-429b-8170-7aea1917161a tempest-VolumesGetTest-1299330385 None] Acquiring lock "cinder-0d9d760a-00d9-4e7f-8c87-d259aebb3e0f-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:29:56 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-c1f78c30-3fe5-44d6-9ce6-0f4cb3c1f443 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Acquiring lock "cinder-be50a4f5-2bc8-476d-85df-653a6416244f-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:29:56 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-a66d7013-0e0f-429b-8170-7aea1917161a tempest-VolumesGetTest-1299330385 None] Lock "cinder-0d9d760a-00d9-4e7f-8c87-d259aebb3e0f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:29:56 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-c1f78c30-3fe5-44d6-9ce6-0f4cb3c1f443 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Lock "cinder-be50a4f5-2bc8-476d-85df-653a6416244f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:29:56 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-a66d7013-0e0f-429b-8170-7aea1917161a tempest-VolumesGetTest-1299330385 None] Acquiring lock "cinder-quobyte-0d9d760a-00d9-4e7f-8c87-d259aebb3e0f" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:29:56 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-c1f78c30-3fe5-44d6-9ce6-0f4cb3c1f443 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Acquiring lock "cinder-quobyte-be50a4f5-2bc8-476d-85df-653a6416244f" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:29:56 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-a66d7013-0e0f-429b-8170-7aea1917161a tempest-VolumesGetTest-1299330385 None] Lock "cinder-quobyte-0d9d760a-00d9-4e7f-8c87-d259aebb3e0f" acquired by "delete_volume" :: waited 0.018s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:29:56 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-c1f78c30-3fe5-44d6-9ce6-0f4cb3c1f443 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Lock "cinder-quobyte-be50a4f5-2bc8-476d-85df-653a6416244f" acquired by "delete_volume" :: waited 0.019s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:29:56 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdfee325-a09f-48e5-9deb-5f7838ee224e]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:29:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a66d7013-0e0f-429b-8170-7aea1917161a tempest-VolumesGetTest-1299330385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0d9d760a-00d9-4e7f-8c87-d259aebb3e0f {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:56 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[e106486c-6fbb-49bf-a8d5-75ceeb554de1]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:29:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c1f78c30-3fe5-44d6-9ce6-0f4cb3c1f443 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-be50a4f5-2bc8-476d-85df-653a6416244f {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:56 devstack sudo[90020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0d9d760a-00d9-4e7f-8c87-d259aebb3e0f
Feb 27 01:29:56 devstack sudo[90020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:56 devstack sudo[90021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-be50a4f5-2bc8-476d-85df-653a6416244f
Feb 27 01:29:56 devstack sudo[90021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:56 devstack sudo[90020]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a66d7013-0e0f-429b-8170-7aea1917161a tempest-VolumesGetTest-1299330385 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0d9d760a-00d9-4e7f-8c87-d259aebb3e0f" returned: 0 in 0.556s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a66d7013-0e0f-429b-8170-7aea1917161a tempest-VolumesGetTest-1299330385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0d9d760a-00d9-4e7f-8c87-d259aebb3e0f {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:56 devstack sudo[90021]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c1f78c30-3fe5-44d6-9ce6-0f4cb3c1f443 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-be50a4f5-2bc8-476d-85df-653a6416244f" returned: 0 in 0.562s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c1f78c30-3fe5-44d6-9ce6-0f4cb3c1f443 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-be50a4f5-2bc8-476d-85df-653a6416244f {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:56 devstack sudo[90030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0d9d760a-00d9-4e7f-8c87-d259aebb3e0f
Feb 27 01:29:56 devstack sudo[90030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:56 devstack sudo[90031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-be50a4f5-2bc8-476d-85df-653a6416244f
Feb 27 01:29:56 devstack sudo[90031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:56 devstack cinder-volume[83106]: DEBUG oslo_service.periodic_task [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83106) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Feb 27 01:29:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:29:56 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:29:56 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:29:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:29:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:56 devstack sudo[90034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:29:56 devstack sudo[90034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:57 devstack sudo[90030]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a66d7013-0e0f-429b-8170-7aea1917161a tempest-VolumesGetTest-1299330385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0d9d760a-00d9-4e7f-8c87-d259aebb3e0f" returned: 0 in 0.431s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:57 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-a66d7013-0e0f-429b-8170-7aea1917161a tempest-VolumesGetTest-1299330385 None] Lock "cinder-quobyte-0d9d760a-00d9-4e7f-8c87-d259aebb3e0f" released by "delete_volume" :: held 1.019s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:29:57 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-a66d7013-0e0f-429b-8170-7aea1917161a tempest-VolumesGetTest-1299330385 None] Created reservations ['e145321b-aae6-41dc-bcdf-78ebf315bfc2', '800ff057-6392-4f0e-9629-aea9fe66819b', '6850ec85-83d0-42ea-a3ba-35ee17fd443f', '2020687c-6670-4d87-aba8-b2ef9c690e1e'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:29:57 devstack sudo[90031]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c1f78c30-3fe5-44d6-9ce6-0f4cb3c1f443 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-be50a4f5-2bc8-476d-85df-653a6416244f" returned: 0 in 0.479s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:57 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-c1f78c30-3fe5-44d6-9ce6-0f4cb3c1f443 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Lock "cinder-quobyte-be50a4f5-2bc8-476d-85df-653a6416244f" released by "delete_volume" :: held 1.074s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:29:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-a66d7013-0e0f-429b-8170-7aea1917161a tempest-VolumesGetTest-1299330385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-a66d7013-0e0f-429b-8170-7aea1917161a tempest-VolumesGetTest-1299330385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:29:57 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-a66d7013-0e0f-429b-8170-7aea1917161a tempest-VolumesGetTest-1299330385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:29:57 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-a66d7013-0e0f-429b-8170-7aea1917161a tempest-VolumesGetTest-1299330385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:29:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-a66d7013-0e0f-429b-8170-7aea1917161a tempest-VolumesGetTest-1299330385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:29:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a66d7013-0e0f-429b-8170-7aea1917161a tempest-VolumesGetTest-1299330385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:57 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-c1f78c30-3fe5-44d6-9ce6-0f4cb3c1f443 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Created reservations ['9719aa97-b328-49bf-9148-93e8f91cc2e2', '65c80ce9-e9e3-4272-bcba-ed07475b3781', '97f3721a-b1c1-4fe1-9283-9dab51dfebab', '2f0acd43-821a-4d4d-979a-3b846bb3b73a'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:29:57 devstack sudo[90038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:29:57 devstack sudo[90038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-c1f78c30-3fe5-44d6-9ce6-0f4cb3c1f443 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-c1f78c30-3fe5-44d6-9ce6-0f4cb3c1f443 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:29:57 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-c1f78c30-3fe5-44d6-9ce6-0f4cb3c1f443 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:29:57 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-c1f78c30-3fe5-44d6-9ce6-0f4cb3c1f443 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:29:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-c1f78c30-3fe5-44d6-9ce6-0f4cb3c1f443 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:29:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c1f78c30-3fe5-44d6-9ce6-0f4cb3c1f443 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:57 devstack sudo[90041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:29:57 devstack sudo[90041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:57 devstack sudo[90034]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.521s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:57 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:29:57 devstack sudo[90041]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c1f78c30-3fe5-44d6-9ce6-0f4cb3c1f443 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.424s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:57 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-c1f78c30-3fe5-44d6-9ce6-0f4cb3c1f443 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:29:57 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-c1f78c30-3fe5-44d6-9ce6-0f4cb3c1f443 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Deleted volume successfully.
Feb 27 01:29:57 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-c1f78c30-3fe5-44d6-9ce6-0f4cb3c1f443 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Lock "cinder-be50a4f5-2bc8-476d-85df-653a6416244f-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:29:57 devstack sudo[90038]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a66d7013-0e0f-429b-8170-7aea1917161a tempest-VolumesGetTest-1299330385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.602s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:57 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-a66d7013-0e0f-429b-8170-7aea1917161a tempest-VolumesGetTest-1299330385 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:29:57 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-a66d7013-0e0f-429b-8170-7aea1917161a tempest-VolumesGetTest-1299330385 None] Deleted volume successfully.
Feb 27 01:29:57 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-a66d7013-0e0f-429b-8170-7aea1917161a tempest-VolumesGetTest-1299330385 None] Lock "cinder-0d9d760a-00d9-4e7f-8c87-d259aebb3e0f-delete_volume" released by "delete_volume" :: held 1.811s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:29:58 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-27368690-be4c-4924-9806-b84b0a554548 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Acquiring lock "cinder-720861f5-a374-4bea-b602-8c718245139c-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:29:58 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-27368690-be4c-4924-9806-b84b0a554548 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Lock "cinder-720861f5-a374-4bea-b602-8c718245139c-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:29:58 devstack cinder-volume[83106]: DEBUG dbcounter [-] [83106] Writing DB stats cinder:SELECT=118,cinder:INSERT=52,cinder:UPDATE=160,cinder:DELETE=16 {{(pid=83106) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 01:29:58 devstack cinder-volume[83106]: DEBUG dbcounter [-] [83106] Writing DB stats cinder:UPDATE=180,cinder:SELECT=124,cinder:INSERT=39,cinder:DELETE=14 {{(pid=83106) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 01:29:58 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-27368690-be4c-4924-9806-b84b0a554548 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Acquiring lock "cinder-quobyte-720861f5-a374-4bea-b602-8c718245139c" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:29:58 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-27368690-be4c-4924-9806-b84b0a554548 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Lock "cinder-quobyte-720861f5-a374-4bea-b602-8c718245139c" acquired by "delete_volume" :: waited 0.009s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:29:58 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50e5a85-f5a1-4153-b312-2087a6b0745d]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:29:58 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-27368690-be4c-4924-9806-b84b0a554548 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-720861f5-a374-4bea-b602-8c718245139c {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:58 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-0501b661-0b99-49a7-ade8-57465f143980 tempest-VolumesGetTest-1299330385 None] Acquiring lock "cinder-768708c8-91d9-4f9e-845a-baae50959a89-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:29:58 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-0501b661-0b99-49a7-ade8-57465f143980 tempest-VolumesGetTest-1299330385 None] Lock "cinder-768708c8-91d9-4f9e-845a-baae50959a89-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:29:58 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-0501b661-0b99-49a7-ade8-57465f143980 tempest-VolumesGetTest-1299330385 None] Acquiring lock "cinder-quobyte-768708c8-91d9-4f9e-845a-baae50959a89" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:29:58 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-0501b661-0b99-49a7-ade8-57465f143980 tempest-VolumesGetTest-1299330385 None] Lock "cinder-quobyte-768708c8-91d9-4f9e-845a-baae50959a89" acquired by "delete_volume" :: waited 0.012s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:29:58 devstack sudo[90045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-720861f5-a374-4bea-b602-8c718245139c
Feb 27 01:29:58 devstack sudo[90045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:58 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7cc6e0-7841-4e4d-8b72-0c1d857e27f4]: (4, 'raw') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:29:58 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0501b661-0b99-49a7-ade8-57465f143980 tempest-VolumesGetTest-1299330385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-768708c8-91d9-4f9e-845a-baae50959a89 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:58 devstack sudo[90047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-768708c8-91d9-4f9e-845a-baae50959a89
Feb 27 01:29:58 devstack sudo[90047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:58 devstack sudo[90045]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:58 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-27368690-be4c-4924-9806-b84b0a554548 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-720861f5-a374-4bea-b602-8c718245139c" returned: 0 in 0.623s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:58 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-27368690-be4c-4924-9806-b84b0a554548 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-720861f5-a374-4bea-b602-8c718245139c {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:58 devstack sudo[90052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-720861f5-a374-4bea-b602-8c718245139c
Feb 27 01:29:58 devstack sudo[90052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:59 devstack sudo[90047]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:59 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0501b661-0b99-49a7-ade8-57465f143980 tempest-VolumesGetTest-1299330385 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-768708c8-91d9-4f9e-845a-baae50959a89" returned: 0 in 0.581s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:59 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0501b661-0b99-49a7-ade8-57465f143980 tempest-VolumesGetTest-1299330385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-768708c8-91d9-4f9e-845a-baae50959a89 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:59 devstack sudo[90056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-768708c8-91d9-4f9e-845a-baae50959a89
Feb 27 01:29:59 devstack sudo[90056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:59 devstack sudo[90052]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:59 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-27368690-be4c-4924-9806-b84b0a554548 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-720861f5-a374-4bea-b602-8c718245139c" returned: 0 in 0.437s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:59 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-27368690-be4c-4924-9806-b84b0a554548 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Lock "cinder-quobyte-720861f5-a374-4bea-b602-8c718245139c" released by "delete_volume" :: held 1.088s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:29:59 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-27368690-be4c-4924-9806-b84b0a554548 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Created reservations ['ee9622ab-863a-4075-9231-aa3effae1d4e', '681697cc-00a3-48dd-8a3a-4c335683246e', '67255b82-05d5-467f-800d-d6a6d339251a', 'fd835927-e9ef-4d3f-88ef-9d32f760a577'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:29:59 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-27368690-be4c-4924-9806-b84b0a554548 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:29:59 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-27368690-be4c-4924-9806-b84b0a554548 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:29:59 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-27368690-be4c-4924-9806-b84b0a554548 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:29:59 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-27368690-be4c-4924-9806-b84b0a554548 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:29:59 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-27368690-be4c-4924-9806-b84b0a554548 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:29:59 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-27368690-be4c-4924-9806-b84b0a554548 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:59 devstack sudo[90062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:29:59 devstack sudo[90062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:59 devstack sudo[90056]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:59 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0501b661-0b99-49a7-ade8-57465f143980 tempest-VolumesGetTest-1299330385 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-768708c8-91d9-4f9e-845a-baae50959a89" returned: 1 in 0.511s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:59 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0501b661-0b99-49a7-ade8-57465f143980 tempest-VolumesGetTest-1299330385 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-768708c8-91d9-4f9e-845a-baae50959a89' failed. Not Retrying. {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 27 01:29:59 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0501b661-0b99-49a7-ade8-57465f143980 tempest-VolumesGetTest-1299330385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-768708c8-91d9-4f9e-845a-baae50959a89 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:29:59 devstack sudo[90064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-768708c8-91d9-4f9e-845a-baae50959a89
Feb 27 01:29:59 devstack sudo[90064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:29:59 devstack sudo[90062]: pam_unix(sudo:session): session closed for user root
Feb 27 01:29:59 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-27368690-be4c-4924-9806-b84b0a554548 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.405s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:29:59 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-27368690-be4c-4924-9806-b84b0a554548 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:29:59 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-27368690-be4c-4924-9806-b84b0a554548 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Deleted volume successfully.
Feb 27 01:29:59 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-27368690-be4c-4924-9806-b84b0a554548 tempest-CreateVolumesFromSourceVolumeTest-509922347 None] Lock "cinder-720861f5-a374-4bea-b602-8c718245139c-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:30:00 devstack sudo[90064]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:00 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0501b661-0b99-49a7-ade8-57465f143980 tempest-VolumesGetTest-1299330385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-768708c8-91d9-4f9e-845a-baae50959a89" returned: 0 in 0.455s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:00 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-0501b661-0b99-49a7-ade8-57465f143980 tempest-VolumesGetTest-1299330385 None] Lock "cinder-quobyte-768708c8-91d9-4f9e-845a-baae50959a89" released by "delete_volume" :: held 1.597s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:30:00 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-0501b661-0b99-49a7-ade8-57465f143980 tempest-VolumesGetTest-1299330385 None] Created reservations ['9e3bdc46-1af7-449d-8e65-f6c17d0e4825', '4f25a9cc-2a4c-4830-bfba-1e4674b3feef', '0650f6c6-726c-4aee-83b9-99d7c161a9b2', '50e58072-195d-4a96-949b-da70690c57c7'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:30:00 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-0501b661-0b99-49a7-ade8-57465f143980 tempest-VolumesGetTest-1299330385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:30:00 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-0501b661-0b99-49a7-ade8-57465f143980 tempest-VolumesGetTest-1299330385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:30:00 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-0501b661-0b99-49a7-ade8-57465f143980 tempest-VolumesGetTest-1299330385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:30:00 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-0501b661-0b99-49a7-ade8-57465f143980 tempest-VolumesGetTest-1299330385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:30:00 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-0501b661-0b99-49a7-ade8-57465f143980 tempest-VolumesGetTest-1299330385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:30:00 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0501b661-0b99-49a7-ade8-57465f143980 tempest-VolumesGetTest-1299330385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:00 devstack sudo[90068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:30:00 devstack sudo[90068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:00 devstack sudo[90068]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:00 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0501b661-0b99-49a7-ade8-57465f143980 tempest-VolumesGetTest-1299330385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.465s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:00 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-0501b661-0b99-49a7-ade8-57465f143980 tempest-VolumesGetTest-1299330385 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:30:00 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-0501b661-0b99-49a7-ade8-57465f143980 tempest-VolumesGetTest-1299330385 None] Deleted volume successfully.
Feb 27 01:30:00 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-0501b661-0b99-49a7-ade8-57465f143980 tempest-VolumesGetTest-1299330385 None] Lock "cinder-768708c8-91d9-4f9e-845a-baae50959a89-delete_volume" released by "delete_volume" :: held 2.217s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:30:03 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-e315844e-ac68-4892-a689-e03ea9b8fd42 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:30:03 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-e315844e-ac68-4892-a689-e03ea9b8fd42 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Flow 'volume_create_manager' (a0297c8b-7ae6-4eb2-87b2-b6652b4eaae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:30:03 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-e315844e-ac68-4892-a689-e03ea9b8fd42 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (629494d6-ad70-4721-bbb6-3bea419b80c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:03 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-e315844e-ac68-4892-a689-e03ea9b8fd42 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (629494d6-ad70-4721-bbb6-3bea419b80c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1333657838',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e602ba9e-6c99-4479-a262-4de2cd8abb79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c117f17334f4fb4903e8a89e7302211',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:30:03Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:30:03Z,use_quota=True,user_id='f70fdc07f93548139e86145e92337562',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:03 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-e315844e-ac68-4892-a689-e03ea9b8fd42 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb61aae1-6c90-4552-8542-36d535f434c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:03 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-e315844e-ac68-4892-a689-e03ea9b8fd42 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb61aae1-6c90-4552-8542-36d535f434c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:03 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-e315844e-ac68-4892-a689-e03ea9b8fd42 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c49fa9ee-884e-46fd-9834-834ba47ce2d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:03 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-e315844e-ac68-4892-a689-e03ea9b8fd42 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c49fa9ee-884e-46fd-9834-834ba47ce2d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e602ba9e-6c99-4479-a262-4de2cd8abb79', 'volume_name': 'volume-e602ba9e-6c99-4479-a262-4de2cd8abb79', 'volume_size': 2}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:03 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-e315844e-ac68-4892-a689-e03ea9b8fd42 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3ac7e0d-c2ac-483a-971e-bb6f818764d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:03 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-e315844e-ac68-4892-a689-e03ea9b8fd42 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3ac7e0d-c2ac-483a-971e-bb6f818764d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:03 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-e315844e-ac68-4892-a689-e03ea9b8fd42 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34fb77cf-b65c-4900-85be-dc5d0f03625d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:03 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-e315844e-ac68-4892-a689-e03ea9b8fd42 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Volume e602ba9e-6c99-4479-a262-4de2cd8abb79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e602ba9e-6c99-4479-a262-4de2cd8abb79', 'volume_size': 2}
Feb 27 01:30:03 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-e315844e-ac68-4892-a689-e03ea9b8fd42 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:30:03 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-e315844e-ac68-4892-a689-e03ea9b8fd42 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:30:03 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-e315844e-ac68-4892-a689-e03ea9b8fd42 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1333657838',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e602ba9e-6c99-4479-a262-4de2cd8abb79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c117f17334f4fb4903e8a89e7302211',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:30:03Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:30:03Z,use_quota=True,user_id='f70fdc07f93548139e86145e92337562',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:30:03 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-e315844e-ac68-4892-a689-e03ea9b8fd42 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Creating volume e602ba9e-6c99-4479-a262-4de2cd8abb79 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:30:03 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-e315844e-ac68-4892-a689-e03ea9b8fd42 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:30:03 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-e315844e-ac68-4892-a689-e03ea9b8fd42 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:30:03 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-e315844e-ac68-4892-a689-e03ea9b8fd42 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:30:03 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-e315844e-ac68-4892-a689-e03ea9b8fd42 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:30:03 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-e315844e-ac68-4892-a689-e03ea9b8fd42 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:30:03 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-e315844e-ac68-4892-a689-e03ea9b8fd42 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:30:03 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-e315844e-ac68-4892-a689-e03ea9b8fd42 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:30:03 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-e315844e-ac68-4892-a689-e03ea9b8fd42 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e602ba9e-6c99-4479-a262-4de2cd8abb79 2147483648 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:03 devstack sudo[90114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e602ba9e-6c99-4479-a262-4de2cd8abb79 2147483648
Feb 27 01:30:03 devstack sudo[90114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:03 devstack sudo[90114]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:03 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-e315844e-ac68-4892-a689-e03ea9b8fd42 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e602ba9e-6c99-4479-a262-4de2cd8abb79 2147483648" returned: 0 in 0.506s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:03 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-e315844e-ac68-4892-a689-e03ea9b8fd42 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e602ba9e-6c99-4479-a262-4de2cd8abb79 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:03 devstack sudo[90119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e602ba9e-6c99-4479-a262-4de2cd8abb79
Feb 27 01:30:03 devstack sudo[90119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:04 devstack sudo[90119]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:04 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-e315844e-ac68-4892-a689-e03ea9b8fd42 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e602ba9e-6c99-4479-a262-4de2cd8abb79" returned: 0 in 0.449s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:04 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-e315844e-ac68-4892-a689-e03ea9b8fd42 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:30:04 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-e315844e-ac68-4892-a689-e03ea9b8fd42 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:30:04 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-e315844e-ac68-4892-a689-e03ea9b8fd42 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34fb77cf-b65c-4900-85be-dc5d0f03625d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e602ba9e-6c99-4479-a262-4de2cd8abb79', 'volume_size': 2}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:04 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-e315844e-ac68-4892-a689-e03ea9b8fd42 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43536030-d0f7-4341-86d0-60858178dd8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:04 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-e315844e-ac68-4892-a689-e03ea9b8fd42 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Volume volume-e602ba9e-6c99-4479-a262-4de2cd8abb79 (e602ba9e-6c99-4479-a262-4de2cd8abb79): created successfully
Feb 27 01:30:04 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-e315844e-ac68-4892-a689-e03ea9b8fd42 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43536030-d0f7-4341-86d0-60858178dd8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:04 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-e315844e-ac68-4892-a689-e03ea9b8fd42 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Flow 'volume_create_manager' (a0297c8b-7ae6-4eb2-87b2-b6652b4eaae1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:30:04 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-e315844e-ac68-4892-a689-e03ea9b8fd42 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Created volume successfully.
Feb 27 01:30:05 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-2979f55a-d260-4b7c-9b3a-ac4f0a2fc1f1 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:30:05 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-2979f55a-d260-4b7c-9b3a-ac4f0a2fc1f1 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:30:05 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-2979f55a-d260-4b7c-9b3a-ac4f0a2fc1f1 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Creating offline snapshot 58d6ea0c-ebe0-4700-ab34-c7e3543b2b20 of volume e602ba9e-6c99-4479-a262-4de2cd8abb79 {{(pid=83106) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:30:05 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda889b5-6dcc-4097-b7d7-acb7d917840f]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:30:05 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-2979f55a-d260-4b7c-9b3a-ac4f0a2fc1f1 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e602ba9e-6c99-4479-a262-4de2cd8abb79 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:05 devstack sudo[90122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e602ba9e-6c99-4479-a262-4de2cd8abb79
Feb 27 01:30:05 devstack sudo[90122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:05 devstack sudo[90122]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:05 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-2979f55a-d260-4b7c-9b3a-ac4f0a2fc1f1 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e602ba9e-6c99-4479-a262-4de2cd8abb79" returned: 0 in 0.474s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:05 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-2979f55a-d260-4b7c-9b3a-ac4f0a2fc1f1 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e602ba9e-6c99-4479-a262-4de2cd8abb79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e602ba9e-6c99-4479-a262-4de2cd8abb79.58d6ea0c-ebe0-4700-ab34-c7e3543b2b20 2G {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:05 devstack sudo[90127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e602ba9e-6c99-4479-a262-4de2cd8abb79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e602ba9e-6c99-4479-a262-4de2cd8abb79.58d6ea0c-ebe0-4700-ab34-c7e3543b2b20 2G
Feb 27 01:30:05 devstack sudo[90127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:06 devstack sudo[90127]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:06 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-2979f55a-d260-4b7c-9b3a-ac4f0a2fc1f1 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e602ba9e-6c99-4479-a262-4de2cd8abb79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e602ba9e-6c99-4479-a262-4de2cd8abb79.58d6ea0c-ebe0-4700-ab34-c7e3543b2b20 2G" returned: 0 in 0.498s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:06 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-2979f55a-d260-4b7c-9b3a-ac4f0a2fc1f1 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e602ba9e-6c99-4479-a262-4de2cd8abb79 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e602ba9e-6c99-4479-a262-4de2cd8abb79.58d6ea0c-ebe0-4700-ab34-c7e3543b2b20 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:06 devstack sudo[90132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e602ba9e-6c99-4479-a262-4de2cd8abb79 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e602ba9e-6c99-4479-a262-4de2cd8abb79.58d6ea0c-ebe0-4700-ab34-c7e3543b2b20
Feb 27 01:30:06 devstack sudo[90132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:06 devstack sudo[90132]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:06 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-2979f55a-d260-4b7c-9b3a-ac4f0a2fc1f1 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e602ba9e-6c99-4479-a262-4de2cd8abb79 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e602ba9e-6c99-4479-a262-4de2cd8abb79.58d6ea0c-ebe0-4700-ab34-c7e3543b2b20" returned: 0 in 0.485s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:06 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-2979f55a-d260-4b7c-9b3a-ac4f0a2fc1f1 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e602ba9e-6c99-4479-a262-4de2cd8abb79.58d6ea0c-ebe0-4700-ab34-c7e3543b2b20 is being set with open permissions: ugo+rw
Feb 27 01:30:06 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-2979f55a-d260-4b7c-9b3a-ac4f0a2fc1f1 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e602ba9e-6c99-4479-a262-4de2cd8abb79.58d6ea0c-ebe0-4700-ab34-c7e3543b2b20 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:06 devstack sudo[90137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e602ba9e-6c99-4479-a262-4de2cd8abb79.58d6ea0c-ebe0-4700-ab34-c7e3543b2b20
Feb 27 01:30:06 devstack sudo[90137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:07 devstack sudo[90137]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:07 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-2979f55a-d260-4b7c-9b3a-ac4f0a2fc1f1 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e602ba9e-6c99-4479-a262-4de2cd8abb79.58d6ea0c-ebe0-4700-ab34-c7e3543b2b20" returned: 0 in 0.412s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:07 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-2979f55a-d260-4b7c-9b3a-ac4f0a2fc1f1 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e602ba9e-6c99-4479-a262-4de2cd8abb79.info {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:07 devstack sudo[90140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e602ba9e-6c99-4479-a262-4de2cd8abb79.info
Feb 27 01:30:07 devstack sudo[90140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:07 devstack sudo[90140]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:07 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-2979f55a-d260-4b7c-9b3a-ac4f0a2fc1f1 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e602ba9e-6c99-4479-a262-4de2cd8abb79.info" returned: 0 in 0.429s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:07 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-2979f55a-d260-4b7c-9b3a-ac4f0a2fc1f1 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e602ba9e-6c99-4479-a262-4de2cd8abb79.info is being set with open permissions: ugo+rw
Feb 27 01:30:07 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-2979f55a-d260-4b7c-9b3a-ac4f0a2fc1f1 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e602ba9e-6c99-4479-a262-4de2cd8abb79.info {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:07 devstack sudo[90143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e602ba9e-6c99-4479-a262-4de2cd8abb79.info
Feb 27 01:30:07 devstack sudo[90143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:08 devstack sudo[90143]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:08 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-2979f55a-d260-4b7c-9b3a-ac4f0a2fc1f1 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e602ba9e-6c99-4479-a262-4de2cd8abb79.info" returned: 0 in 0.463s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:08 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-2979f55a-d260-4b7c-9b3a-ac4f0a2fc1f1 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.835s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:30:08 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-2979f55a-d260-4b7c-9b3a-ac4f0a2fc1f1 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Create snapshot completed successfully
Feb 27 01:30:08 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-8ba21a7c-40e7-4c19-a73a-e113b0c1e7ea tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Acquiring lock "cinder-58d6ea0c-ebe0-4700-ab34-c7e3543b2b20-delete_snapshot" by "delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:30:08 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-8ba21a7c-40e7-4c19-a73a-e113b0c1e7ea tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Lock "cinder-58d6ea0c-ebe0-4700-ab34-c7e3543b2b20-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:30:08 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-8ba21a7c-40e7-4c19-a73a-e113b0c1e7ea tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Acquiring lock "cinder-quobyte-e602ba9e-6c99-4479-a262-4de2cd8abb79" by "delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:30:08 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-8ba21a7c-40e7-4c19-a73a-e113b0c1e7ea tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Lock "cinder-quobyte-e602ba9e-6c99-4479-a262-4de2cd8abb79" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:30:08 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-8ba21a7c-40e7-4c19-a73a-e113b0c1e7ea tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Acquiring lock "cinder-quobyte-58d6ea0c-ebe0-4700-ab34-c7e3543b2b20" by "_delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:30:08 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-8ba21a7c-40e7-4c19-a73a-e113b0c1e7ea tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Lock "cinder-quobyte-58d6ea0c-ebe0-4700-ab34-c7e3543b2b20" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:30:08 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-8ba21a7c-40e7-4c19-a73a-e113b0c1e7ea tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Deleting offline snapshot 58d6ea0c-ebe0-4700-ab34-c7e3543b2b20 of volume e602ba9e-6c99-4479-a262-4de2cd8abb79 {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:30:08 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-8ba21a7c-40e7-4c19-a73a-e113b0c1e7ea tempest-VolumesSnapshotNegativeTestJSON-784809319 None] snapshot_file for this snap is: volume-e602ba9e-6c99-4479-a262-4de2cd8abb79.58d6ea0c-ebe0-4700-ab34-c7e3543b2b20 {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:30:08 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3442646-5c25-427d-be7d-872932d45406]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:30:08 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-8ba21a7c-40e7-4c19-a73a-e113b0c1e7ea tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e602ba9e-6c99-4479-a262-4de2cd8abb79.58d6ea0c-ebe0-4700-ab34-c7e3543b2b20 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:08 devstack sudo[90146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e602ba9e-6c99-4479-a262-4de2cd8abb79.58d6ea0c-ebe0-4700-ab34-c7e3543b2b20
Feb 27 01:30:08 devstack sudo[90146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:09 devstack sudo[90146]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:09 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-8ba21a7c-40e7-4c19-a73a-e113b0c1e7ea tempest-VolumesSnapshotNegativeTestJSON-784809319 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e602ba9e-6c99-4479-a262-4de2cd8abb79.58d6ea0c-ebe0-4700-ab34-c7e3543b2b20" returned: 0 in 0.636s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:09 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-8ba21a7c-40e7-4c19-a73a-e113b0c1e7ea tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e602ba9e-6c99-4479-a262-4de2cd8abb79(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83106) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:30:09 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[500971ab-2678-459b-a239-5add8d5dc72e]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:30:09 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-8ba21a7c-40e7-4c19-a73a-e113b0c1e7ea tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e602ba9e-6c99-4479-a262-4de2cd8abb79 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:09 devstack sudo[90151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e602ba9e-6c99-4479-a262-4de2cd8abb79
Feb 27 01:30:09 devstack sudo[90151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:09 devstack sudo[90151]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:09 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-8ba21a7c-40e7-4c19-a73a-e113b0c1e7ea tempest-VolumesSnapshotNegativeTestJSON-784809319 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e602ba9e-6c99-4479-a262-4de2cd8abb79" returned: 0 in 0.502s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:09 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-8ba21a7c-40e7-4c19-a73a-e113b0c1e7ea tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e602ba9e-6c99-4479-a262-4de2cd8abb79.58d6ea0c-ebe0-4700-ab34-c7e3543b2b20 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:09 devstack sudo[90156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e602ba9e-6c99-4479-a262-4de2cd8abb79.58d6ea0c-ebe0-4700-ab34-c7e3543b2b20
Feb 27 01:30:09 devstack sudo[90156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:10 devstack sudo[90156]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:10 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-8ba21a7c-40e7-4c19-a73a-e113b0c1e7ea tempest-VolumesSnapshotNegativeTestJSON-784809319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e602ba9e-6c99-4479-a262-4de2cd8abb79.58d6ea0c-ebe0-4700-ab34-c7e3543b2b20" returned: 0 in 0.492s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:10 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-8ba21a7c-40e7-4c19-a73a-e113b0c1e7ea tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e602ba9e-6c99-4479-a262-4de2cd8abb79.58d6ea0c-ebe0-4700-ab34-c7e3543b2b20 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:10 devstack sudo[90161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e602ba9e-6c99-4479-a262-4de2cd8abb79.58d6ea0c-ebe0-4700-ab34-c7e3543b2b20
Feb 27 01:30:10 devstack sudo[90161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:10 devstack sudo[90161]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:10 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-8ba21a7c-40e7-4c19-a73a-e113b0c1e7ea tempest-VolumesSnapshotNegativeTestJSON-784809319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e602ba9e-6c99-4479-a262-4de2cd8abb79.58d6ea0c-ebe0-4700-ab34-c7e3543b2b20" returned: 0 in 0.410s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:10 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-8ba21a7c-40e7-4c19-a73a-e113b0c1e7ea tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Lock "cinder-quobyte-58d6ea0c-ebe0-4700-ab34-c7e3543b2b20" released by "_delete_snapshot" :: held 2.103s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:30:10 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-8ba21a7c-40e7-4c19-a73a-e113b0c1e7ea tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Lock "cinder-quobyte-e602ba9e-6c99-4479-a262-4de2cd8abb79" released by "delete_snapshot" :: held 2.118s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:30:10 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-8ba21a7c-40e7-4c19-a73a-e113b0c1e7ea tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Created reservations ['f927419c-d6c7-4d61-baf0-b015d5c7076e', 'd6d2ce1a-6eec-4057-8161-df015aa6b6aa', '66112367-3ee2-41f1-b97a-8b9f9a4608d3', '05cf5a7b-0432-4b5e-8223-be8fcc85e2e6'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:30:10 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-8ba21a7c-40e7-4c19-a73a-e113b0c1e7ea tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Delete snapshot completed successfully.
Feb 27 01:30:10 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-8ba21a7c-40e7-4c19-a73a-e113b0c1e7ea tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Lock "cinder-58d6ea0c-ebe0-4700-ab34-c7e3543b2b20-delete_snapshot" released by "delete_snapshot" :: held 2.204s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:30:11 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-4e001f30-6f83-4329-8b42-e9675d0c55f0 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Acquiring lock "cinder-e602ba9e-6c99-4479-a262-4de2cd8abb79-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:30:11 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-4e001f30-6f83-4329-8b42-e9675d0c55f0 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Lock "cinder-e602ba9e-6c99-4479-a262-4de2cd8abb79-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:30:11 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-4e001f30-6f83-4329-8b42-e9675d0c55f0 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Acquiring lock "cinder-quobyte-e602ba9e-6c99-4479-a262-4de2cd8abb79" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:30:11 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-4e001f30-6f83-4329-8b42-e9675d0c55f0 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Lock "cinder-quobyte-e602ba9e-6c99-4479-a262-4de2cd8abb79" acquired by "delete_volume" :: waited 0.008s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:30:11 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2eb8fe-e2e8-496c-ae21-54b254c8bc16]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:30:11 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-4e001f30-6f83-4329-8b42-e9675d0c55f0 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e602ba9e-6c99-4479-a262-4de2cd8abb79 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:11 devstack sudo[90164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e602ba9e-6c99-4479-a262-4de2cd8abb79
Feb 27 01:30:11 devstack sudo[90164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:12 devstack sudo[90164]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:12 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-4e001f30-6f83-4329-8b42-e9675d0c55f0 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e602ba9e-6c99-4479-a262-4de2cd8abb79" returned: 0 in 0.467s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:12 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-4e001f30-6f83-4329-8b42-e9675d0c55f0 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e602ba9e-6c99-4479-a262-4de2cd8abb79 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:12 devstack sudo[90169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e602ba9e-6c99-4479-a262-4de2cd8abb79
Feb 27 01:30:12 devstack sudo[90169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:12 devstack sudo[90169]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:12 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-4e001f30-6f83-4329-8b42-e9675d0c55f0 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e602ba9e-6c99-4479-a262-4de2cd8abb79" returned: 0 in 0.396s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:12 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-4e001f30-6f83-4329-8b42-e9675d0c55f0 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Lock "cinder-quobyte-e602ba9e-6c99-4479-a262-4de2cd8abb79" released by "delete_volume" :: held 0.900s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:30:12 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-4e001f30-6f83-4329-8b42-e9675d0c55f0 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Created reservations ['392f4412-d1ea-442f-9a73-582735925d7c', 'e377df24-1415-4905-b65d-b70ae689f81e', '118beb79-e9bb-479f-aaf0-bb2e7ebd2fcf', '065da501-a43c-4be1-9fd1-4fd166aace15'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:30:12 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-4e001f30-6f83-4329-8b42-e9675d0c55f0 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:30:12 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-4e001f30-6f83-4329-8b42-e9675d0c55f0 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:30:12 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-4e001f30-6f83-4329-8b42-e9675d0c55f0 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:30:12 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-4e001f30-6f83-4329-8b42-e9675d0c55f0 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:30:12 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-4e001f30-6f83-4329-8b42-e9675d0c55f0 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:30:12 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-4e001f30-6f83-4329-8b42-e9675d0c55f0 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:12 devstack sudo[90172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:30:12 devstack sudo[90172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:13 devstack sudo[90172]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:13 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-4e001f30-6f83-4329-8b42-e9675d0c55f0 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.472s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:13 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-4e001f30-6f83-4329-8b42-e9675d0c55f0 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:30:13 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-4e001f30-6f83-4329-8b42-e9675d0c55f0 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Deleted volume successfully.
Feb 27 01:30:13 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-4e001f30-6f83-4329-8b42-e9675d0c55f0 tempest-VolumesSnapshotNegativeTestJSON-784809319 None] Lock "cinder-e602ba9e-6c99-4479-a262-4de2cd8abb79-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:30:14 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-d95ac468-b7d9-4047-b422-66de560565b8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:30:14 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d95ac468-b7d9-4047-b422-66de560565b8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Flow 'volume_create_manager' (ca8ab10f-f61b-4690-9524-3354c46005d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:30:14 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d95ac468-b7d9-4047-b422-66de560565b8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4199a772-640b-4490-b598-53f48adc8f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:14 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d95ac468-b7d9-4047-b422-66de560565b8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4199a772-640b-4490-b598-53f48adc8f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:30:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-761036892',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eeb33ba-b7e1-45c6-ab0a-6402221d2e31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fe984a9789846fcb07248fd9f234380',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:30:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:30:15Z,use_quota=True,user_id='4dd65638b3d24ca4bbb5d27cdfa56167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:14 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d95ac468-b7d9-4047-b422-66de560565b8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4a2d0b4-d1f6-4b4d-a850-41184336c403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:14 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d95ac468-b7d9-4047-b422-66de560565b8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4a2d0b4-d1f6-4b4d-a850-41184336c403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:14 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d95ac468-b7d9-4047-b422-66de560565b8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14602831-a756-4f89-9bb4-e607202910f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:14 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d95ac468-b7d9-4047-b422-66de560565b8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14602831-a756-4f89-9bb4-e607202910f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5eeb33ba-b7e1-45c6-ab0a-6402221d2e31', 'volume_name': 'volume-5eeb33ba-b7e1-45c6-ab0a-6402221d2e31', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:14 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d95ac468-b7d9-4047-b422-66de560565b8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (303813dc-35dc-42c8-837a-4926772412fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:14 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d95ac468-b7d9-4047-b422-66de560565b8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (303813dc-35dc-42c8-837a-4926772412fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:14 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d95ac468-b7d9-4047-b422-66de560565b8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b870ec2c-2b47-433a-883a-28530b4f8cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:14 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-d95ac468-b7d9-4047-b422-66de560565b8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Volume 5eeb33ba-b7e1-45c6-ab0a-6402221d2e31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5eeb33ba-b7e1-45c6-ab0a-6402221d2e31', 'volume_size': 1}
Feb 27 01:30:14 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-d95ac468-b7d9-4047-b422-66de560565b8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:30:14 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-d95ac468-b7d9-4047-b422-66de560565b8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:30:14 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-d95ac468-b7d9-4047-b422-66de560565b8 tempest-CreateVolumesFromSnapshotTest-331979769 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:30:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-761036892',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eeb33ba-b7e1-45c6-ab0a-6402221d2e31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fe984a9789846fcb07248fd9f234380',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:30:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:30:15Z,use_quota=True,user_id='4dd65638b3d24ca4bbb5d27cdfa56167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:30:14 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-d95ac468-b7d9-4047-b422-66de560565b8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Creating volume 5eeb33ba-b7e1-45c6-ab0a-6402221d2e31 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:30:14 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-d95ac468-b7d9-4047-b422-66de560565b8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:30:14 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-d95ac468-b7d9-4047-b422-66de560565b8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:30:14 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-d95ac468-b7d9-4047-b422-66de560565b8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:30:14 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-d95ac468-b7d9-4047-b422-66de560565b8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:30:14 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-d95ac468-b7d9-4047-b422-66de560565b8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:30:14 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-d95ac468-b7d9-4047-b422-66de560565b8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:30:14 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-d95ac468-b7d9-4047-b422-66de560565b8 tempest-CreateVolumesFromSnapshotTest-331979769 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:30:14 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d95ac468-b7d9-4047-b422-66de560565b8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5eeb33ba-b7e1-45c6-ab0a-6402221d2e31 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:14 devstack sudo[90176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5eeb33ba-b7e1-45c6-ab0a-6402221d2e31 1073741824
Feb 27 01:30:14 devstack sudo[90176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:15 devstack sudo[90176]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:15 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d95ac468-b7d9-4047-b422-66de560565b8 tempest-CreateVolumesFromSnapshotTest-331979769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5eeb33ba-b7e1-45c6-ab0a-6402221d2e31 1073741824" returned: 0 in 0.527s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:15 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d95ac468-b7d9-4047-b422-66de560565b8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5eeb33ba-b7e1-45c6-ab0a-6402221d2e31 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:15 devstack sudo[90181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5eeb33ba-b7e1-45c6-ab0a-6402221d2e31
Feb 27 01:30:15 devstack sudo[90181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:15 devstack sudo[90181]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:15 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d95ac468-b7d9-4047-b422-66de560565b8 tempest-CreateVolumesFromSnapshotTest-331979769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5eeb33ba-b7e1-45c6-ab0a-6402221d2e31" returned: 0 in 0.482s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:15 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-d95ac468-b7d9-4047-b422-66de560565b8 tempest-CreateVolumesFromSnapshotTest-331979769 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:30:15 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-d95ac468-b7d9-4047-b422-66de560565b8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:30:15 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d95ac468-b7d9-4047-b422-66de560565b8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b870ec2c-2b47-433a-883a-28530b4f8cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5eeb33ba-b7e1-45c6-ab0a-6402221d2e31', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:15 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d95ac468-b7d9-4047-b422-66de560565b8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00b08e76-cbfe-4ffa-b28f-15ae6e7fb6bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:15 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-d95ac468-b7d9-4047-b422-66de560565b8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Volume volume-5eeb33ba-b7e1-45c6-ab0a-6402221d2e31 (5eeb33ba-b7e1-45c6-ab0a-6402221d2e31): created successfully
Feb 27 01:30:15 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d95ac468-b7d9-4047-b422-66de560565b8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00b08e76-cbfe-4ffa-b28f-15ae6e7fb6bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:15 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d95ac468-b7d9-4047-b422-66de560565b8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Flow 'volume_create_manager' (ca8ab10f-f61b-4690-9524-3354c46005d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:30:15 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-d95ac468-b7d9-4047-b422-66de560565b8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Created volume successfully.
Feb 27 01:30:16 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-74310762-e7c0-4427-a30f-d50d46464e1e tempest-CreateVolumesFromSnapshotTest-331979769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:30:16 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-74310762-e7c0-4427-a30f-d50d46464e1e tempest-CreateVolumesFromSnapshotTest-331979769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:30:16 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-74310762-e7c0-4427-a30f-d50d46464e1e tempest-CreateVolumesFromSnapshotTest-331979769 None] Creating offline snapshot c22e2b59-d0b2-44af-8e9c-f6487f03efc1 of volume 5eeb33ba-b7e1-45c6-ab0a-6402221d2e31 {{(pid=83106) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:30:16 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab768e1-53c7-401d-9a00-078653ad6029]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:30:16 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-74310762-e7c0-4427-a30f-d50d46464e1e tempest-CreateVolumesFromSnapshotTest-331979769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5eeb33ba-b7e1-45c6-ab0a-6402221d2e31 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:17 devstack sudo[90184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5eeb33ba-b7e1-45c6-ab0a-6402221d2e31
Feb 27 01:30:17 devstack sudo[90184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:17 devstack sudo[90184]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:17 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-74310762-e7c0-4427-a30f-d50d46464e1e tempest-CreateVolumesFromSnapshotTest-331979769 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5eeb33ba-b7e1-45c6-ab0a-6402221d2e31" returned: 0 in 0.455s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:17 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-74310762-e7c0-4427-a30f-d50d46464e1e tempest-CreateVolumesFromSnapshotTest-331979769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5eeb33ba-b7e1-45c6-ab0a-6402221d2e31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5eeb33ba-b7e1-45c6-ab0a-6402221d2e31.c22e2b59-d0b2-44af-8e9c-f6487f03efc1 1G {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:17 devstack sudo[90189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5eeb33ba-b7e1-45c6-ab0a-6402221d2e31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5eeb33ba-b7e1-45c6-ab0a-6402221d2e31.c22e2b59-d0b2-44af-8e9c-f6487f03efc1 1G
Feb 27 01:30:17 devstack sudo[90189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:17 devstack sudo[90189]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:17 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-74310762-e7c0-4427-a30f-d50d46464e1e tempest-CreateVolumesFromSnapshotTest-331979769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5eeb33ba-b7e1-45c6-ab0a-6402221d2e31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5eeb33ba-b7e1-45c6-ab0a-6402221d2e31.c22e2b59-d0b2-44af-8e9c-f6487f03efc1 1G" returned: 0 in 0.442s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:17 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-74310762-e7c0-4427-a30f-d50d46464e1e tempest-CreateVolumesFromSnapshotTest-331979769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5eeb33ba-b7e1-45c6-ab0a-6402221d2e31 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5eeb33ba-b7e1-45c6-ab0a-6402221d2e31.c22e2b59-d0b2-44af-8e9c-f6487f03efc1 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:17 devstack sudo[90194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5eeb33ba-b7e1-45c6-ab0a-6402221d2e31 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5eeb33ba-b7e1-45c6-ab0a-6402221d2e31.c22e2b59-d0b2-44af-8e9c-f6487f03efc1
Feb 27 01:30:17 devstack sudo[90194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:18 devstack sudo[90194]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:18 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-74310762-e7c0-4427-a30f-d50d46464e1e tempest-CreateVolumesFromSnapshotTest-331979769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5eeb33ba-b7e1-45c6-ab0a-6402221d2e31 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5eeb33ba-b7e1-45c6-ab0a-6402221d2e31.c22e2b59-d0b2-44af-8e9c-f6487f03efc1" returned: 0 in 0.408s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:18 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-74310762-e7c0-4427-a30f-d50d46464e1e tempest-CreateVolumesFromSnapshotTest-331979769 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5eeb33ba-b7e1-45c6-ab0a-6402221d2e31.c22e2b59-d0b2-44af-8e9c-f6487f03efc1 is being set with open permissions: ugo+rw
Feb 27 01:30:18 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-74310762-e7c0-4427-a30f-d50d46464e1e tempest-CreateVolumesFromSnapshotTest-331979769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5eeb33ba-b7e1-45c6-ab0a-6402221d2e31.c22e2b59-d0b2-44af-8e9c-f6487f03efc1 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:18 devstack sudo[90199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5eeb33ba-b7e1-45c6-ab0a-6402221d2e31.c22e2b59-d0b2-44af-8e9c-f6487f03efc1
Feb 27 01:30:18 devstack sudo[90199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:18 devstack sudo[90199]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:18 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-74310762-e7c0-4427-a30f-d50d46464e1e tempest-CreateVolumesFromSnapshotTest-331979769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5eeb33ba-b7e1-45c6-ab0a-6402221d2e31.c22e2b59-d0b2-44af-8e9c-f6487f03efc1" returned: 0 in 0.393s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:18 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-74310762-e7c0-4427-a30f-d50d46464e1e tempest-CreateVolumesFromSnapshotTest-331979769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5eeb33ba-b7e1-45c6-ab0a-6402221d2e31.info {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:18 devstack sudo[90202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5eeb33ba-b7e1-45c6-ab0a-6402221d2e31.info
Feb 27 01:30:18 devstack sudo[90202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:19 devstack sudo[90202]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:19 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-74310762-e7c0-4427-a30f-d50d46464e1e tempest-CreateVolumesFromSnapshotTest-331979769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5eeb33ba-b7e1-45c6-ab0a-6402221d2e31.info" returned: 0 in 0.399s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:19 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-74310762-e7c0-4427-a30f-d50d46464e1e tempest-CreateVolumesFromSnapshotTest-331979769 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5eeb33ba-b7e1-45c6-ab0a-6402221d2e31.info is being set with open permissions: ugo+rw
Feb 27 01:30:19 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-74310762-e7c0-4427-a30f-d50d46464e1e tempest-CreateVolumesFromSnapshotTest-331979769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5eeb33ba-b7e1-45c6-ab0a-6402221d2e31.info {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:19 devstack sudo[90205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5eeb33ba-b7e1-45c6-ab0a-6402221d2e31.info
Feb 27 01:30:19 devstack sudo[90205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:19 devstack sudo[90205]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:19 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-74310762-e7c0-4427-a30f-d50d46464e1e tempest-CreateVolumesFromSnapshotTest-331979769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5eeb33ba-b7e1-45c6-ab0a-6402221d2e31.info" returned: 0 in 0.397s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:19 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-74310762-e7c0-4427-a30f-d50d46464e1e tempest-CreateVolumesFromSnapshotTest-331979769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.563s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:30:19 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-74310762-e7c0-4427-a30f-d50d46464e1e tempest-CreateVolumesFromSnapshotTest-331979769 None] Create snapshot completed successfully
Feb 27 01:30:20 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddfacffe-31d4-410f-9357-48675569cb07 tempest-CreateVolumesFromSnapshotTest-331979769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:30:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-ddfacffe-31d4-410f-9357-48675569cb07 tempest-CreateVolumesFromSnapshotTest-331979769 None] Flow 'volume_create_manager' (14c79666-a88f-449d-abef-c68229518215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:30:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-ddfacffe-31d4-410f-9357-48675569cb07 tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24ef79ef-c9a6-47ec-a877-6cf1131c8990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-ddfacffe-31d4-410f-9357-48675569cb07 tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24ef79ef-c9a6-47ec-a877-6cf1131c8990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:30:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-310349745',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61b56db3-4e73-4755-8080-92f7c2e2d12b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fe984a9789846fcb07248fd9f234380',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:30:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:30:20Z,use_quota=True,user_id='4dd65638b3d24ca4bbb5d27cdfa56167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-ddfacffe-31d4-410f-9357-48675569cb07 tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f9330a8-ff55-4db6-a5cb-4d2798b8aab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-ddfacffe-31d4-410f-9357-48675569cb07 tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f9330a8-ff55-4db6-a5cb-4d2798b8aab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-ddfacffe-31d4-410f-9357-48675569cb07 tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3027b7a-e31b-4b54-8da3-ccd57020d3f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-ddfacffe-31d4-410f-9357-48675569cb07 tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3027b7a-e31b-4b54-8da3-ccd57020d3f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61b56db3-4e73-4755-8080-92f7c2e2d12b', 'volume_name': 'volume-61b56db3-4e73-4755-8080-92f7c2e2d12b', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-ddfacffe-31d4-410f-9357-48675569cb07 tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8381629a-3472-4cd9-843a-7f7ca341b9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-ddfacffe-31d4-410f-9357-48675569cb07 tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8381629a-3472-4cd9-843a-7f7ca341b9f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-ddfacffe-31d4-410f-9357-48675569cb07 tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df9d9ce5-24b4-4eae-a4fe-fae9a43915fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:20 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-ddfacffe-31d4-410f-9357-48675569cb07 tempest-CreateVolumesFromSnapshotTest-331979769 None] Volume 61b56db3-4e73-4755-8080-92f7c2e2d12b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61b56db3-4e73-4755-8080-92f7c2e2d12b', 'volume_size': 1}
Feb 27 01:30:20 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-ddfacffe-31d4-410f-9357-48675569cb07 tempest-CreateVolumesFromSnapshotTest-331979769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:30:20 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-ddfacffe-31d4-410f-9357-48675569cb07 tempest-CreateVolumesFromSnapshotTest-331979769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:30:20 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-ddfacffe-31d4-410f-9357-48675569cb07 tempest-CreateVolumesFromSnapshotTest-331979769 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:30:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-310349745',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61b56db3-4e73-4755-8080-92f7c2e2d12b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fe984a9789846fcb07248fd9f234380',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:30:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:30:20Z,use_quota=True,user_id='4dd65638b3d24ca4bbb5d27cdfa56167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:30:20 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-ddfacffe-31d4-410f-9357-48675569cb07 tempest-CreateVolumesFromSnapshotTest-331979769 None] Creating volume 61b56db3-4e73-4755-8080-92f7c2e2d12b {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:30:20 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-ddfacffe-31d4-410f-9357-48675569cb07 tempest-CreateVolumesFromSnapshotTest-331979769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:30:20 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-ddfacffe-31d4-410f-9357-48675569cb07 tempest-CreateVolumesFromSnapshotTest-331979769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:30:20 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-ddfacffe-31d4-410f-9357-48675569cb07 tempest-CreateVolumesFromSnapshotTest-331979769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:30:20 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-ddfacffe-31d4-410f-9357-48675569cb07 tempest-CreateVolumesFromSnapshotTest-331979769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:30:20 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-ddfacffe-31d4-410f-9357-48675569cb07 tempest-CreateVolumesFromSnapshotTest-331979769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:30:20 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-ddfacffe-31d4-410f-9357-48675569cb07 tempest-CreateVolumesFromSnapshotTest-331979769 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:30:20 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-ddfacffe-31d4-410f-9357-48675569cb07 tempest-CreateVolumesFromSnapshotTest-331979769 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:30:20 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ddfacffe-31d4-410f-9357-48675569cb07 tempest-CreateVolumesFromSnapshotTest-331979769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-61b56db3-4e73-4755-8080-92f7c2e2d12b 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:20 devstack sudo[90208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-61b56db3-4e73-4755-8080-92f7c2e2d12b 1073741824
Feb 27 01:30:20 devstack sudo[90208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:20 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-4afbc110-1298-49e4-98b1-d25b7ca47592 tempest-CreateVolumesFromSnapshotTest-331979769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:30:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-4afbc110-1298-49e4-98b1-d25b7ca47592 tempest-CreateVolumesFromSnapshotTest-331979769 None] Flow 'volume_create_manager' (87b37493-d733-495f-a142-14af3e60606c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:30:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-4afbc110-1298-49e4-98b1-d25b7ca47592 tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68b4ae6c-f81c-4403-9470-3abfa6b0fb87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-4afbc110-1298-49e4-98b1-d25b7ca47592 tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68b4ae6c-f81c-4403-9470-3abfa6b0fb87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:30:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-358815371',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fa067bf-98e2-4cfd-be82-1e63d11c3e29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fe984a9789846fcb07248fd9f234380',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:30:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:30:20Z,use_quota=True,user_id='4dd65638b3d24ca4bbb5d27cdfa56167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-4afbc110-1298-49e4-98b1-d25b7ca47592 tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4ff2ff2-e95d-4e79-baf6-1f3cfadca368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-4afbc110-1298-49e4-98b1-d25b7ca47592 tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4ff2ff2-e95d-4e79-baf6-1f3cfadca368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-4afbc110-1298-49e4-98b1-d25b7ca47592 tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1f7e95d-afdc-4921-a779-ea64085d942d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-4afbc110-1298-49e4-98b1-d25b7ca47592 tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1f7e95d-afdc-4921-a779-ea64085d942d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fa067bf-98e2-4cfd-be82-1e63d11c3e29', 'volume_name': 'volume-3fa067bf-98e2-4cfd-be82-1e63d11c3e29', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-4afbc110-1298-49e4-98b1-d25b7ca47592 tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20fd1103-5217-466b-8db7-8bd4820b8128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-4afbc110-1298-49e4-98b1-d25b7ca47592 tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20fd1103-5217-466b-8db7-8bd4820b8128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-4afbc110-1298-49e4-98b1-d25b7ca47592 tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (033f36a8-e7ea-49a8-aae0-057fede725b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:20 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-4afbc110-1298-49e4-98b1-d25b7ca47592 tempest-CreateVolumesFromSnapshotTest-331979769 None] Volume 3fa067bf-98e2-4cfd-be82-1e63d11c3e29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fa067bf-98e2-4cfd-be82-1e63d11c3e29', 'volume_size': 1}
Feb 27 01:30:20 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-4afbc110-1298-49e4-98b1-d25b7ca47592 tempest-CreateVolumesFromSnapshotTest-331979769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:30:20 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-95230f8d-e5ed-4538-ac25-1a77051be28b tempest-CreateVolumesFromSnapshotTest-331979769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:30:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-95230f8d-e5ed-4538-ac25-1a77051be28b tempest-CreateVolumesFromSnapshotTest-331979769 None] Flow 'volume_create_manager' (9e7c8dff-6b4d-429f-acd5-e5985df49740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:30:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-95230f8d-e5ed-4538-ac25-1a77051be28b tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d843e6da-9203-4600-bac7-83ce25d85b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-95230f8d-e5ed-4538-ac25-1a77051be28b tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d843e6da-9203-4600-bac7-83ce25d85b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:30:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2045926889',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c098b15-9149-4f57-bac8-696fd6c2434a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fe984a9789846fcb07248fd9f234380',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:30:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:30:21Z,use_quota=True,user_id='4dd65638b3d24ca4bbb5d27cdfa56167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-95230f8d-e5ed-4538-ac25-1a77051be28b tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66f94e11-27f1-4906-837f-da892238d854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-95230f8d-e5ed-4538-ac25-1a77051be28b tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66f94e11-27f1-4906-837f-da892238d854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-95230f8d-e5ed-4538-ac25-1a77051be28b tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f0b0fc5-3976-4a91-b32e-0870b78af10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-95230f8d-e5ed-4538-ac25-1a77051be28b tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f0b0fc5-3976-4a91-b32e-0870b78af10f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c098b15-9149-4f57-bac8-696fd6c2434a', 'volume_name': 'volume-4c098b15-9149-4f57-bac8-696fd6c2434a', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-95230f8d-e5ed-4538-ac25-1a77051be28b tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dea78e5c-2285-4b8f-9cbc-d6f06adb2d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-95230f8d-e5ed-4538-ac25-1a77051be28b tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dea78e5c-2285-4b8f-9cbc-d6f06adb2d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-95230f8d-e5ed-4538-ac25-1a77051be28b tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b038af41-32bd-41a6-9ab9-fe808b51ab2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:20 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-95230f8d-e5ed-4538-ac25-1a77051be28b tempest-CreateVolumesFromSnapshotTest-331979769 None] Volume 4c098b15-9149-4f57-bac8-696fd6c2434a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c098b15-9149-4f57-bac8-696fd6c2434a', 'volume_size': 1}
Feb 27 01:30:20 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-95230f8d-e5ed-4538-ac25-1a77051be28b tempest-CreateVolumesFromSnapshotTest-331979769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:30:20 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b63f606-f160-4b5a-9a51-3e2d36804cb8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:30:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-6b63f606-f160-4b5a-9a51-3e2d36804cb8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Flow 'volume_create_manager' (b302734f-f3bb-4034-bc4b-8356fa548c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:30:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-6b63f606-f160-4b5a-9a51-3e2d36804cb8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (150d3470-5baa-4f8f-9678-12cb85c1d15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-6b63f606-f160-4b5a-9a51-3e2d36804cb8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (150d3470-5baa-4f8f-9678-12cb85c1d15b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:30:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-559311339',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd4478fd-cc72-4cb9-85ac-0fff9dc580f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fe984a9789846fcb07248fd9f234380',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:30:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:30:21Z,use_quota=True,user_id='4dd65638b3d24ca4bbb5d27cdfa56167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-6b63f606-f160-4b5a-9a51-3e2d36804cb8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4156539-aac9-4d9d-abe8-db679609b9d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-6b63f606-f160-4b5a-9a51-3e2d36804cb8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4156539-aac9-4d9d-abe8-db679609b9d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-6b63f606-f160-4b5a-9a51-3e2d36804cb8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac05a796-169f-4517-a4cf-0ca664d5d12f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-6b63f606-f160-4b5a-9a51-3e2d36804cb8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac05a796-169f-4517-a4cf-0ca664d5d12f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd4478fd-cc72-4cb9-85ac-0fff9dc580f1', 'volume_name': 'volume-dd4478fd-cc72-4cb9-85ac-0fff9dc580f1', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-6b63f606-f160-4b5a-9a51-3e2d36804cb8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0fae20e-6410-41da-98bb-2df17c62d78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-6b63f606-f160-4b5a-9a51-3e2d36804cb8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0fae20e-6410-41da-98bb-2df17c62d78f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:20 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-6b63f606-f160-4b5a-9a51-3e2d36804cb8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a5a2acf-d3a4-48fa-af8e-70cafdcfd6af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:20 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-6b63f606-f160-4b5a-9a51-3e2d36804cb8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Volume dd4478fd-cc72-4cb9-85ac-0fff9dc580f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd4478fd-cc72-4cb9-85ac-0fff9dc580f1', 'volume_size': 1}
Feb 27 01:30:20 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-6b63f606-f160-4b5a-9a51-3e2d36804cb8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:30:21 devstack sudo[90208]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:21 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ddfacffe-31d4-410f-9357-48675569cb07 tempest-CreateVolumesFromSnapshotTest-331979769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-61b56db3-4e73-4755-8080-92f7c2e2d12b 1073741824" returned: 0 in 0.640s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:21 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ddfacffe-31d4-410f-9357-48675569cb07 tempest-CreateVolumesFromSnapshotTest-331979769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-61b56db3-4e73-4755-8080-92f7c2e2d12b {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:21 devstack sudo[90213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-61b56db3-4e73-4755-8080-92f7c2e2d12b
Feb 27 01:30:21 devstack sudo[90213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:21 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-7df30fab-29ec-4f08-93cf-b5553a81063d tempest-CreateVolumesFromSnapshotTest-331979769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:30:21 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7df30fab-29ec-4f08-93cf-b5553a81063d tempest-CreateVolumesFromSnapshotTest-331979769 None] Flow 'volume_create_manager' (35b57ec3-df64-4873-9f7c-6d5bf7e6deb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:30:21 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7df30fab-29ec-4f08-93cf-b5553a81063d tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97beb9ca-859d-44f6-b3a3-61a5acad88a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:21 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7df30fab-29ec-4f08-93cf-b5553a81063d tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97beb9ca-859d-44f6-b3a3-61a5acad88a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:30:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-11761970',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=243d90e6-4310-4bdd-b8ab-50a193b4f176,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fe984a9789846fcb07248fd9f234380',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:30:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:30:21Z,use_quota=True,user_id='4dd65638b3d24ca4bbb5d27cdfa56167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:21 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7df30fab-29ec-4f08-93cf-b5553a81063d tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffcbdd3f-e424-40e0-adfb-3ec1936971d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:21 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7df30fab-29ec-4f08-93cf-b5553a81063d tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffcbdd3f-e424-40e0-adfb-3ec1936971d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:21 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7df30fab-29ec-4f08-93cf-b5553a81063d tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68e7c0c4-2724-47bc-a2c7-67de2b819e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:21 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7df30fab-29ec-4f08-93cf-b5553a81063d tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68e7c0c4-2724-47bc-a2c7-67de2b819e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '243d90e6-4310-4bdd-b8ab-50a193b4f176', 'volume_name': 'volume-243d90e6-4310-4bdd-b8ab-50a193b4f176', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:21 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7df30fab-29ec-4f08-93cf-b5553a81063d tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8431e1c-a15e-4d29-8130-410aec930a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:21 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7df30fab-29ec-4f08-93cf-b5553a81063d tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8431e1c-a15e-4d29-8130-410aec930a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:21 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7df30fab-29ec-4f08-93cf-b5553a81063d tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89b6ad03-c118-4bfc-b07a-69bb6327af81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:21 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-7df30fab-29ec-4f08-93cf-b5553a81063d tempest-CreateVolumesFromSnapshotTest-331979769 None] Volume 243d90e6-4310-4bdd-b8ab-50a193b4f176: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-243d90e6-4310-4bdd-b8ab-50a193b4f176', 'volume_size': 1}
Feb 27 01:30:21 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-7df30fab-29ec-4f08-93cf-b5553a81063d tempest-CreateVolumesFromSnapshotTest-331979769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:30:21 devstack sudo[90213]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:21 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ddfacffe-31d4-410f-9357-48675569cb07 tempest-CreateVolumesFromSnapshotTest-331979769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-61b56db3-4e73-4755-8080-92f7c2e2d12b" returned: 0 in 0.481s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:21 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-ddfacffe-31d4-410f-9357-48675569cb07 tempest-CreateVolumesFromSnapshotTest-331979769 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:30:21 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-ddfacffe-31d4-410f-9357-48675569cb07 tempest-CreateVolumesFromSnapshotTest-331979769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:30:21 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-4afbc110-1298-49e4-98b1-d25b7ca47592 tempest-CreateVolumesFromSnapshotTest-331979769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.964s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:30:21 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-4afbc110-1298-49e4-98b1-d25b7ca47592 tempest-CreateVolumesFromSnapshotTest-331979769 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:30:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-358815371',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fa067bf-98e2-4cfd-be82-1e63d11c3e29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fe984a9789846fcb07248fd9f234380',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:30:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:30:20Z,use_quota=True,user_id='4dd65638b3d24ca4bbb5d27cdfa56167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:30:21 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-4afbc110-1298-49e4-98b1-d25b7ca47592 tempest-CreateVolumesFromSnapshotTest-331979769 None] Creating volume 3fa067bf-98e2-4cfd-be82-1e63d11c3e29 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:30:21 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-4afbc110-1298-49e4-98b1-d25b7ca47592 tempest-CreateVolumesFromSnapshotTest-331979769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:30:21 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-4afbc110-1298-49e4-98b1-d25b7ca47592 tempest-CreateVolumesFromSnapshotTest-331979769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:30:21 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-4afbc110-1298-49e4-98b1-d25b7ca47592 tempest-CreateVolumesFromSnapshotTest-331979769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:30:21 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-4afbc110-1298-49e4-98b1-d25b7ca47592 tempest-CreateVolumesFromSnapshotTest-331979769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:30:21 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-4afbc110-1298-49e4-98b1-d25b7ca47592 tempest-CreateVolumesFromSnapshotTest-331979769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:30:21 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-4afbc110-1298-49e4-98b1-d25b7ca47592 tempest-CreateVolumesFromSnapshotTest-331979769 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:30:21 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-4afbc110-1298-49e4-98b1-d25b7ca47592 tempest-CreateVolumesFromSnapshotTest-331979769 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:30:21 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-4afbc110-1298-49e4-98b1-d25b7ca47592 tempest-CreateVolumesFromSnapshotTest-331979769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3fa067bf-98e2-4cfd-be82-1e63d11c3e29 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:21 devstack sudo[90216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3fa067bf-98e2-4cfd-be82-1e63d11c3e29 1073741824
Feb 27 01:30:21 devstack sudo[90216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:21 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-ddfacffe-31d4-410f-9357-48675569cb07 tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df9d9ce5-24b4-4eae-a4fe-fae9a43915fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61b56db3-4e73-4755-8080-92f7c2e2d12b', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:21 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-ddfacffe-31d4-410f-9357-48675569cb07 tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75f83b0c-565e-46c9-83c0-f5a438210b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:21 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-ddfacffe-31d4-410f-9357-48675569cb07 tempest-CreateVolumesFromSnapshotTest-331979769 None] Volume volume-61b56db3-4e73-4755-8080-92f7c2e2d12b (61b56db3-4e73-4755-8080-92f7c2e2d12b): created successfully
Feb 27 01:30:21 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-ddfacffe-31d4-410f-9357-48675569cb07 tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75f83b0c-565e-46c9-83c0-f5a438210b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:21 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-ddfacffe-31d4-410f-9357-48675569cb07 tempest-CreateVolumesFromSnapshotTest-331979769 None] Flow 'volume_create_manager' (14c79666-a88f-449d-abef-c68229518215) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:30:21 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-ddfacffe-31d4-410f-9357-48675569cb07 tempest-CreateVolumesFromSnapshotTest-331979769 None] Created volume successfully.
Feb 27 01:30:22 devstack sudo[90216]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:22 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-4afbc110-1298-49e4-98b1-d25b7ca47592 tempest-CreateVolumesFromSnapshotTest-331979769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3fa067bf-98e2-4cfd-be82-1e63d11c3e29 1073741824" returned: 0 in 0.619s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:22 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-4afbc110-1298-49e4-98b1-d25b7ca47592 tempest-CreateVolumesFromSnapshotTest-331979769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3fa067bf-98e2-4cfd-be82-1e63d11c3e29 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:22 devstack sudo[90221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3fa067bf-98e2-4cfd-be82-1e63d11c3e29
Feb 27 01:30:22 devstack sudo[90221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:22 devstack sudo[90221]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:22 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-4afbc110-1298-49e4-98b1-d25b7ca47592 tempest-CreateVolumesFromSnapshotTest-331979769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3fa067bf-98e2-4cfd-be82-1e63d11c3e29" returned: 0 in 0.434s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:22 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-4afbc110-1298-49e4-98b1-d25b7ca47592 tempest-CreateVolumesFromSnapshotTest-331979769 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:30:22 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-4afbc110-1298-49e4-98b1-d25b7ca47592 tempest-CreateVolumesFromSnapshotTest-331979769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:30:22 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-95230f8d-e5ed-4538-ac25-1a77051be28b tempest-CreateVolumesFromSnapshotTest-331979769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.849s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:30:22 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-95230f8d-e5ed-4538-ac25-1a77051be28b tempest-CreateVolumesFromSnapshotTest-331979769 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:30:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2045926889',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c098b15-9149-4f57-bac8-696fd6c2434a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fe984a9789846fcb07248fd9f234380',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:30:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:30:21Z,use_quota=True,user_id='4dd65638b3d24ca4bbb5d27cdfa56167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:30:22 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-95230f8d-e5ed-4538-ac25-1a77051be28b tempest-CreateVolumesFromSnapshotTest-331979769 None] Creating volume 4c098b15-9149-4f57-bac8-696fd6c2434a {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:30:22 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-95230f8d-e5ed-4538-ac25-1a77051be28b tempest-CreateVolumesFromSnapshotTest-331979769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:30:22 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-95230f8d-e5ed-4538-ac25-1a77051be28b tempest-CreateVolumesFromSnapshotTest-331979769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:30:22 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-95230f8d-e5ed-4538-ac25-1a77051be28b tempest-CreateVolumesFromSnapshotTest-331979769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:30:22 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-95230f8d-e5ed-4538-ac25-1a77051be28b tempest-CreateVolumesFromSnapshotTest-331979769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:30:22 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-95230f8d-e5ed-4538-ac25-1a77051be28b tempest-CreateVolumesFromSnapshotTest-331979769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:30:22 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-95230f8d-e5ed-4538-ac25-1a77051be28b tempest-CreateVolumesFromSnapshotTest-331979769 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:30:22 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-95230f8d-e5ed-4538-ac25-1a77051be28b tempest-CreateVolumesFromSnapshotTest-331979769 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:30:22 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-95230f8d-e5ed-4538-ac25-1a77051be28b tempest-CreateVolumesFromSnapshotTest-331979769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-4c098b15-9149-4f57-bac8-696fd6c2434a 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:22 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-4afbc110-1298-49e4-98b1-d25b7ca47592 tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (033f36a8-e7ea-49a8-aae0-057fede725b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fa067bf-98e2-4cfd-be82-1e63d11c3e29', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:22 devstack sudo[90224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-4c098b15-9149-4f57-bac8-696fd6c2434a 1073741824
Feb 27 01:30:22 devstack sudo[90224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:22 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-4afbc110-1298-49e4-98b1-d25b7ca47592 tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6f7f104-bb14-4992-b559-47963f80c99c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:22 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-4afbc110-1298-49e4-98b1-d25b7ca47592 tempest-CreateVolumesFromSnapshotTest-331979769 None] Volume volume-3fa067bf-98e2-4cfd-be82-1e63d11c3e29 (3fa067bf-98e2-4cfd-be82-1e63d11c3e29): created successfully
Feb 27 01:30:22 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-4afbc110-1298-49e4-98b1-d25b7ca47592 tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6f7f104-bb14-4992-b559-47963f80c99c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:22 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-4afbc110-1298-49e4-98b1-d25b7ca47592 tempest-CreateVolumesFromSnapshotTest-331979769 None] Flow 'volume_create_manager' (87b37493-d733-495f-a142-14af3e60606c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:30:22 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-4afbc110-1298-49e4-98b1-d25b7ca47592 tempest-CreateVolumesFromSnapshotTest-331979769 None] Created volume successfully.
Feb 27 01:30:23 devstack sudo[90224]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:23 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-95230f8d-e5ed-4538-ac25-1a77051be28b tempest-CreateVolumesFromSnapshotTest-331979769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-4c098b15-9149-4f57-bac8-696fd6c2434a 1073741824" returned: 0 in 0.486s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:23 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-95230f8d-e5ed-4538-ac25-1a77051be28b tempest-CreateVolumesFromSnapshotTest-331979769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-4c098b15-9149-4f57-bac8-696fd6c2434a {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:23 devstack sudo[90230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-4c098b15-9149-4f57-bac8-696fd6c2434a
Feb 27 01:30:23 devstack sudo[90230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:23 devstack sudo[90230]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:23 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-95230f8d-e5ed-4538-ac25-1a77051be28b tempest-CreateVolumesFromSnapshotTest-331979769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-4c098b15-9149-4f57-bac8-696fd6c2434a" returned: 0 in 0.502s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:23 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-95230f8d-e5ed-4538-ac25-1a77051be28b tempest-CreateVolumesFromSnapshotTest-331979769 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:30:23 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-95230f8d-e5ed-4538-ac25-1a77051be28b tempest-CreateVolumesFromSnapshotTest-331979769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:30:23 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-6b63f606-f160-4b5a-9a51-3e2d36804cb8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.659s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:30:23 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-6b63f606-f160-4b5a-9a51-3e2d36804cb8 tempest-CreateVolumesFromSnapshotTest-331979769 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:30:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-559311339',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd4478fd-cc72-4cb9-85ac-0fff9dc580f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fe984a9789846fcb07248fd9f234380',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:30:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:30:21Z,use_quota=True,user_id='4dd65638b3d24ca4bbb5d27cdfa56167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:30:23 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-6b63f606-f160-4b5a-9a51-3e2d36804cb8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Creating volume dd4478fd-cc72-4cb9-85ac-0fff9dc580f1 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:30:23 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-6b63f606-f160-4b5a-9a51-3e2d36804cb8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:30:23 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-6b63f606-f160-4b5a-9a51-3e2d36804cb8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:30:23 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-6b63f606-f160-4b5a-9a51-3e2d36804cb8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:30:23 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-6b63f606-f160-4b5a-9a51-3e2d36804cb8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:30:23 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-6b63f606-f160-4b5a-9a51-3e2d36804cb8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:30:23 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-6b63f606-f160-4b5a-9a51-3e2d36804cb8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:30:23 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-6b63f606-f160-4b5a-9a51-3e2d36804cb8 tempest-CreateVolumesFromSnapshotTest-331979769 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:30:23 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-6b63f606-f160-4b5a-9a51-3e2d36804cb8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4478fd-cc72-4cb9-85ac-0fff9dc580f1 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:23 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-95230f8d-e5ed-4538-ac25-1a77051be28b tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b038af41-32bd-41a6-9ab9-fe808b51ab2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c098b15-9149-4f57-bac8-696fd6c2434a', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:23 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-95230f8d-e5ed-4538-ac25-1a77051be28b tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa8dd90d-ddd4-4d0d-a2a3-f93b543f2207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:23 devstack sudo[90233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4478fd-cc72-4cb9-85ac-0fff9dc580f1 1073741824
Feb 27 01:30:23 devstack sudo[90233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:23 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-95230f8d-e5ed-4538-ac25-1a77051be28b tempest-CreateVolumesFromSnapshotTest-331979769 None] Volume volume-4c098b15-9149-4f57-bac8-696fd6c2434a (4c098b15-9149-4f57-bac8-696fd6c2434a): created successfully
Feb 27 01:30:23 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-95230f8d-e5ed-4538-ac25-1a77051be28b tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa8dd90d-ddd4-4d0d-a2a3-f93b543f2207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:23 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-95230f8d-e5ed-4538-ac25-1a77051be28b tempest-CreateVolumesFromSnapshotTest-331979769 None] Flow 'volume_create_manager' (9e7c8dff-6b4d-429f-acd5-e5985df49740) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:30:23 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-95230f8d-e5ed-4538-ac25-1a77051be28b tempest-CreateVolumesFromSnapshotTest-331979769 None] Created volume successfully.
Feb 27 01:30:24 devstack sudo[90233]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:24 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-6b63f606-f160-4b5a-9a51-3e2d36804cb8 tempest-CreateVolumesFromSnapshotTest-331979769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4478fd-cc72-4cb9-85ac-0fff9dc580f1 1073741824" returned: 0 in 0.491s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:24 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-6b63f606-f160-4b5a-9a51-3e2d36804cb8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4478fd-cc72-4cb9-85ac-0fff9dc580f1 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:24 devstack sudo[90240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4478fd-cc72-4cb9-85ac-0fff9dc580f1
Feb 27 01:30:24 devstack sudo[90240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:24 devstack sudo[90240]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:24 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-6b63f606-f160-4b5a-9a51-3e2d36804cb8 tempest-CreateVolumesFromSnapshotTest-331979769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4478fd-cc72-4cb9-85ac-0fff9dc580f1" returned: 0 in 0.405s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:24 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-6b63f606-f160-4b5a-9a51-3e2d36804cb8 tempest-CreateVolumesFromSnapshotTest-331979769 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:30:24 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-6b63f606-f160-4b5a-9a51-3e2d36804cb8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:30:24 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-7df30fab-29ec-4f08-93cf-b5553a81063d tempest-CreateVolumesFromSnapshotTest-331979769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.322s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:30:24 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-7df30fab-29ec-4f08-93cf-b5553a81063d tempest-CreateVolumesFromSnapshotTest-331979769 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:30:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-11761970',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=243d90e6-4310-4bdd-b8ab-50a193b4f176,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fe984a9789846fcb07248fd9f234380',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:30:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:30:21Z,use_quota=True,user_id='4dd65638b3d24ca4bbb5d27cdfa56167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:30:24 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-7df30fab-29ec-4f08-93cf-b5553a81063d tempest-CreateVolumesFromSnapshotTest-331979769 None] Creating volume 243d90e6-4310-4bdd-b8ab-50a193b4f176 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:30:24 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-7df30fab-29ec-4f08-93cf-b5553a81063d tempest-CreateVolumesFromSnapshotTest-331979769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:30:24 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-7df30fab-29ec-4f08-93cf-b5553a81063d tempest-CreateVolumesFromSnapshotTest-331979769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:30:24 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-7df30fab-29ec-4f08-93cf-b5553a81063d tempest-CreateVolumesFromSnapshotTest-331979769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:30:24 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-7df30fab-29ec-4f08-93cf-b5553a81063d tempest-CreateVolumesFromSnapshotTest-331979769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:30:24 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-7df30fab-29ec-4f08-93cf-b5553a81063d tempest-CreateVolumesFromSnapshotTest-331979769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:30:24 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-7df30fab-29ec-4f08-93cf-b5553a81063d tempest-CreateVolumesFromSnapshotTest-331979769 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:30:24 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-7df30fab-29ec-4f08-93cf-b5553a81063d tempest-CreateVolumesFromSnapshotTest-331979769 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:30:24 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7df30fab-29ec-4f08-93cf-b5553a81063d tempest-CreateVolumesFromSnapshotTest-331979769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-243d90e6-4310-4bdd-b8ab-50a193b4f176 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:24 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-6b63f606-f160-4b5a-9a51-3e2d36804cb8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a5a2acf-d3a4-48fa-af8e-70cafdcfd6af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd4478fd-cc72-4cb9-85ac-0fff9dc580f1', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:24 devstack sudo[90243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-243d90e6-4310-4bdd-b8ab-50a193b4f176 1073741824
Feb 27 01:30:24 devstack sudo[90243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:24 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-6b63f606-f160-4b5a-9a51-3e2d36804cb8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc006e87-dfe4-4356-93e7-1038609571b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:24 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-6b63f606-f160-4b5a-9a51-3e2d36804cb8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Volume volume-dd4478fd-cc72-4cb9-85ac-0fff9dc580f1 (dd4478fd-cc72-4cb9-85ac-0fff9dc580f1): created successfully
Feb 27 01:30:24 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-6b63f606-f160-4b5a-9a51-3e2d36804cb8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc006e87-dfe4-4356-93e7-1038609571b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:24 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-6b63f606-f160-4b5a-9a51-3e2d36804cb8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Flow 'volume_create_manager' (b302734f-f3bb-4034-bc4b-8356fa548c96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:30:24 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-6b63f606-f160-4b5a-9a51-3e2d36804cb8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Created volume successfully.
Feb 27 01:30:25 devstack sudo[90243]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:25 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7df30fab-29ec-4f08-93cf-b5553a81063d tempest-CreateVolumesFromSnapshotTest-331979769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-243d90e6-4310-4bdd-b8ab-50a193b4f176 1073741824" returned: 0 in 0.506s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:25 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7df30fab-29ec-4f08-93cf-b5553a81063d tempest-CreateVolumesFromSnapshotTest-331979769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-243d90e6-4310-4bdd-b8ab-50a193b4f176 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:25 devstack sudo[90248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-243d90e6-4310-4bdd-b8ab-50a193b4f176
Feb 27 01:30:25 devstack sudo[90248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:25 devstack sudo[90248]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:25 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7df30fab-29ec-4f08-93cf-b5553a81063d tempest-CreateVolumesFromSnapshotTest-331979769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-243d90e6-4310-4bdd-b8ab-50a193b4f176" returned: 0 in 0.392s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:25 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-7df30fab-29ec-4f08-93cf-b5553a81063d tempest-CreateVolumesFromSnapshotTest-331979769 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:30:25 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-7df30fab-29ec-4f08-93cf-b5553a81063d tempest-CreateVolumesFromSnapshotTest-331979769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:30:25 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7df30fab-29ec-4f08-93cf-b5553a81063d tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89b6ad03-c118-4bfc-b07a-69bb6327af81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-243d90e6-4310-4bdd-b8ab-50a193b4f176', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:25 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7df30fab-29ec-4f08-93cf-b5553a81063d tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6be564b-a738-4589-aad2-b0dc5d4d1cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:25 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-7df30fab-29ec-4f08-93cf-b5553a81063d tempest-CreateVolumesFromSnapshotTest-331979769 None] Volume volume-243d90e6-4310-4bdd-b8ab-50a193b4f176 (243d90e6-4310-4bdd-b8ab-50a193b4f176): created successfully
Feb 27 01:30:25 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7df30fab-29ec-4f08-93cf-b5553a81063d tempest-CreateVolumesFromSnapshotTest-331979769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6be564b-a738-4589-aad2-b0dc5d4d1cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:25 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7df30fab-29ec-4f08-93cf-b5553a81063d tempest-CreateVolumesFromSnapshotTest-331979769 None] Flow 'volume_create_manager' (35b57ec3-df64-4873-9f7c-6d5bf7e6deb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:30:25 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-7df30fab-29ec-4f08-93cf-b5553a81063d tempest-CreateVolumesFromSnapshotTest-331979769 None] Created volume successfully.
Feb 27 01:30:26 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-dc0f4249-7f3c-4d5c-ae7c-3f539f1d1866 tempest-CreateVolumesFromSnapshotTest-331979769 None] Acquiring lock "cinder-243d90e6-4310-4bdd-b8ab-50a193b4f176-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:30:26 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-dc0f4249-7f3c-4d5c-ae7c-3f539f1d1866 tempest-CreateVolumesFromSnapshotTest-331979769 None] Lock "cinder-243d90e6-4310-4bdd-b8ab-50a193b4f176-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:30:26 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-dc0f4249-7f3c-4d5c-ae7c-3f539f1d1866 tempest-CreateVolumesFromSnapshotTest-331979769 None] Acquiring lock "cinder-quobyte-243d90e6-4310-4bdd-b8ab-50a193b4f176" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:30:26 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-dc0f4249-7f3c-4d5c-ae7c-3f539f1d1866 tempest-CreateVolumesFromSnapshotTest-331979769 None] Lock "cinder-quobyte-243d90e6-4310-4bdd-b8ab-50a193b4f176" acquired by "delete_volume" :: waited 0.009s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:30:26 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14da0bf-104b-4898-b993-13f36c7ecef3]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:30:26 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-dc0f4249-7f3c-4d5c-ae7c-3f539f1d1866 tempest-CreateVolumesFromSnapshotTest-331979769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-243d90e6-4310-4bdd-b8ab-50a193b4f176 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:26 devstack sudo[90251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-243d90e6-4310-4bdd-b8ab-50a193b4f176
Feb 27 01:30:26 devstack sudo[90251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:27 devstack sudo[90251]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-dc0f4249-7f3c-4d5c-ae7c-3f539f1d1866 tempest-CreateVolumesFromSnapshotTest-331979769 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-243d90e6-4310-4bdd-b8ab-50a193b4f176" returned: 0 in 0.464s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-dc0f4249-7f3c-4d5c-ae7c-3f539f1d1866 tempest-CreateVolumesFromSnapshotTest-331979769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-243d90e6-4310-4bdd-b8ab-50a193b4f176 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:27 devstack sudo[90256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-243d90e6-4310-4bdd-b8ab-50a193b4f176
Feb 27 01:30:27 devstack sudo[90256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:27 devstack sudo[90256]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-dc0f4249-7f3c-4d5c-ae7c-3f539f1d1866 tempest-CreateVolumesFromSnapshotTest-331979769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-243d90e6-4310-4bdd-b8ab-50a193b4f176" returned: 0 in 0.399s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:27 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-dc0f4249-7f3c-4d5c-ae7c-3f539f1d1866 tempest-CreateVolumesFromSnapshotTest-331979769 None] Lock "cinder-quobyte-243d90e6-4310-4bdd-b8ab-50a193b4f176" released by "delete_volume" :: held 0.887s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:30:27 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-dc0f4249-7f3c-4d5c-ae7c-3f539f1d1866 tempest-CreateVolumesFromSnapshotTest-331979769 None] Created reservations ['db46c209-0341-4a3e-861a-4cf2f84bddc2', '7b124840-bf75-4122-bee6-a6cf1469ebaf', 'af6caa09-083a-43fa-9c0d-3cb66b7e7737', 'aad60ad7-d240-47a5-adf6-f72991e89333'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:30:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-dc0f4249-7f3c-4d5c-ae7c-3f539f1d1866 tempest-CreateVolumesFromSnapshotTest-331979769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:30:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-dc0f4249-7f3c-4d5c-ae7c-3f539f1d1866 tempest-CreateVolumesFromSnapshotTest-331979769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:30:27 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-dc0f4249-7f3c-4d5c-ae7c-3f539f1d1866 tempest-CreateVolumesFromSnapshotTest-331979769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:30:27 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-dc0f4249-7f3c-4d5c-ae7c-3f539f1d1866 tempest-CreateVolumesFromSnapshotTest-331979769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:30:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-dc0f4249-7f3c-4d5c-ae7c-3f539f1d1866 tempest-CreateVolumesFromSnapshotTest-331979769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:30:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-dc0f4249-7f3c-4d5c-ae7c-3f539f1d1866 tempest-CreateVolumesFromSnapshotTest-331979769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:27 devstack sudo[90259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:30:27 devstack sudo[90259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:27 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-37cd04f7-954e-42fa-b00a-7fb684d1d009 tempest-CreateVolumesFromSnapshotTest-331979769 None] Acquiring lock "cinder-dd4478fd-cc72-4cb9-85ac-0fff9dc580f1-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:30:27 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-37cd04f7-954e-42fa-b00a-7fb684d1d009 tempest-CreateVolumesFromSnapshotTest-331979769 None] Lock "cinder-dd4478fd-cc72-4cb9-85ac-0fff9dc580f1-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:30:27 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-37cd04f7-954e-42fa-b00a-7fb684d1d009 tempest-CreateVolumesFromSnapshotTest-331979769 None] Acquiring lock "cinder-quobyte-dd4478fd-cc72-4cb9-85ac-0fff9dc580f1" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:30:27 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-37cd04f7-954e-42fa-b00a-7fb684d1d009 tempest-CreateVolumesFromSnapshotTest-331979769 None] Lock "cinder-quobyte-dd4478fd-cc72-4cb9-85ac-0fff9dc580f1" acquired by "delete_volume" :: waited 0.012s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:30:27 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[124535dc-a3af-40cc-9474-04955e63eba9]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:30:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-37cd04f7-954e-42fa-b00a-7fb684d1d009 tempest-CreateVolumesFromSnapshotTest-331979769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4478fd-cc72-4cb9-85ac-0fff9dc580f1 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:27 devstack sudo[90261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4478fd-cc72-4cb9-85ac-0fff9dc580f1
Feb 27 01:30:27 devstack sudo[90261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:28 devstack sudo[90259]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:28 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-dc0f4249-7f3c-4d5c-ae7c-3f539f1d1866 tempest-CreateVolumesFromSnapshotTest-331979769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.423s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:28 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-dc0f4249-7f3c-4d5c-ae7c-3f539f1d1866 tempest-CreateVolumesFromSnapshotTest-331979769 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:30:28 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-dc0f4249-7f3c-4d5c-ae7c-3f539f1d1866 tempest-CreateVolumesFromSnapshotTest-331979769 None] Deleted volume successfully.
Feb 27 01:30:28 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-dc0f4249-7f3c-4d5c-ae7c-3f539f1d1866 tempest-CreateVolumesFromSnapshotTest-331979769 None] Lock "cinder-243d90e6-4310-4bdd-b8ab-50a193b4f176-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:30:28 devstack sudo[90261]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:28 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-37cd04f7-954e-42fa-b00a-7fb684d1d009 tempest-CreateVolumesFromSnapshotTest-331979769 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4478fd-cc72-4cb9-85ac-0fff9dc580f1" returned: 0 in 0.531s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:28 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-37cd04f7-954e-42fa-b00a-7fb684d1d009 tempest-CreateVolumesFromSnapshotTest-331979769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4478fd-cc72-4cb9-85ac-0fff9dc580f1 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:28 devstack sudo[90267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4478fd-cc72-4cb9-85ac-0fff9dc580f1
Feb 27 01:30:28 devstack sudo[90267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:28 devstack sudo[90267]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:28 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-37cd04f7-954e-42fa-b00a-7fb684d1d009 tempest-CreateVolumesFromSnapshotTest-331979769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4478fd-cc72-4cb9-85ac-0fff9dc580f1" returned: 0 in 0.415s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:28 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-37cd04f7-954e-42fa-b00a-7fb684d1d009 tempest-CreateVolumesFromSnapshotTest-331979769 None] Lock "cinder-quobyte-dd4478fd-cc72-4cb9-85ac-0fff9dc580f1" released by "delete_volume" :: held 0.975s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:30:28 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-37cd04f7-954e-42fa-b00a-7fb684d1d009 tempest-CreateVolumesFromSnapshotTest-331979769 None] Created reservations ['0a6bebdf-e216-414c-abc7-bf70fee86c5d', '5e248dc9-e3a5-45ad-9995-bb4dafbafb50', 'f1e9896e-2eac-4fbd-89a2-471e073cce25', '127705b7-056f-4aad-9408-8b08a5de8e16'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:30:28 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-37cd04f7-954e-42fa-b00a-7fb684d1d009 tempest-CreateVolumesFromSnapshotTest-331979769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:30:28 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-37cd04f7-954e-42fa-b00a-7fb684d1d009 tempest-CreateVolumesFromSnapshotTest-331979769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:30:28 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-37cd04f7-954e-42fa-b00a-7fb684d1d009 tempest-CreateVolumesFromSnapshotTest-331979769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:30:28 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-37cd04f7-954e-42fa-b00a-7fb684d1d009 tempest-CreateVolumesFromSnapshotTest-331979769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:30:28 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-37cd04f7-954e-42fa-b00a-7fb684d1d009 tempest-CreateVolumesFromSnapshotTest-331979769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:30:28 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-37cd04f7-954e-42fa-b00a-7fb684d1d009 tempest-CreateVolumesFromSnapshotTest-331979769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:28 devstack sudo[90270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:30:28 devstack sudo[90270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:29 devstack sudo[90270]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:29 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-37cd04f7-954e-42fa-b00a-7fb684d1d009 tempest-CreateVolumesFromSnapshotTest-331979769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.408s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:29 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-37cd04f7-954e-42fa-b00a-7fb684d1d009 tempest-CreateVolumesFromSnapshotTest-331979769 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:30:29 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-37cd04f7-954e-42fa-b00a-7fb684d1d009 tempest-CreateVolumesFromSnapshotTest-331979769 None] Deleted volume successfully.
Feb 27 01:30:29 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-37cd04f7-954e-42fa-b00a-7fb684d1d009 tempest-CreateVolumesFromSnapshotTest-331979769 None] Lock "cinder-dd4478fd-cc72-4cb9-85ac-0fff9dc580f1-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:30:30 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-1eb19659-f256-4d6b-89f4-c6d5f66995c8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Acquiring lock "cinder-4c098b15-9149-4f57-bac8-696fd6c2434a-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:30:30 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-1eb19659-f256-4d6b-89f4-c6d5f66995c8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Lock "cinder-4c098b15-9149-4f57-bac8-696fd6c2434a-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:30:30 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-1eb19659-f256-4d6b-89f4-c6d5f66995c8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Acquiring lock "cinder-quobyte-4c098b15-9149-4f57-bac8-696fd6c2434a" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:30:30 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-1eb19659-f256-4d6b-89f4-c6d5f66995c8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Lock "cinder-quobyte-4c098b15-9149-4f57-bac8-696fd6c2434a" acquired by "delete_volume" :: waited 0.011s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:30:30 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[db465192-f30f-43a8-8dd1-32a5ebeae884]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:30:30 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-1eb19659-f256-4d6b-89f4-c6d5f66995c8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-4c098b15-9149-4f57-bac8-696fd6c2434a {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:30 devstack sudo[90273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-4c098b15-9149-4f57-bac8-696fd6c2434a
Feb 27 01:30:30 devstack sudo[90273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:30 devstack sudo[90273]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:30 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-1eb19659-f256-4d6b-89f4-c6d5f66995c8 tempest-CreateVolumesFromSnapshotTest-331979769 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-4c098b15-9149-4f57-bac8-696fd6c2434a" returned: 0 in 0.457s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:30 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-1eb19659-f256-4d6b-89f4-c6d5f66995c8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-4c098b15-9149-4f57-bac8-696fd6c2434a {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:30 devstack sudo[90278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-4c098b15-9149-4f57-bac8-696fd6c2434a
Feb 27 01:30:30 devstack sudo[90278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:30 devstack sudo[90278]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:30 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-1eb19659-f256-4d6b-89f4-c6d5f66995c8 tempest-CreateVolumesFromSnapshotTest-331979769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-4c098b15-9149-4f57-bac8-696fd6c2434a" returned: 0 in 0.394s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:30 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-1eb19659-f256-4d6b-89f4-c6d5f66995c8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Lock "cinder-quobyte-4c098b15-9149-4f57-bac8-696fd6c2434a" released by "delete_volume" :: held 0.876s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:30:30 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-1eb19659-f256-4d6b-89f4-c6d5f66995c8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Created reservations ['ab553f01-0b90-4d96-b7fd-e6de421bda2b', 'c0bde47a-ea06-4082-86a7-ead77fe44b65', '91ceb0fe-e86e-4c6d-b7ed-fee65a616909', '977f11bd-d986-4891-8914-636abec2ff23'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:30:31 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-1eb19659-f256-4d6b-89f4-c6d5f66995c8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:30:31 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-1eb19659-f256-4d6b-89f4-c6d5f66995c8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:30:31 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-1eb19659-f256-4d6b-89f4-c6d5f66995c8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:30:31 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-1eb19659-f256-4d6b-89f4-c6d5f66995c8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:30:31 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-1eb19659-f256-4d6b-89f4-c6d5f66995c8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:30:31 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-1eb19659-f256-4d6b-89f4-c6d5f66995c8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:31 devstack sudo[90281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:30:31 devstack sudo[90281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:31 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-2177279c-50f1-42be-9733-a050e40496c2 tempest-CreateVolumesFromSnapshotTest-331979769 None] Acquiring lock "cinder-3fa067bf-98e2-4cfd-be82-1e63d11c3e29-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:30:31 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-2177279c-50f1-42be-9733-a050e40496c2 tempest-CreateVolumesFromSnapshotTest-331979769 None] Lock "cinder-3fa067bf-98e2-4cfd-be82-1e63d11c3e29-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:30:31 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-2177279c-50f1-42be-9733-a050e40496c2 tempest-CreateVolumesFromSnapshotTest-331979769 None] Acquiring lock "cinder-quobyte-3fa067bf-98e2-4cfd-be82-1e63d11c3e29" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:30:31 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-2177279c-50f1-42be-9733-a050e40496c2 tempest-CreateVolumesFromSnapshotTest-331979769 None] Lock "cinder-quobyte-3fa067bf-98e2-4cfd-be82-1e63d11c3e29" acquired by "delete_volume" :: waited 0.011s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:30:31 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19b73c7-6f91-4328-a723-54bf1a3c52b3]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:30:31 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-2177279c-50f1-42be-9733-a050e40496c2 tempest-CreateVolumesFromSnapshotTest-331979769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3fa067bf-98e2-4cfd-be82-1e63d11c3e29 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:31 devstack sudo[90283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3fa067bf-98e2-4cfd-be82-1e63d11c3e29
Feb 27 01:30:31 devstack sudo[90283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:31 devstack sudo[90281]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:31 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-1eb19659-f256-4d6b-89f4-c6d5f66995c8 tempest-CreateVolumesFromSnapshotTest-331979769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.428s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:31 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-1eb19659-f256-4d6b-89f4-c6d5f66995c8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:30:31 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-1eb19659-f256-4d6b-89f4-c6d5f66995c8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Deleted volume successfully.
Feb 27 01:30:31 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-1eb19659-f256-4d6b-89f4-c6d5f66995c8 tempest-CreateVolumesFromSnapshotTest-331979769 None] Lock "cinder-4c098b15-9149-4f57-bac8-696fd6c2434a-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:30:31 devstack sudo[90283]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:31 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-2177279c-50f1-42be-9733-a050e40496c2 tempest-CreateVolumesFromSnapshotTest-331979769 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3fa067bf-98e2-4cfd-be82-1e63d11c3e29" returned: 0 in 0.521s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:31 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-2177279c-50f1-42be-9733-a050e40496c2 tempest-CreateVolumesFromSnapshotTest-331979769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3fa067bf-98e2-4cfd-be82-1e63d11c3e29 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:31 devstack sudo[90289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3fa067bf-98e2-4cfd-be82-1e63d11c3e29
Feb 27 01:30:31 devstack sudo[90289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:32 devstack sudo[90289]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:32 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-2177279c-50f1-42be-9733-a050e40496c2 tempest-CreateVolumesFromSnapshotTest-331979769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-3fa067bf-98e2-4cfd-be82-1e63d11c3e29" returned: 0 in 0.417s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:32 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-2177279c-50f1-42be-9733-a050e40496c2 tempest-CreateVolumesFromSnapshotTest-331979769 None] Lock "cinder-quobyte-3fa067bf-98e2-4cfd-be82-1e63d11c3e29" released by "delete_volume" :: held 0.967s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:30:32 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-2177279c-50f1-42be-9733-a050e40496c2 tempest-CreateVolumesFromSnapshotTest-331979769 None] Created reservations ['db5c4a25-5d2d-4cb9-a6b3-856d62c2be83', '90eb70b2-4197-4a2d-bf7f-4e339d3a57fa', '444ee244-0db1-489b-b73e-d638b506c9d3', 'c091ee9e-1859-4c01-8e4b-0202bc1e691a'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:30:32 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-2177279c-50f1-42be-9733-a050e40496c2 tempest-CreateVolumesFromSnapshotTest-331979769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:30:32 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-2177279c-50f1-42be-9733-a050e40496c2 tempest-CreateVolumesFromSnapshotTest-331979769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:30:32 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-2177279c-50f1-42be-9733-a050e40496c2 tempest-CreateVolumesFromSnapshotTest-331979769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:30:32 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-2177279c-50f1-42be-9733-a050e40496c2 tempest-CreateVolumesFromSnapshotTest-331979769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:30:32 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-2177279c-50f1-42be-9733-a050e40496c2 tempest-CreateVolumesFromSnapshotTest-331979769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:30:32 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-2177279c-50f1-42be-9733-a050e40496c2 tempest-CreateVolumesFromSnapshotTest-331979769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:32 devstack sudo[90292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:30:32 devstack sudo[90292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:32 devstack sudo[90292]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:32 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-2177279c-50f1-42be-9733-a050e40496c2 tempest-CreateVolumesFromSnapshotTest-331979769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.404s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:32 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-2177279c-50f1-42be-9733-a050e40496c2 tempest-CreateVolumesFromSnapshotTest-331979769 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:30:32 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-2177279c-50f1-42be-9733-a050e40496c2 tempest-CreateVolumesFromSnapshotTest-331979769 None] Deleted volume successfully.
Feb 27 01:30:32 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-2177279c-50f1-42be-9733-a050e40496c2 tempest-CreateVolumesFromSnapshotTest-331979769 None] Lock "cinder-3fa067bf-98e2-4cfd-be82-1e63d11c3e29-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:30:33 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-e53fbea0-b53b-4a18-8cf6-15f54261d5cb tempest-CreateVolumesFromSnapshotTest-331979769 None] Acquiring lock "cinder-61b56db3-4e73-4755-8080-92f7c2e2d12b-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:30:33 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-e53fbea0-b53b-4a18-8cf6-15f54261d5cb tempest-CreateVolumesFromSnapshotTest-331979769 None] Lock "cinder-61b56db3-4e73-4755-8080-92f7c2e2d12b-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:30:33 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-e53fbea0-b53b-4a18-8cf6-15f54261d5cb tempest-CreateVolumesFromSnapshotTest-331979769 None] Acquiring lock "cinder-quobyte-61b56db3-4e73-4755-8080-92f7c2e2d12b" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:30:33 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-e53fbea0-b53b-4a18-8cf6-15f54261d5cb tempest-CreateVolumesFromSnapshotTest-331979769 None] Lock "cinder-quobyte-61b56db3-4e73-4755-8080-92f7c2e2d12b" acquired by "delete_volume" :: waited 0.011s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:30:33 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[33cadcc5-571b-4a42-ba70-cbe33984621e]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:30:33 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-e53fbea0-b53b-4a18-8cf6-15f54261d5cb tempest-CreateVolumesFromSnapshotTest-331979769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-61b56db3-4e73-4755-8080-92f7c2e2d12b {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:33 devstack sudo[90296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-61b56db3-4e73-4755-8080-92f7c2e2d12b
Feb 27 01:30:33 devstack sudo[90296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:33 devstack sudo[90296]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:33 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-e53fbea0-b53b-4a18-8cf6-15f54261d5cb tempest-CreateVolumesFromSnapshotTest-331979769 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-61b56db3-4e73-4755-8080-92f7c2e2d12b" returned: 0 in 0.546s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:33 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-e53fbea0-b53b-4a18-8cf6-15f54261d5cb tempest-CreateVolumesFromSnapshotTest-331979769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-61b56db3-4e73-4755-8080-92f7c2e2d12b {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:33 devstack sudo[90301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-61b56db3-4e73-4755-8080-92f7c2e2d12b
Feb 27 01:30:33 devstack sudo[90301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:34 devstack sudo[90301]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:34 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-e53fbea0-b53b-4a18-8cf6-15f54261d5cb tempest-CreateVolumesFromSnapshotTest-331979769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-61b56db3-4e73-4755-8080-92f7c2e2d12b" returned: 0 in 0.399s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:34 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-e53fbea0-b53b-4a18-8cf6-15f54261d5cb tempest-CreateVolumesFromSnapshotTest-331979769 None] Lock "cinder-quobyte-61b56db3-4e73-4755-8080-92f7c2e2d12b" released by "delete_volume" :: held 0.979s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:30:34 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-e53fbea0-b53b-4a18-8cf6-15f54261d5cb tempest-CreateVolumesFromSnapshotTest-331979769 None] Created reservations ['b1d2dafc-1a5d-4f40-9782-2de646ff7549', 'eb05d1b3-47fe-4506-a4fb-af148fdb30fa', 'd7777d0c-3333-4f67-9458-c906d5c44632', '0cb6a8a2-abf7-4547-b5f5-1ab8734e0176'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:30:34 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-e53fbea0-b53b-4a18-8cf6-15f54261d5cb tempest-CreateVolumesFromSnapshotTest-331979769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:30:34 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-e53fbea0-b53b-4a18-8cf6-15f54261d5cb tempest-CreateVolumesFromSnapshotTest-331979769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:30:34 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-e53fbea0-b53b-4a18-8cf6-15f54261d5cb tempest-CreateVolumesFromSnapshotTest-331979769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:30:34 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-e53fbea0-b53b-4a18-8cf6-15f54261d5cb tempest-CreateVolumesFromSnapshotTest-331979769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:30:34 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-e53fbea0-b53b-4a18-8cf6-15f54261d5cb tempest-CreateVolumesFromSnapshotTest-331979769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:30:34 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-e53fbea0-b53b-4a18-8cf6-15f54261d5cb tempest-CreateVolumesFromSnapshotTest-331979769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:34 devstack sudo[90304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:30:34 devstack sudo[90304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:34 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-c21fca8c-7d7d-4eaf-8ed0-335c4dd28ab1 tempest-CreateVolumesFromSnapshotTest-331979769 None] Acquiring lock "cinder-c22e2b59-d0b2-44af-8e9c-f6487f03efc1-delete_snapshot" by "delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:30:34 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-c21fca8c-7d7d-4eaf-8ed0-335c4dd28ab1 tempest-CreateVolumesFromSnapshotTest-331979769 None] Lock "cinder-c22e2b59-d0b2-44af-8e9c-f6487f03efc1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:30:34 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-c21fca8c-7d7d-4eaf-8ed0-335c4dd28ab1 tempest-CreateVolumesFromSnapshotTest-331979769 None] Acquiring lock "cinder-quobyte-5eeb33ba-b7e1-45c6-ab0a-6402221d2e31" by "delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:30:34 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-c21fca8c-7d7d-4eaf-8ed0-335c4dd28ab1 tempest-CreateVolumesFromSnapshotTest-331979769 None] Lock "cinder-quobyte-5eeb33ba-b7e1-45c6-ab0a-6402221d2e31" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:30:34 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-c21fca8c-7d7d-4eaf-8ed0-335c4dd28ab1 tempest-CreateVolumesFromSnapshotTest-331979769 None] Acquiring lock "cinder-quobyte-c22e2b59-d0b2-44af-8e9c-f6487f03efc1" by "_delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:30:34 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-c21fca8c-7d7d-4eaf-8ed0-335c4dd28ab1 tempest-CreateVolumesFromSnapshotTest-331979769 None] Lock "cinder-quobyte-c22e2b59-d0b2-44af-8e9c-f6487f03efc1" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:30:34 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-c21fca8c-7d7d-4eaf-8ed0-335c4dd28ab1 tempest-CreateVolumesFromSnapshotTest-331979769 None] Deleting offline snapshot c22e2b59-d0b2-44af-8e9c-f6487f03efc1 of volume 5eeb33ba-b7e1-45c6-ab0a-6402221d2e31 {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:30:34 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-c21fca8c-7d7d-4eaf-8ed0-335c4dd28ab1 tempest-CreateVolumesFromSnapshotTest-331979769 None] snapshot_file for this snap is: volume-5eeb33ba-b7e1-45c6-ab0a-6402221d2e31.c22e2b59-d0b2-44af-8e9c-f6487f03efc1 {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:30:34 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82d70d9-64be-4ad2-9f45-eed8281d0963]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:30:34 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c21fca8c-7d7d-4eaf-8ed0-335c4dd28ab1 tempest-CreateVolumesFromSnapshotTest-331979769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5eeb33ba-b7e1-45c6-ab0a-6402221d2e31.c22e2b59-d0b2-44af-8e9c-f6487f03efc1 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:34 devstack sudo[90306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5eeb33ba-b7e1-45c6-ab0a-6402221d2e31.c22e2b59-d0b2-44af-8e9c-f6487f03efc1
Feb 27 01:30:34 devstack sudo[90306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:34 devstack sudo[90304]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:34 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-e53fbea0-b53b-4a18-8cf6-15f54261d5cb tempest-CreateVolumesFromSnapshotTest-331979769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.430s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:34 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-e53fbea0-b53b-4a18-8cf6-15f54261d5cb tempest-CreateVolumesFromSnapshotTest-331979769 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:30:34 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-e53fbea0-b53b-4a18-8cf6-15f54261d5cb tempest-CreateVolumesFromSnapshotTest-331979769 None] Deleted volume successfully.
Feb 27 01:30:34 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-e53fbea0-b53b-4a18-8cf6-15f54261d5cb tempest-CreateVolumesFromSnapshotTest-331979769 None] Lock "cinder-61b56db3-4e73-4755-8080-92f7c2e2d12b-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:30:35 devstack sudo[90306]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:35 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c21fca8c-7d7d-4eaf-8ed0-335c4dd28ab1 tempest-CreateVolumesFromSnapshotTest-331979769 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5eeb33ba-b7e1-45c6-ab0a-6402221d2e31.c22e2b59-d0b2-44af-8e9c-f6487f03efc1" returned: 0 in 0.516s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:35 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-c21fca8c-7d7d-4eaf-8ed0-335c4dd28ab1 tempest-CreateVolumesFromSnapshotTest-331979769 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5eeb33ba-b7e1-45c6-ab0a-6402221d2e31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83106) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:30:35 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[25aa44c4-5693-443d-a368-6c6bf32f0220]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:30:35 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c21fca8c-7d7d-4eaf-8ed0-335c4dd28ab1 tempest-CreateVolumesFromSnapshotTest-331979769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5eeb33ba-b7e1-45c6-ab0a-6402221d2e31 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:35 devstack sudo[90312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5eeb33ba-b7e1-45c6-ab0a-6402221d2e31
Feb 27 01:30:35 devstack sudo[90312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:35 devstack sudo[90312]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:35 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c21fca8c-7d7d-4eaf-8ed0-335c4dd28ab1 tempest-CreateVolumesFromSnapshotTest-331979769 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5eeb33ba-b7e1-45c6-ab0a-6402221d2e31" returned: 0 in 0.483s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:35 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c21fca8c-7d7d-4eaf-8ed0-335c4dd28ab1 tempest-CreateVolumesFromSnapshotTest-331979769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5eeb33ba-b7e1-45c6-ab0a-6402221d2e31.c22e2b59-d0b2-44af-8e9c-f6487f03efc1 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:35 devstack sudo[90317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5eeb33ba-b7e1-45c6-ab0a-6402221d2e31.c22e2b59-d0b2-44af-8e9c-f6487f03efc1
Feb 27 01:30:35 devstack sudo[90317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:35 devstack sudo[90317]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:35 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c21fca8c-7d7d-4eaf-8ed0-335c4dd28ab1 tempest-CreateVolumesFromSnapshotTest-331979769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5eeb33ba-b7e1-45c6-ab0a-6402221d2e31.c22e2b59-d0b2-44af-8e9c-f6487f03efc1" returned: 0 in 0.446s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:35 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c21fca8c-7d7d-4eaf-8ed0-335c4dd28ab1 tempest-CreateVolumesFromSnapshotTest-331979769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5eeb33ba-b7e1-45c6-ab0a-6402221d2e31.c22e2b59-d0b2-44af-8e9c-f6487f03efc1 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:36 devstack sudo[90322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5eeb33ba-b7e1-45c6-ab0a-6402221d2e31.c22e2b59-d0b2-44af-8e9c-f6487f03efc1
Feb 27 01:30:36 devstack sudo[90322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:36 devstack sudo[90322]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:36 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c21fca8c-7d7d-4eaf-8ed0-335c4dd28ab1 tempest-CreateVolumesFromSnapshotTest-331979769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5eeb33ba-b7e1-45c6-ab0a-6402221d2e31.c22e2b59-d0b2-44af-8e9c-f6487f03efc1" returned: 0 in 0.401s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:36 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-c21fca8c-7d7d-4eaf-8ed0-335c4dd28ab1 tempest-CreateVolumesFromSnapshotTest-331979769 None] Lock "cinder-quobyte-c22e2b59-d0b2-44af-8e9c-f6487f03efc1" released by "_delete_snapshot" :: held 1.909s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:30:36 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-c21fca8c-7d7d-4eaf-8ed0-335c4dd28ab1 tempest-CreateVolumesFromSnapshotTest-331979769 None] Lock "cinder-quobyte-5eeb33ba-b7e1-45c6-ab0a-6402221d2e31" released by "delete_snapshot" :: held 1.922s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:30:36 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-c21fca8c-7d7d-4eaf-8ed0-335c4dd28ab1 tempest-CreateVolumesFromSnapshotTest-331979769 None] Created reservations ['af5338b4-e3dd-4d79-baa2-4706a83f8e54', 'deafbc25-fad6-4315-ba47-85a487488ad3', '92f4da37-6cb8-44bf-9dcb-003305bf333e', '68929269-bc4e-499f-8c92-be8e8c8870c6'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:30:36 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-c21fca8c-7d7d-4eaf-8ed0-335c4dd28ab1 tempest-CreateVolumesFromSnapshotTest-331979769 None] Delete snapshot completed successfully.
Feb 27 01:30:36 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-c21fca8c-7d7d-4eaf-8ed0-335c4dd28ab1 tempest-CreateVolumesFromSnapshotTest-331979769 None] Lock "cinder-c22e2b59-d0b2-44af-8e9c-f6487f03efc1-delete_snapshot" released by "delete_snapshot" :: held 2.007s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:30:36 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-6d14e6c7-649f-4ad3-a0b4-99d1ec980a4c tempest-CreateVolumesFromSnapshotTest-331979769 None] Acquiring lock "cinder-5eeb33ba-b7e1-45c6-ab0a-6402221d2e31-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:30:36 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-6d14e6c7-649f-4ad3-a0b4-99d1ec980a4c tempest-CreateVolumesFromSnapshotTest-331979769 None] Lock "cinder-5eeb33ba-b7e1-45c6-ab0a-6402221d2e31-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:30:36 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-6d14e6c7-649f-4ad3-a0b4-99d1ec980a4c tempest-CreateVolumesFromSnapshotTest-331979769 None] Acquiring lock "cinder-quobyte-5eeb33ba-b7e1-45c6-ab0a-6402221d2e31" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:30:36 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-6d14e6c7-649f-4ad3-a0b4-99d1ec980a4c tempest-CreateVolumesFromSnapshotTest-331979769 None] Lock "cinder-quobyte-5eeb33ba-b7e1-45c6-ab0a-6402221d2e31" acquired by "delete_volume" :: waited 0.009s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:30:36 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f588917-1d8c-4cfe-9d6d-ab8141810361]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:30:36 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-6d14e6c7-649f-4ad3-a0b4-99d1ec980a4c tempest-CreateVolumesFromSnapshotTest-331979769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5eeb33ba-b7e1-45c6-ab0a-6402221d2e31 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:36 devstack sudo[90325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5eeb33ba-b7e1-45c6-ab0a-6402221d2e31
Feb 27 01:30:36 devstack sudo[90325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:37 devstack sudo[90325]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-6d14e6c7-649f-4ad3-a0b4-99d1ec980a4c tempest-CreateVolumesFromSnapshotTest-331979769 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5eeb33ba-b7e1-45c6-ab0a-6402221d2e31" returned: 0 in 0.468s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-6d14e6c7-649f-4ad3-a0b4-99d1ec980a4c tempest-CreateVolumesFromSnapshotTest-331979769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5eeb33ba-b7e1-45c6-ab0a-6402221d2e31 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:37 devstack sudo[90330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5eeb33ba-b7e1-45c6-ab0a-6402221d2e31
Feb 27 01:30:37 devstack sudo[90330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:37 devstack sudo[90330]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-6d14e6c7-649f-4ad3-a0b4-99d1ec980a4c tempest-CreateVolumesFromSnapshotTest-331979769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5eeb33ba-b7e1-45c6-ab0a-6402221d2e31" returned: 0 in 0.402s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:37 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-6d14e6c7-649f-4ad3-a0b4-99d1ec980a4c tempest-CreateVolumesFromSnapshotTest-331979769 None] Lock "cinder-quobyte-5eeb33ba-b7e1-45c6-ab0a-6402221d2e31" released by "delete_volume" :: held 0.901s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:30:37 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-6d14e6c7-649f-4ad3-a0b4-99d1ec980a4c tempest-CreateVolumesFromSnapshotTest-331979769 None] Created reservations ['5557347a-9605-42a7-a06c-fee9b9f5ce72', '8ea9e7ee-dc97-4da0-897d-6b96d06148c3', 'f2aace80-82a5-4c4e-a54d-cb1131d34871', 'c690881b-af48-4042-9bcf-b485aeb199c7'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:30:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-6d14e6c7-649f-4ad3-a0b4-99d1ec980a4c tempest-CreateVolumesFromSnapshotTest-331979769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:30:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-6d14e6c7-649f-4ad3-a0b4-99d1ec980a4c tempest-CreateVolumesFromSnapshotTest-331979769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:30:37 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-6d14e6c7-649f-4ad3-a0b4-99d1ec980a4c tempest-CreateVolumesFromSnapshotTest-331979769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:30:37 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-6d14e6c7-649f-4ad3-a0b4-99d1ec980a4c tempest-CreateVolumesFromSnapshotTest-331979769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:30:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-6d14e6c7-649f-4ad3-a0b4-99d1ec980a4c tempest-CreateVolumesFromSnapshotTest-331979769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:30:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-6d14e6c7-649f-4ad3-a0b4-99d1ec980a4c tempest-CreateVolumesFromSnapshotTest-331979769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:37 devstack sudo[90333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:30:37 devstack sudo[90333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:38 devstack sudo[90333]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:38 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-6d14e6c7-649f-4ad3-a0b4-99d1ec980a4c tempest-CreateVolumesFromSnapshotTest-331979769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.515s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:38 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-6d14e6c7-649f-4ad3-a0b4-99d1ec980a4c tempest-CreateVolumesFromSnapshotTest-331979769 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:30:38 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-6d14e6c7-649f-4ad3-a0b4-99d1ec980a4c tempest-CreateVolumesFromSnapshotTest-331979769 None] Deleted volume successfully.
Feb 27 01:30:38 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-6d14e6c7-649f-4ad3-a0b4-99d1ec980a4c tempest-CreateVolumesFromSnapshotTest-331979769 None] Lock "cinder-5eeb33ba-b7e1-45c6-ab0a-6402221d2e31-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:30:39 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5e77d6d-2f9e-430f-ac27-38ddb8b0a70c tempest-VolumeDependencyTests-62967508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:30:39 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d5e77d6d-2f9e-430f-ac27-38ddb8b0a70c tempest-VolumeDependencyTests-62967508 None] Flow 'volume_create_manager' (0174d93a-f06c-49e9-b8c6-4ba52509479f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:30:39 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d5e77d6d-2f9e-430f-ac27-38ddb8b0a70c tempest-VolumeDependencyTests-62967508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e2b0e36-0f2f-42f2-9da7-d94d94248684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:39 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d5e77d6d-2f9e-430f-ac27-38ddb8b0a70c tempest-VolumeDependencyTests-62967508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e2b0e36-0f2f-42f2-9da7-d94d94248684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:30:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-446556768',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c76f694f-1303-4dfb-a828-182fab76443a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c18c4fde6aff412eb2bce355ba1f067d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:30:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:30:40Z,use_quota=True,user_id='1298f0fc66d147688e7c2bbcdb6ed1bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:39 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d5e77d6d-2f9e-430f-ac27-38ddb8b0a70c tempest-VolumeDependencyTests-62967508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bf77953-9618-45f3-b2e0-5d1f417a0731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:39 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d5e77d6d-2f9e-430f-ac27-38ddb8b0a70c tempest-VolumeDependencyTests-62967508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bf77953-9618-45f3-b2e0-5d1f417a0731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:39 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d5e77d6d-2f9e-430f-ac27-38ddb8b0a70c tempest-VolumeDependencyTests-62967508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dc7ff5b-4782-465e-8b0c-28e6918a1187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:39 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d5e77d6d-2f9e-430f-ac27-38ddb8b0a70c tempest-VolumeDependencyTests-62967508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dc7ff5b-4782-465e-8b0c-28e6918a1187) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c76f694f-1303-4dfb-a828-182fab76443a', 'volume_name': 'volume-c76f694f-1303-4dfb-a828-182fab76443a', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:39 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d5e77d6d-2f9e-430f-ac27-38ddb8b0a70c tempest-VolumeDependencyTests-62967508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7919f1c4-0986-42c8-a184-052cc6653331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:39 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d5e77d6d-2f9e-430f-ac27-38ddb8b0a70c tempest-VolumeDependencyTests-62967508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7919f1c4-0986-42c8-a184-052cc6653331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:39 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d5e77d6d-2f9e-430f-ac27-38ddb8b0a70c tempest-VolumeDependencyTests-62967508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66b3a000-13ff-4717-9f51-d6bbf74f6eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:39 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-d5e77d6d-2f9e-430f-ac27-38ddb8b0a70c tempest-VolumeDependencyTests-62967508 None] Volume c76f694f-1303-4dfb-a828-182fab76443a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c76f694f-1303-4dfb-a828-182fab76443a', 'volume_size': 1}
Feb 27 01:30:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-d5e77d6d-2f9e-430f-ac27-38ddb8b0a70c tempest-VolumeDependencyTests-62967508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:30:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-d5e77d6d-2f9e-430f-ac27-38ddb8b0a70c tempest-VolumeDependencyTests-62967508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:30:39 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-d5e77d6d-2f9e-430f-ac27-38ddb8b0a70c tempest-VolumeDependencyTests-62967508 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:30:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-446556768',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c76f694f-1303-4dfb-a828-182fab76443a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c18c4fde6aff412eb2bce355ba1f067d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:30:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:30:40Z,use_quota=True,user_id='1298f0fc66d147688e7c2bbcdb6ed1bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:30:39 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-d5e77d6d-2f9e-430f-ac27-38ddb8b0a70c tempest-VolumeDependencyTests-62967508 None] Creating volume c76f694f-1303-4dfb-a828-182fab76443a {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:30:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-d5e77d6d-2f9e-430f-ac27-38ddb8b0a70c tempest-VolumeDependencyTests-62967508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:30:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-d5e77d6d-2f9e-430f-ac27-38ddb8b0a70c tempest-VolumeDependencyTests-62967508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:30:39 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-d5e77d6d-2f9e-430f-ac27-38ddb8b0a70c tempest-VolumeDependencyTests-62967508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:30:39 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-d5e77d6d-2f9e-430f-ac27-38ddb8b0a70c tempest-VolumeDependencyTests-62967508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:30:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-d5e77d6d-2f9e-430f-ac27-38ddb8b0a70c tempest-VolumeDependencyTests-62967508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:30:39 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-d5e77d6d-2f9e-430f-ac27-38ddb8b0a70c tempest-VolumeDependencyTests-62967508 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:30:39 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-d5e77d6d-2f9e-430f-ac27-38ddb8b0a70c tempest-VolumeDependencyTests-62967508 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:30:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d5e77d6d-2f9e-430f-ac27-38ddb8b0a70c tempest-VolumeDependencyTests-62967508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c76f694f-1303-4dfb-a828-182fab76443a 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:39 devstack sudo[90337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c76f694f-1303-4dfb-a828-182fab76443a 1073741824
Feb 27 01:30:39 devstack sudo[90337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:40 devstack sudo[90337]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:40 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d5e77d6d-2f9e-430f-ac27-38ddb8b0a70c tempest-VolumeDependencyTests-62967508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c76f694f-1303-4dfb-a828-182fab76443a 1073741824" returned: 0 in 0.487s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:40 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d5e77d6d-2f9e-430f-ac27-38ddb8b0a70c tempest-VolumeDependencyTests-62967508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c76f694f-1303-4dfb-a828-182fab76443a {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:40 devstack sudo[90342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c76f694f-1303-4dfb-a828-182fab76443a
Feb 27 01:30:40 devstack sudo[90342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:40 devstack sudo[90342]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:40 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d5e77d6d-2f9e-430f-ac27-38ddb8b0a70c tempest-VolumeDependencyTests-62967508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c76f694f-1303-4dfb-a828-182fab76443a" returned: 0 in 0.409s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:40 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-d5e77d6d-2f9e-430f-ac27-38ddb8b0a70c tempest-VolumeDependencyTests-62967508 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:30:40 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-d5e77d6d-2f9e-430f-ac27-38ddb8b0a70c tempest-VolumeDependencyTests-62967508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:30:40 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d5e77d6d-2f9e-430f-ac27-38ddb8b0a70c tempest-VolumeDependencyTests-62967508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66b3a000-13ff-4717-9f51-d6bbf74f6eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c76f694f-1303-4dfb-a828-182fab76443a', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:40 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d5e77d6d-2f9e-430f-ac27-38ddb8b0a70c tempest-VolumeDependencyTests-62967508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db891f4b-4761-4458-8dc0-9ca7fb4c4216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:40 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-d5e77d6d-2f9e-430f-ac27-38ddb8b0a70c tempest-VolumeDependencyTests-62967508 None] Volume volume-c76f694f-1303-4dfb-a828-182fab76443a (c76f694f-1303-4dfb-a828-182fab76443a): created successfully
Feb 27 01:30:40 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d5e77d6d-2f9e-430f-ac27-38ddb8b0a70c tempest-VolumeDependencyTests-62967508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db891f4b-4761-4458-8dc0-9ca7fb4c4216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:40 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d5e77d6d-2f9e-430f-ac27-38ddb8b0a70c tempest-VolumeDependencyTests-62967508 None] Flow 'volume_create_manager' (0174d93a-f06c-49e9-b8c6-4ba52509479f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:30:40 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-d5e77d6d-2f9e-430f-ac27-38ddb8b0a70c tempest-VolumeDependencyTests-62967508 None] Created volume successfully.
Feb 27 01:30:41 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-49d4d5e8-3c2d-42f8-8814-b5681dd14276 tempest-VolumeDependencyTests-62967508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:30:41 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-49d4d5e8-3c2d-42f8-8814-b5681dd14276 tempest-VolumeDependencyTests-62967508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:30:41 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-49d4d5e8-3c2d-42f8-8814-b5681dd14276 tempest-VolumeDependencyTests-62967508 None] Creating offline snapshot c1e99724-bb5b-40e0-94d9-2401e15b7ab3 of volume c76f694f-1303-4dfb-a828-182fab76443a {{(pid=83106) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:30:41 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a133bd2-f91c-4269-aea6-a64f9c185ef8]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:30:41 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-49d4d5e8-3c2d-42f8-8814-b5681dd14276 tempest-VolumeDependencyTests-62967508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c76f694f-1303-4dfb-a828-182fab76443a {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:42 devstack sudo[90345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c76f694f-1303-4dfb-a828-182fab76443a
Feb 27 01:30:42 devstack sudo[90345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:42 devstack sudo[90345]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:42 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-49d4d5e8-3c2d-42f8-8814-b5681dd14276 tempest-VolumeDependencyTests-62967508 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c76f694f-1303-4dfb-a828-182fab76443a" returned: 0 in 0.468s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:42 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-49d4d5e8-3c2d-42f8-8814-b5681dd14276 tempest-VolumeDependencyTests-62967508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c76f694f-1303-4dfb-a828-182fab76443a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c76f694f-1303-4dfb-a828-182fab76443a.c1e99724-bb5b-40e0-94d9-2401e15b7ab3 1G {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:42 devstack sudo[90350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c76f694f-1303-4dfb-a828-182fab76443a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c76f694f-1303-4dfb-a828-182fab76443a.c1e99724-bb5b-40e0-94d9-2401e15b7ab3 1G
Feb 27 01:30:42 devstack sudo[90350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:42 devstack sudo[90350]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:42 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-49d4d5e8-3c2d-42f8-8814-b5681dd14276 tempest-VolumeDependencyTests-62967508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c76f694f-1303-4dfb-a828-182fab76443a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c76f694f-1303-4dfb-a828-182fab76443a.c1e99724-bb5b-40e0-94d9-2401e15b7ab3 1G" returned: 0 in 0.474s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:42 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-49d4d5e8-3c2d-42f8-8814-b5681dd14276 tempest-VolumeDependencyTests-62967508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c76f694f-1303-4dfb-a828-182fab76443a -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c76f694f-1303-4dfb-a828-182fab76443a.c1e99724-bb5b-40e0-94d9-2401e15b7ab3 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:42 devstack sudo[90356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c76f694f-1303-4dfb-a828-182fab76443a -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c76f694f-1303-4dfb-a828-182fab76443a.c1e99724-bb5b-40e0-94d9-2401e15b7ab3
Feb 27 01:30:42 devstack sudo[90356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:43 devstack sudo[90356]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:43 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-49d4d5e8-3c2d-42f8-8814-b5681dd14276 tempest-VolumeDependencyTests-62967508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c76f694f-1303-4dfb-a828-182fab76443a -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c76f694f-1303-4dfb-a828-182fab76443a.c1e99724-bb5b-40e0-94d9-2401e15b7ab3" returned: 0 in 0.437s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:43 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-49d4d5e8-3c2d-42f8-8814-b5681dd14276 tempest-VolumeDependencyTests-62967508 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c76f694f-1303-4dfb-a828-182fab76443a.c1e99724-bb5b-40e0-94d9-2401e15b7ab3 is being set with open permissions: ugo+rw
Feb 27 01:30:43 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-49d4d5e8-3c2d-42f8-8814-b5681dd14276 tempest-VolumeDependencyTests-62967508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c76f694f-1303-4dfb-a828-182fab76443a.c1e99724-bb5b-40e0-94d9-2401e15b7ab3 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:43 devstack sudo[90361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c76f694f-1303-4dfb-a828-182fab76443a.c1e99724-bb5b-40e0-94d9-2401e15b7ab3
Feb 27 01:30:43 devstack sudo[90361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:43 devstack sudo[90361]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:43 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-49d4d5e8-3c2d-42f8-8814-b5681dd14276 tempest-VolumeDependencyTests-62967508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c76f694f-1303-4dfb-a828-182fab76443a.c1e99724-bb5b-40e0-94d9-2401e15b7ab3" returned: 0 in 0.397s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:43 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-49d4d5e8-3c2d-42f8-8814-b5681dd14276 tempest-VolumeDependencyTests-62967508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c76f694f-1303-4dfb-a828-182fab76443a.info {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:43 devstack sudo[90364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c76f694f-1303-4dfb-a828-182fab76443a.info
Feb 27 01:30:43 devstack sudo[90364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:44 devstack sudo[90364]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:44 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-49d4d5e8-3c2d-42f8-8814-b5681dd14276 tempest-VolumeDependencyTests-62967508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c76f694f-1303-4dfb-a828-182fab76443a.info" returned: 0 in 0.410s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:44 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-49d4d5e8-3c2d-42f8-8814-b5681dd14276 tempest-VolumeDependencyTests-62967508 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c76f694f-1303-4dfb-a828-182fab76443a.info is being set with open permissions: ugo+rw
Feb 27 01:30:44 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-49d4d5e8-3c2d-42f8-8814-b5681dd14276 tempest-VolumeDependencyTests-62967508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c76f694f-1303-4dfb-a828-182fab76443a.info {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:44 devstack sudo[90367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c76f694f-1303-4dfb-a828-182fab76443a.info
Feb 27 01:30:44 devstack sudo[90367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:44 devstack sudo[90367]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:44 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-49d4d5e8-3c2d-42f8-8814-b5681dd14276 tempest-VolumeDependencyTests-62967508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c76f694f-1303-4dfb-a828-182fab76443a.info" returned: 0 in 0.400s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:44 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-49d4d5e8-3c2d-42f8-8814-b5681dd14276 tempest-VolumeDependencyTests-62967508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.652s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:30:44 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-49d4d5e8-3c2d-42f8-8814-b5681dd14276 tempest-VolumeDependencyTests-62967508 None] Create snapshot completed successfully
Feb 27 01:30:45 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-f83e9155-c94c-4d79-9dcb-280374e59d3d tempest-VolumeDependencyTests-62967508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:30:45 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-f83e9155-c94c-4d79-9dcb-280374e59d3d tempest-VolumeDependencyTests-62967508 None] Flow 'volume_create_manager' (38ed4c6f-82c2-49f1-bcac-8a3e1301f50a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:30:45 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-f83e9155-c94c-4d79-9dcb-280374e59d3d tempest-VolumeDependencyTests-62967508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4496bf3e-9be8-438e-b32f-6ce9f37a361d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:45 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-f83e9155-c94c-4d79-9dcb-280374e59d3d tempest-VolumeDependencyTests-62967508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4496bf3e-9be8-438e-b32f-6ce9f37a361d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:30:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1642917230',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8d04c99-f6da-42f8-a531-e67d414c42db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c18c4fde6aff412eb2bce355ba1f067d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:30:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c1e99724-bb5b-40e0-94d9-2401e15b7ab3,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:30:45Z,use_quota=True,user_id='1298f0fc66d147688e7c2bbcdb6ed1bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:45 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-f83e9155-c94c-4d79-9dcb-280374e59d3d tempest-VolumeDependencyTests-62967508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (399724b1-94d7-4257-9756-692cb45c1a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:45 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-f83e9155-c94c-4d79-9dcb-280374e59d3d tempest-VolumeDependencyTests-62967508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (399724b1-94d7-4257-9756-692cb45c1a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:45 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-f83e9155-c94c-4d79-9dcb-280374e59d3d tempest-VolumeDependencyTests-62967508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da3f758c-9997-4aca-80fa-3c8924b5a7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:45 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-f83e9155-c94c-4d79-9dcb-280374e59d3d tempest-VolumeDependencyTests-62967508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da3f758c-9997-4aca-80fa-3c8924b5a7ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd8d04c99-f6da-42f8-a531-e67d414c42db', 'volume_name': 'volume-d8d04c99-f6da-42f8-a531-e67d414c42db', 'volume_size': 1, 'snapshot_id': 'c1e99724-bb5b-40e0-94d9-2401e15b7ab3'}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:45 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-f83e9155-c94c-4d79-9dcb-280374e59d3d tempest-VolumeDependencyTests-62967508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (936d587a-141a-42b2-8ad6-1a9125f2db25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:45 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-f83e9155-c94c-4d79-9dcb-280374e59d3d tempest-VolumeDependencyTests-62967508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (936d587a-141a-42b2-8ad6-1a9125f2db25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:45 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-f83e9155-c94c-4d79-9dcb-280374e59d3d tempest-VolumeDependencyTests-62967508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b9ea9ea-a71b-499e-b253-498a029a3e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:45 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-f83e9155-c94c-4d79-9dcb-280374e59d3d tempest-VolumeDependencyTests-62967508 None] Volume d8d04c99-f6da-42f8-a531-e67d414c42db: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d8d04c99-f6da-42f8-a531-e67d414c42db', 'volume_size': 1, 'snapshot_id': 'c1e99724-bb5b-40e0-94d9-2401e15b7ab3'}
Feb 27 01:30:45 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-f83e9155-c94c-4d79-9dcb-280374e59d3d tempest-VolumeDependencyTests-62967508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:30:45 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-f83e9155-c94c-4d79-9dcb-280374e59d3d tempest-VolumeDependencyTests-62967508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:30:45 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-f83e9155-c94c-4d79-9dcb-280374e59d3d tempest-VolumeDependencyTests-62967508 None] Acquiring lock "cinder-quobyte-c1e99724-bb5b-40e0-94d9-2401e15b7ab3-d8d04c99-f6da-42f8-a531-e67d414c42db" by "_create_volume_from_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:30:45 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-f83e9155-c94c-4d79-9dcb-280374e59d3d tempest-VolumeDependencyTests-62967508 None] Lock "cinder-quobyte-c1e99724-bb5b-40e0-94d9-2401e15b7ab3-d8d04c99-f6da-42f8-a531-e67d414c42db" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:30:45 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-f83e9155-c94c-4d79-9dcb-280374e59d3d tempest-VolumeDependencyTests-62967508 None] Creating volume d8d04c99-f6da-42f8-a531-e67d414c42db from snapshot c1e99724-bb5b-40e0-94d9-2401e15b7ab3 {{(pid=83106) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Feb 27 01:30:45 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-f83e9155-c94c-4d79-9dcb-280374e59d3d tempest-VolumeDependencyTests-62967508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:30:45 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-f83e9155-c94c-4d79-9dcb-280374e59d3d tempest-VolumeDependencyTests-62967508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:30:45 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-f83e9155-c94c-4d79-9dcb-280374e59d3d tempest-VolumeDependencyTests-62967508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:30:45 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-f83e9155-c94c-4d79-9dcb-280374e59d3d tempest-VolumeDependencyTests-62967508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:30:45 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-f83e9155-c94c-4d79-9dcb-280374e59d3d tempest-VolumeDependencyTests-62967508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:30:45 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-f83e9155-c94c-4d79-9dcb-280374e59d3d tempest-VolumeDependencyTests-62967508 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:30:45 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-f83e9155-c94c-4d79-9dcb-280374e59d3d tempest-VolumeDependencyTests-62967508 None] Acquiring lock "cinder-quobyte-d8d04c99-f6da-42f8-a531-e67d414c42db" by "_copy_volume_from_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:30:45 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-f83e9155-c94c-4d79-9dcb-280374e59d3d tempest-VolumeDependencyTests-62967508 None] Lock "cinder-quobyte-d8d04c99-f6da-42f8-a531-e67d414c42db" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:30:45 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-f83e9155-c94c-4d79-9dcb-280374e59d3d tempest-VolumeDependencyTests-62967508 None] snapshot: c1e99724-bb5b-40e0-94d9-2401e15b7ab3, volume: d8d04c99-f6da-42f8-a531-e67d414c42db,  {{(pid=83106) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Feb 27 01:30:45 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-f83e9155-c94c-4d79-9dcb-280374e59d3d tempest-VolumeDependencyTests-62967508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:30:45 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-f83e9155-c94c-4d79-9dcb-280374e59d3d tempest-VolumeDependencyTests-62967508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:30:45 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-f83e9155-c94c-4d79-9dcb-280374e59d3d tempest-VolumeDependencyTests-62967508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:30:45 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-f83e9155-c94c-4d79-9dcb-280374e59d3d tempest-VolumeDependencyTests-62967508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:30:45 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-f83e9155-c94c-4d79-9dcb-280374e59d3d tempest-VolumeDependencyTests-62967508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:30:45 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a56326b-3096-4798-b97e-444de84ffc32]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:30:45 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-f83e9155-c94c-4d79-9dcb-280374e59d3d tempest-VolumeDependencyTests-62967508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c76f694f-1303-4dfb-a828-182fab76443a.c1e99724-bb5b-40e0-94d9-2401e15b7ab3 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:45 devstack sudo[90370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c76f694f-1303-4dfb-a828-182fab76443a.c1e99724-bb5b-40e0-94d9-2401e15b7ab3
Feb 27 01:30:45 devstack sudo[90370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:46 devstack sudo[90370]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:46 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-f83e9155-c94c-4d79-9dcb-280374e59d3d tempest-VolumeDependencyTests-62967508 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c76f694f-1303-4dfb-a828-182fab76443a.c1e99724-bb5b-40e0-94d9-2401e15b7ab3" returned: 0 in 0.507s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:46 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-f83e9155-c94c-4d79-9dcb-280374e59d3d tempest-VolumeDependencyTests-62967508 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c76f694f-1303-4dfb-a828-182fab76443a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83106) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:30:46 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-f83e9155-c94c-4d79-9dcb-280374e59d3d tempest-VolumeDependencyTests-62967508 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c76f694f-1303-4dfb-a828-182fab76443a {{(pid=83106) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Feb 27 01:30:46 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-f83e9155-c94c-4d79-9dcb-280374e59d3d tempest-VolumeDependencyTests-62967508 None] Creating direct copy from snapshot {{(pid=83106) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Feb 27 01:30:46 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2113afe-efd6-41ca-a34c-4d702933540e]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:30:46 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-f83e9155-c94c-4d79-9dcb-280374e59d3d tempest-VolumeDependencyTests-62967508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c76f694f-1303-4dfb-a828-182fab76443a {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:46 devstack sudo[90375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c76f694f-1303-4dfb-a828-182fab76443a
Feb 27 01:30:46 devstack sudo[90375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:46 devstack sudo[90375]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:46 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-f83e9155-c94c-4d79-9dcb-280374e59d3d tempest-VolumeDependencyTests-62967508 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c76f694f-1303-4dfb-a828-182fab76443a" returned: 0 in 0.513s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:46 devstack cinder-volume[83106]: DEBUG cinder.utils [None req-f83e9155-c94c-4d79-9dcb-280374e59d3d tempest-VolumeDependencyTests-62967508 None] Path /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-d8d04c99-f6da-42f8-a531-e67d414c42db not found in is_blk_device check {{(pid=83106) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Feb 27 01:30:46 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-f83e9155-c94c-4d79-9dcb-280374e59d3d tempest-VolumeDependencyTests-62967508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c76f694f-1303-4dfb-a828-182fab76443a /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-d8d04c99-f6da-42f8-a531-e67d414c42db {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:46 devstack sudo[90380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c76f694f-1303-4dfb-a828-182fab76443a /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-d8d04c99-f6da-42f8-a531-e67d414c42db
Feb 27 01:30:46 devstack sudo[90380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:48 devstack sudo[90380]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:48 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-f83e9155-c94c-4d79-9dcb-280374e59d3d tempest-VolumeDependencyTests-62967508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c76f694f-1303-4dfb-a828-182fab76443a /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-d8d04c99-f6da-42f8-a531-e67d414c42db" returned: 0 in 2.052s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:48 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1bed7e-b2ad-446d-842a-ce4cb6f968d1]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:30:48 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-f83e9155-c94c-4d79-9dcb-280374e59d3d tempest-VolumeDependencyTests-62967508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c76f694f-1303-4dfb-a828-182fab76443a {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:48 devstack sudo[90392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c76f694f-1303-4dfb-a828-182fab76443a
Feb 27 01:30:48 devstack sudo[90392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:49 devstack sudo[90392]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-f83e9155-c94c-4d79-9dcb-280374e59d3d tempest-VolumeDependencyTests-62967508 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c76f694f-1303-4dfb-a828-182fab76443a" returned: 0 in 0.652s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:49 devstack cinder-volume[83106]: DEBUG cinder.image.image_utils [None req-f83e9155-c94c-4d79-9dcb-280374e59d3d tempest-VolumeDependencyTests-62967508 None] Image conversion details: src /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c76f694f-1303-4dfb-a828-182fab76443a, size 1024.00 MB, duration 2.05 sec, destination /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-d8d04c99-f6da-42f8-a531-e67d414c42db {{(pid=83106) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 27 01:30:49 devstack cinder-volume[83106]: INFO cinder.image.image_utils [None req-f83e9155-c94c-4d79-9dcb-280374e59d3d tempest-VolumeDependencyTests-62967508 None] Converted 1024.00 MB image at 498.68 MB/s
Feb 27 01:30:49 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-f83e9155-c94c-4d79-9dcb-280374e59d3d tempest-VolumeDependencyTests-62967508 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-d8d04c99-f6da-42f8-a531-e67d414c42db is being set with open permissions: ugo+rw
Feb 27 01:30:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-f83e9155-c94c-4d79-9dcb-280374e59d3d tempest-VolumeDependencyTests-62967508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-d8d04c99-f6da-42f8-a531-e67d414c42db {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:49 devstack sudo[90397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-d8d04c99-f6da-42f8-a531-e67d414c42db
Feb 27 01:30:49 devstack sudo[90397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:49 devstack sudo[90397]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-f83e9155-c94c-4d79-9dcb-280374e59d3d tempest-VolumeDependencyTests-62967508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-d8d04c99-f6da-42f8-a531-e67d414c42db" returned: 0 in 0.437s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:49 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-f83e9155-c94c-4d79-9dcb-280374e59d3d tempest-VolumeDependencyTests-62967508 None] Lock "cinder-quobyte-d8d04c99-f6da-42f8-a531-e67d414c42db" released by "_copy_volume_from_snapshot" :: held 4.221s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:30:49 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-f83e9155-c94c-4d79-9dcb-280374e59d3d tempest-VolumeDependencyTests-62967508 None] Lock "cinder-quobyte-c1e99724-bb5b-40e0-94d9-2401e15b7ab3-d8d04c99-f6da-42f8-a531-e67d414c42db" released by "_create_volume_from_snapshot" :: held 4.240s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:30:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-f83e9155-c94c-4d79-9dcb-280374e59d3d tempest-VolumeDependencyTests-62967508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.249s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:30:49 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-f83e9155-c94c-4d79-9dcb-280374e59d3d tempest-VolumeDependencyTests-62967508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b9ea9ea-a71b-499e-b253-498a029a3e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8d04c99-f6da-42f8-a531-e67d414c42db', 'volume_size': 1, 'snapshot_id': 'c1e99724-bb5b-40e0-94d9-2401e15b7ab3'}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:49 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-f83e9155-c94c-4d79-9dcb-280374e59d3d tempest-VolumeDependencyTests-62967508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42ecf16e-11e2-4032-8ba4-8373ca39d208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:49 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-f83e9155-c94c-4d79-9dcb-280374e59d3d tempest-VolumeDependencyTests-62967508 None] Volume volume-d8d04c99-f6da-42f8-a531-e67d414c42db (d8d04c99-f6da-42f8-a531-e67d414c42db): created successfully
Feb 27 01:30:49 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-f83e9155-c94c-4d79-9dcb-280374e59d3d tempest-VolumeDependencyTests-62967508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42ecf16e-11e2-4032-8ba4-8373ca39d208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:49 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-f83e9155-c94c-4d79-9dcb-280374e59d3d tempest-VolumeDependencyTests-62967508 None] Flow 'volume_create_manager' (38ed4c6f-82c2-49f1-bcac-8a3e1301f50a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:30:49 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-f83e9155-c94c-4d79-9dcb-280374e59d3d tempest-VolumeDependencyTests-62967508 None] Created volume successfully.
Feb 27 01:30:50 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-0da1448b-e508-4a1d-a595-3b877d34ee6c tempest-VolumeDependencyTests-62967508 None] Acquiring lock "cinder-c1e99724-bb5b-40e0-94d9-2401e15b7ab3-delete_snapshot" by "delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:30:50 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-0da1448b-e508-4a1d-a595-3b877d34ee6c tempest-VolumeDependencyTests-62967508 None] Lock "cinder-c1e99724-bb5b-40e0-94d9-2401e15b7ab3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:30:50 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-0da1448b-e508-4a1d-a595-3b877d34ee6c tempest-VolumeDependencyTests-62967508 None] Acquiring lock "cinder-quobyte-c76f694f-1303-4dfb-a828-182fab76443a" by "delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:30:50 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-0da1448b-e508-4a1d-a595-3b877d34ee6c tempest-VolumeDependencyTests-62967508 None] Lock "cinder-quobyte-c76f694f-1303-4dfb-a828-182fab76443a" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:30:50 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-0da1448b-e508-4a1d-a595-3b877d34ee6c tempest-VolumeDependencyTests-62967508 None] Acquiring lock "cinder-quobyte-c1e99724-bb5b-40e0-94d9-2401e15b7ab3" by "_delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:30:50 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-0da1448b-e508-4a1d-a595-3b877d34ee6c tempest-VolumeDependencyTests-62967508 None] Lock "cinder-quobyte-c1e99724-bb5b-40e0-94d9-2401e15b7ab3" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:30:50 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-0da1448b-e508-4a1d-a595-3b877d34ee6c tempest-VolumeDependencyTests-62967508 None] Deleting offline snapshot c1e99724-bb5b-40e0-94d9-2401e15b7ab3 of volume c76f694f-1303-4dfb-a828-182fab76443a {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:30:50 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-0da1448b-e508-4a1d-a595-3b877d34ee6c tempest-VolumeDependencyTests-62967508 None] snapshot_file for this snap is: volume-c76f694f-1303-4dfb-a828-182fab76443a.c1e99724-bb5b-40e0-94d9-2401e15b7ab3 {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:30:50 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23ec330-a347-4391-983f-e02c25c3872a]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:30:50 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0da1448b-e508-4a1d-a595-3b877d34ee6c tempest-VolumeDependencyTests-62967508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c76f694f-1303-4dfb-a828-182fab76443a.c1e99724-bb5b-40e0-94d9-2401e15b7ab3 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:50 devstack sudo[90400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c76f694f-1303-4dfb-a828-182fab76443a.c1e99724-bb5b-40e0-94d9-2401e15b7ab3
Feb 27 01:30:50 devstack sudo[90400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:51 devstack sudo[90400]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:51 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0da1448b-e508-4a1d-a595-3b877d34ee6c tempest-VolumeDependencyTests-62967508 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c76f694f-1303-4dfb-a828-182fab76443a.c1e99724-bb5b-40e0-94d9-2401e15b7ab3" returned: 0 in 0.488s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:51 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-0da1448b-e508-4a1d-a595-3b877d34ee6c tempest-VolumeDependencyTests-62967508 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c76f694f-1303-4dfb-a828-182fab76443a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83106) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:30:51 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fbe7b68-28a5-47b3-a8bc-b4c8bf9a92f3]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:30:51 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0da1448b-e508-4a1d-a595-3b877d34ee6c tempest-VolumeDependencyTests-62967508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c76f694f-1303-4dfb-a828-182fab76443a {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:51 devstack sudo[90405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c76f694f-1303-4dfb-a828-182fab76443a
Feb 27 01:30:51 devstack sudo[90405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:51 devstack sudo[90405]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:51 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0da1448b-e508-4a1d-a595-3b877d34ee6c tempest-VolumeDependencyTests-62967508 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c76f694f-1303-4dfb-a828-182fab76443a" returned: 0 in 0.526s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:51 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0da1448b-e508-4a1d-a595-3b877d34ee6c tempest-VolumeDependencyTests-62967508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c76f694f-1303-4dfb-a828-182fab76443a.c1e99724-bb5b-40e0-94d9-2401e15b7ab3 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:51 devstack sudo[90410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c76f694f-1303-4dfb-a828-182fab76443a.c1e99724-bb5b-40e0-94d9-2401e15b7ab3
Feb 27 01:30:51 devstack sudo[90410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:52 devstack sudo[90410]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:52 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0da1448b-e508-4a1d-a595-3b877d34ee6c tempest-VolumeDependencyTests-62967508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c76f694f-1303-4dfb-a828-182fab76443a.c1e99724-bb5b-40e0-94d9-2401e15b7ab3" returned: 0 in 0.460s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:52 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0da1448b-e508-4a1d-a595-3b877d34ee6c tempest-VolumeDependencyTests-62967508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c76f694f-1303-4dfb-a828-182fab76443a.c1e99724-bb5b-40e0-94d9-2401e15b7ab3 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:52 devstack sudo[90415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c76f694f-1303-4dfb-a828-182fab76443a.c1e99724-bb5b-40e0-94d9-2401e15b7ab3
Feb 27 01:30:52 devstack sudo[90415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:52 devstack sudo[90415]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:52 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0da1448b-e508-4a1d-a595-3b877d34ee6c tempest-VolumeDependencyTests-62967508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c76f694f-1303-4dfb-a828-182fab76443a.c1e99724-bb5b-40e0-94d9-2401e15b7ab3" returned: 0 in 0.490s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:52 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-0da1448b-e508-4a1d-a595-3b877d34ee6c tempest-VolumeDependencyTests-62967508 None] Lock "cinder-quobyte-c1e99724-bb5b-40e0-94d9-2401e15b7ab3" released by "_delete_snapshot" :: held 2.024s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:30:52 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-0da1448b-e508-4a1d-a595-3b877d34ee6c tempest-VolumeDependencyTests-62967508 None] Lock "cinder-quobyte-c76f694f-1303-4dfb-a828-182fab76443a" released by "delete_snapshot" :: held 2.039s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:30:52 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-0da1448b-e508-4a1d-a595-3b877d34ee6c tempest-VolumeDependencyTests-62967508 None] Created reservations ['83594cdf-e0b3-4f59-8716-96e0d9fdaf70', 'ab027c1a-f88f-4264-a9d9-8f3f7a5b9f96', 'eb69c87f-9543-4a26-a7d6-defaf9e096b8', 'da94f67c-a0f6-4f2f-b64b-ce1a1a034892'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:30:52 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-0da1448b-e508-4a1d-a595-3b877d34ee6c tempest-VolumeDependencyTests-62967508 None] Delete snapshot completed successfully.
Feb 27 01:30:52 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-0da1448b-e508-4a1d-a595-3b877d34ee6c tempest-VolumeDependencyTests-62967508 None] Lock "cinder-c1e99724-bb5b-40e0-94d9-2401e15b7ab3-delete_snapshot" released by "delete_snapshot" :: held 2.130s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:30:53 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-57dff227-2d2a-44fa-958a-f79a36304af6 tempest-VolumeDependencyTests-62967508 None] Acquiring lock "cinder-c76f694f-1303-4dfb-a828-182fab76443a-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:30:54 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-57dff227-2d2a-44fa-958a-f79a36304af6 tempest-VolumeDependencyTests-62967508 None] Lock "cinder-c76f694f-1303-4dfb-a828-182fab76443a-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:30:54 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-57dff227-2d2a-44fa-958a-f79a36304af6 tempest-VolumeDependencyTests-62967508 None] Acquiring lock "cinder-quobyte-c76f694f-1303-4dfb-a828-182fab76443a" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:30:54 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-57dff227-2d2a-44fa-958a-f79a36304af6 tempest-VolumeDependencyTests-62967508 None] Lock "cinder-quobyte-c76f694f-1303-4dfb-a828-182fab76443a" acquired by "delete_volume" :: waited 0.008s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:30:54 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eec1eb1-e94f-4cad-af7e-4ce223e1d2bf]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:30:54 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-57dff227-2d2a-44fa-958a-f79a36304af6 tempest-VolumeDependencyTests-62967508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c76f694f-1303-4dfb-a828-182fab76443a {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:54 devstack sudo[90421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c76f694f-1303-4dfb-a828-182fab76443a
Feb 27 01:30:54 devstack sudo[90421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:54 devstack sudo[90421]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:54 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-57dff227-2d2a-44fa-958a-f79a36304af6 tempest-VolumeDependencyTests-62967508 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c76f694f-1303-4dfb-a828-182fab76443a" returned: 0 in 0.528s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:54 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-57dff227-2d2a-44fa-958a-f79a36304af6 tempest-VolumeDependencyTests-62967508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c76f694f-1303-4dfb-a828-182fab76443a {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:54 devstack sudo[90426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c76f694f-1303-4dfb-a828-182fab76443a
Feb 27 01:30:54 devstack sudo[90426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:55 devstack sudo[90426]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-57dff227-2d2a-44fa-958a-f79a36304af6 tempest-VolumeDependencyTests-62967508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c76f694f-1303-4dfb-a828-182fab76443a" returned: 0 in 0.507s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:55 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-57dff227-2d2a-44fa-958a-f79a36304af6 tempest-VolumeDependencyTests-62967508 None] Lock "cinder-quobyte-c76f694f-1303-4dfb-a828-182fab76443a" released by "delete_volume" :: held 1.075s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:30:55 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-57dff227-2d2a-44fa-958a-f79a36304af6 tempest-VolumeDependencyTests-62967508 None] Created reservations ['4134e294-c20b-4708-b405-5d3d8eca13f5', '2432db4e-823a-4e76-beb8-1cb57419ed1f', '7cb676da-c70d-4389-8cd9-c63e50f187bd', '07edcbc6-776e-4835-aa6c-407b2f62bde3'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:30:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-57dff227-2d2a-44fa-958a-f79a36304af6 tempest-VolumeDependencyTests-62967508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:30:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-57dff227-2d2a-44fa-958a-f79a36304af6 tempest-VolumeDependencyTests-62967508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:30:55 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-57dff227-2d2a-44fa-958a-f79a36304af6 tempest-VolumeDependencyTests-62967508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:30:55 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-57dff227-2d2a-44fa-958a-f79a36304af6 tempest-VolumeDependencyTests-62967508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:30:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-57dff227-2d2a-44fa-958a-f79a36304af6 tempest-VolumeDependencyTests-62967508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:30:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-57dff227-2d2a-44fa-958a-f79a36304af6 tempest-VolumeDependencyTests-62967508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:55 devstack sudo[90429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:30:55 devstack sudo[90429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:55 devstack sudo[90429]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-57dff227-2d2a-44fa-958a-f79a36304af6 tempest-VolumeDependencyTests-62967508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.444s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:55 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-57dff227-2d2a-44fa-958a-f79a36304af6 tempest-VolumeDependencyTests-62967508 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:30:55 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-57dff227-2d2a-44fa-958a-f79a36304af6 tempest-VolumeDependencyTests-62967508 None] Deleted volume successfully.
Feb 27 01:30:55 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-57dff227-2d2a-44fa-958a-f79a36304af6 tempest-VolumeDependencyTests-62967508 None] Lock "cinder-c76f694f-1303-4dfb-a828-182fab76443a-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:30:56 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-3909c0da-376b-488c-839d-56f5ebcc0738 tempest-VolumeDependencyTests-62967508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:30:56 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-3909c0da-376b-488c-839d-56f5ebcc0738 tempest-VolumeDependencyTests-62967508 None] Flow 'volume_create_manager' (53567660-11d5-425c-8108-48a0c64c0f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:30:56 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-3909c0da-376b-488c-839d-56f5ebcc0738 tempest-VolumeDependencyTests-62967508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf558ad9-ea01-4f20-8487-751be0765086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:56 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-3909c0da-376b-488c-839d-56f5ebcc0738 tempest-VolumeDependencyTests-62967508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf558ad9-ea01-4f20-8487-751be0765086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:30:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-243298981',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5165008-9684-462c-ae75-17451963e6f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c18c4fde6aff412eb2bce355ba1f067d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:30:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:30:56Z,use_quota=True,user_id='1298f0fc66d147688e7c2bbcdb6ed1bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:56 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-3909c0da-376b-488c-839d-56f5ebcc0738 tempest-VolumeDependencyTests-62967508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd454395-689c-47b9-a0c8-8f0d24bb2af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:56 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-3909c0da-376b-488c-839d-56f5ebcc0738 tempest-VolumeDependencyTests-62967508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd454395-689c-47b9-a0c8-8f0d24bb2af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:56 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-3909c0da-376b-488c-839d-56f5ebcc0738 tempest-VolumeDependencyTests-62967508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (645186d1-722c-46b8-923c-a25b41791053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:56 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-3909c0da-376b-488c-839d-56f5ebcc0738 tempest-VolumeDependencyTests-62967508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (645186d1-722c-46b8-923c-a25b41791053) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5165008-9684-462c-ae75-17451963e6f3', 'volume_name': 'volume-f5165008-9684-462c-ae75-17451963e6f3', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:56 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-3909c0da-376b-488c-839d-56f5ebcc0738 tempest-VolumeDependencyTests-62967508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cce4dba3-6d60-47ca-a955-c9596c186c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:56 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-3909c0da-376b-488c-839d-56f5ebcc0738 tempest-VolumeDependencyTests-62967508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cce4dba3-6d60-47ca-a955-c9596c186c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:56 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-3909c0da-376b-488c-839d-56f5ebcc0738 tempest-VolumeDependencyTests-62967508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (975edd8e-5af7-4fab-81ec-879d04a37800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:56 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-3909c0da-376b-488c-839d-56f5ebcc0738 tempest-VolumeDependencyTests-62967508 None] Volume f5165008-9684-462c-ae75-17451963e6f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5165008-9684-462c-ae75-17451963e6f3', 'volume_size': 1}
Feb 27 01:30:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-3909c0da-376b-488c-839d-56f5ebcc0738 tempest-VolumeDependencyTests-62967508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:30:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-3909c0da-376b-488c-839d-56f5ebcc0738 tempest-VolumeDependencyTests-62967508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:30:56 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-3909c0da-376b-488c-839d-56f5ebcc0738 tempest-VolumeDependencyTests-62967508 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:30:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-243298981',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5165008-9684-462c-ae75-17451963e6f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c18c4fde6aff412eb2bce355ba1f067d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:30:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:30:56Z,use_quota=True,user_id='1298f0fc66d147688e7c2bbcdb6ed1bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:30:56 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-3909c0da-376b-488c-839d-56f5ebcc0738 tempest-VolumeDependencyTests-62967508 None] Creating volume f5165008-9684-462c-ae75-17451963e6f3 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:30:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-3909c0da-376b-488c-839d-56f5ebcc0738 tempest-VolumeDependencyTests-62967508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:30:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-3909c0da-376b-488c-839d-56f5ebcc0738 tempest-VolumeDependencyTests-62967508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:30:56 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-3909c0da-376b-488c-839d-56f5ebcc0738 tempest-VolumeDependencyTests-62967508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:30:56 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-3909c0da-376b-488c-839d-56f5ebcc0738 tempest-VolumeDependencyTests-62967508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:30:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-3909c0da-376b-488c-839d-56f5ebcc0738 tempest-VolumeDependencyTests-62967508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:30:56 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-3909c0da-376b-488c-839d-56f5ebcc0738 tempest-VolumeDependencyTests-62967508 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:30:56 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-3909c0da-376b-488c-839d-56f5ebcc0738 tempest-VolumeDependencyTests-62967508 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:30:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-3909c0da-376b-488c-839d-56f5ebcc0738 tempest-VolumeDependencyTests-62967508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f5165008-9684-462c-ae75-17451963e6f3 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:56 devstack sudo[90432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f5165008-9684-462c-ae75-17451963e6f3 1073741824
Feb 27 01:30:56 devstack sudo[90432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:56 devstack cinder-volume[83106]: DEBUG oslo_service.periodic_task [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83106) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Feb 27 01:30:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:30:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:30:56 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:30:56 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:30:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:30:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:56 devstack sudo[90437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:30:56 devstack sudo[90437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:57 devstack sudo[90432]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-3909c0da-376b-488c-839d-56f5ebcc0738 tempest-VolumeDependencyTests-62967508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f5165008-9684-462c-ae75-17451963e6f3 1073741824" returned: 0 in 0.526s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-3909c0da-376b-488c-839d-56f5ebcc0738 tempest-VolumeDependencyTests-62967508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f5165008-9684-462c-ae75-17451963e6f3 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:57 devstack sudo[90439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f5165008-9684-462c-ae75-17451963e6f3
Feb 27 01:30:57 devstack sudo[90439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:57 devstack sudo[90437]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.478s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:57 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:30:57 devstack sudo[90439]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-3909c0da-376b-488c-839d-56f5ebcc0738 tempest-VolumeDependencyTests-62967508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f5165008-9684-462c-ae75-17451963e6f3" returned: 0 in 0.460s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:57 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-3909c0da-376b-488c-839d-56f5ebcc0738 tempest-VolumeDependencyTests-62967508 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:30:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-3909c0da-376b-488c-839d-56f5ebcc0738 tempest-VolumeDependencyTests-62967508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:30:57 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-3909c0da-376b-488c-839d-56f5ebcc0738 tempest-VolumeDependencyTests-62967508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (975edd8e-5af7-4fab-81ec-879d04a37800) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5165008-9684-462c-ae75-17451963e6f3', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:57 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-3909c0da-376b-488c-839d-56f5ebcc0738 tempest-VolumeDependencyTests-62967508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fff55432-7633-4efa-a671-752230dc7e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:57 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-3909c0da-376b-488c-839d-56f5ebcc0738 tempest-VolumeDependencyTests-62967508 None] Volume volume-f5165008-9684-462c-ae75-17451963e6f3 (f5165008-9684-462c-ae75-17451963e6f3): created successfully
Feb 27 01:30:57 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-3909c0da-376b-488c-839d-56f5ebcc0738 tempest-VolumeDependencyTests-62967508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fff55432-7633-4efa-a671-752230dc7e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:57 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-3909c0da-376b-488c-839d-56f5ebcc0738 tempest-VolumeDependencyTests-62967508 None] Flow 'volume_create_manager' (53567660-11d5-425c-8108-48a0c64c0f4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:30:57 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-3909c0da-376b-488c-839d-56f5ebcc0738 tempest-VolumeDependencyTests-62967508 None] Created volume successfully.
Feb 27 01:30:58 devstack cinder-volume[83106]: DEBUG dbcounter [-] [83106] Writing DB stats cinder:SELECT=107,cinder:INSERT=32,cinder:UPDATE=124,cinder:DELETE=13 {{(pid=83106) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 01:30:58 devstack cinder-volume[83106]: DEBUG dbcounter [-] [83106] Writing DB stats cinder:SELECT=88,cinder:UPDATE=136,cinder:INSERT=32,cinder:DELETE=10 {{(pid=83106) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 01:30:58 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:30:58 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] Flow 'volume_create_manager' (f6b764b0-4e37-4633-8f95-15a6505bfec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:30:58 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a611cad0-2968-4b93-9738-1a432880cef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:58 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a611cad0-2968-4b93-9738-1a432880cef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:30:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1524504128',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2b49da8-8ecc-40f9-8a4d-7273a7a543e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c18c4fde6aff412eb2bce355ba1f067d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:30:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=f5165008-9684-462c-ae75-17451963e6f3,status='creating',terminated_at=None,updated_at=2026-02-27T00:30:59Z,use_quota=True,user_id='1298f0fc66d147688e7c2bbcdb6ed1bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:58 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1726f50-925c-453f-9965-7a0a6bc1ff8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:58 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1726f50-925c-453f-9965-7a0a6bc1ff8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:58 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25f57076-4b3d-4ea4-bb20-9ccf7ee94236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:58 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25f57076-4b3d-4ea4-bb20-9ccf7ee94236) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'd2b49da8-8ecc-40f9-8a4d-7273a7a543e2', 'volume_name': 'volume-d2b49da8-8ecc-40f9-8a4d-7273a7a543e2', 'volume_size': 1, 'source_volid': 'f5165008-9684-462c-ae75-17451963e6f3', 'source_volstatus': 'available'}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:58 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b401cbfa-6b48-47bf-86b9-1a97f1d41a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:58 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b401cbfa-6b48-47bf-86b9-1a97f1d41a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:30:58 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98dd6b4c-456c-4f5b-8cf0-1ba7007d7ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:30:58 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] Volume d2b49da8-8ecc-40f9-8a4d-7273a7a543e2: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-d2b49da8-8ecc-40f9-8a4d-7273a7a543e2', 'volume_size': 1, 'source_volid': 'f5165008-9684-462c-ae75-17451963e6f3', 'source_volstatus': 'available'}
Feb 27 01:30:58 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:30:58 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:30:58 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] Cloning volume f5165008-9684-462c-ae75-17451963e6f3 to volume d2b49da8-8ecc-40f9-8a4d-7273a7a543e2
Feb 27 01:30:58 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] Creating offline snapshot 05cd7cfb-ede3-4dad-9116-fd82459b481b of volume f5165008-9684-462c-ae75-17451963e6f3 {{(pid=83106) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:30:58 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[2385b7bd-ba96-4caa-a4be-cf4b4dd70c82]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:30:58 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f5165008-9684-462c-ae75-17451963e6f3 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:59 devstack sudo[90443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f5165008-9684-462c-ae75-17451963e6f3
Feb 27 01:30:59 devstack sudo[90443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:59 devstack sudo[90443]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:59 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f5165008-9684-462c-ae75-17451963e6f3" returned: 0 in 0.495s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:59 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f5165008-9684-462c-ae75-17451963e6f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f5165008-9684-462c-ae75-17451963e6f3.05cd7cfb-ede3-4dad-9116-fd82459b481b 1G {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:30:59 devstack sudo[90448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f5165008-9684-462c-ae75-17451963e6f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f5165008-9684-462c-ae75-17451963e6f3.05cd7cfb-ede3-4dad-9116-fd82459b481b 1G
Feb 27 01:30:59 devstack sudo[90448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:30:59 devstack sudo[90448]: pam_unix(sudo:session): session closed for user root
Feb 27 01:30:59 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f5165008-9684-462c-ae75-17451963e6f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f5165008-9684-462c-ae75-17451963e6f3.05cd7cfb-ede3-4dad-9116-fd82459b481b 1G" returned: 0 in 0.504s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:30:59 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5165008-9684-462c-ae75-17451963e6f3 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f5165008-9684-462c-ae75-17451963e6f3.05cd7cfb-ede3-4dad-9116-fd82459b481b {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:00 devstack sudo[90453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5165008-9684-462c-ae75-17451963e6f3 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f5165008-9684-462c-ae75-17451963e6f3.05cd7cfb-ede3-4dad-9116-fd82459b481b
Feb 27 01:31:00 devstack sudo[90453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:00 devstack sudo[90453]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:00 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5165008-9684-462c-ae75-17451963e6f3 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f5165008-9684-462c-ae75-17451963e6f3.05cd7cfb-ede3-4dad-9116-fd82459b481b" returned: 0 in 0.506s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:00 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f5165008-9684-462c-ae75-17451963e6f3.05cd7cfb-ede3-4dad-9116-fd82459b481b is being set with open permissions: ugo+rw
Feb 27 01:31:00 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f5165008-9684-462c-ae75-17451963e6f3.05cd7cfb-ede3-4dad-9116-fd82459b481b {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:00 devstack sudo[90459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f5165008-9684-462c-ae75-17451963e6f3.05cd7cfb-ede3-4dad-9116-fd82459b481b
Feb 27 01:31:00 devstack sudo[90459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:00 devstack sudo[90459]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:00 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f5165008-9684-462c-ae75-17451963e6f3.05cd7cfb-ede3-4dad-9116-fd82459b481b" returned: 0 in 0.391s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:00 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f5165008-9684-462c-ae75-17451963e6f3.info {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:00 devstack sudo[90467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f5165008-9684-462c-ae75-17451963e6f3.info
Feb 27 01:31:00 devstack sudo[90467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:01 devstack sudo[90467]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:01 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f5165008-9684-462c-ae75-17451963e6f3.info" returned: 0 in 0.522s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:01 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f5165008-9684-462c-ae75-17451963e6f3.info is being set with open permissions: ugo+rw
Feb 27 01:31:01 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f5165008-9684-462c-ae75-17451963e6f3.info {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:01 devstack sudo[90470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f5165008-9684-462c-ae75-17451963e6f3.info
Feb 27 01:31:01 devstack sudo[90470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:01 devstack sudo[90470]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:01 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f5165008-9684-462c-ae75-17451963e6f3.info" returned: 0 in 0.492s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:01 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] Acquiring lock "cinder-quobyte-d2b49da8-8ecc-40f9-8a4d-7273a7a543e2" by "_copy_volume_from_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:31:01 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] Lock "cinder-quobyte-d2b49da8-8ecc-40f9-8a4d-7273a7a543e2" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:31:01 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] snapshot: 05cd7cfb-ede3-4dad-9116-fd82459b481b, volume: d2b49da8-8ecc-40f9-8a4d-7273a7a543e2,  {{(pid=83106) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Feb 27 01:31:01 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:01 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:01 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:31:01 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:31:01 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:01 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93f487b-9bf0-41dc-bdfc-375850693faf]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:31:01 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f5165008-9684-462c-ae75-17451963e6f3.05cd7cfb-ede3-4dad-9116-fd82459b481b {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:02 devstack sudo[90507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f5165008-9684-462c-ae75-17451963e6f3.05cd7cfb-ede3-4dad-9116-fd82459b481b
Feb 27 01:31:02 devstack sudo[90507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:02 devstack sudo[90507]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:02 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f5165008-9684-462c-ae75-17451963e6f3.05cd7cfb-ede3-4dad-9116-fd82459b481b" returned: 0 in 0.596s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:02 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5165008-9684-462c-ae75-17451963e6f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83106) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:31:02 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f5165008-9684-462c-ae75-17451963e6f3 {{(pid=83106) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Feb 27 01:31:02 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] Creating direct copy from snapshot {{(pid=83106) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Feb 27 01:31:02 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[8056a057-6a84-48ba-a796-695938a41078]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:31:02 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f5165008-9684-462c-ae75-17451963e6f3 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:02 devstack sudo[90512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f5165008-9684-462c-ae75-17451963e6f3
Feb 27 01:31:02 devstack sudo[90512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:03 devstack sudo[90512]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:03 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f5165008-9684-462c-ae75-17451963e6f3" returned: 0 in 0.589s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:03 devstack cinder-volume[83106]: DEBUG cinder.utils [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] Path /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-d2b49da8-8ecc-40f9-8a4d-7273a7a543e2 not found in is_blk_device check {{(pid=83106) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Feb 27 01:31:03 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f5165008-9684-462c-ae75-17451963e6f3 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-d2b49da8-8ecc-40f9-8a4d-7273a7a543e2 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:03 devstack sudo[90519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f5165008-9684-462c-ae75-17451963e6f3 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-d2b49da8-8ecc-40f9-8a4d-7273a7a543e2
Feb 27 01:31:03 devstack sudo[90519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:05 devstack sudo[90519]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:05 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f5165008-9684-462c-ae75-17451963e6f3 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-d2b49da8-8ecc-40f9-8a4d-7273a7a543e2" returned: 0 in 2.141s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:05 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[8524d37d-9d89-4c9e-a72f-ae2d0d3f0d65]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:31:05 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f5165008-9684-462c-ae75-17451963e6f3 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:05 devstack sudo[90531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f5165008-9684-462c-ae75-17451963e6f3
Feb 27 01:31:05 devstack sudo[90531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:05 devstack sudo[90531]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:05 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f5165008-9684-462c-ae75-17451963e6f3" returned: 0 in 0.652s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:05 devstack cinder-volume[83106]: DEBUG cinder.image.image_utils [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] Image conversion details: src /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f5165008-9684-462c-ae75-17451963e6f3, size 1024.00 MB, duration 2.14 sec, destination /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-d2b49da8-8ecc-40f9-8a4d-7273a7a543e2 {{(pid=83106) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 27 01:31:05 devstack cinder-volume[83106]: INFO cinder.image.image_utils [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] Converted 1024.00 MB image at 477.88 MB/s
Feb 27 01:31:05 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-d2b49da8-8ecc-40f9-8a4d-7273a7a543e2 is being set with open permissions: ugo+rw
Feb 27 01:31:05 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-d2b49da8-8ecc-40f9-8a4d-7273a7a543e2 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:06 devstack sudo[90536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-d2b49da8-8ecc-40f9-8a4d-7273a7a543e2
Feb 27 01:31:06 devstack sudo[90536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:06 devstack sudo[90536]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:06 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-d2b49da8-8ecc-40f9-8a4d-7273a7a543e2" returned: 0 in 0.479s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:06 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] Lock "cinder-quobyte-d2b49da8-8ecc-40f9-8a4d-7273a7a543e2" released by "_copy_volume_from_snapshot" :: held 4.528s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:31:06 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] Acquiring lock "cinder-quobyte-05cd7cfb-ede3-4dad-9116-fd82459b481b" by "_delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:31:06 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] Lock "cinder-quobyte-05cd7cfb-ede3-4dad-9116-fd82459b481b" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:31:06 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] Deleting offline snapshot 05cd7cfb-ede3-4dad-9116-fd82459b481b of volume f5165008-9684-462c-ae75-17451963e6f3 {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:31:06 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] snapshot_file for this snap is: volume-f5165008-9684-462c-ae75-17451963e6f3.05cd7cfb-ede3-4dad-9116-fd82459b481b {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:31:06 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30ccf58-d7c8-4cbe-9863-c4377c6302ba]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:31:06 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f5165008-9684-462c-ae75-17451963e6f3.05cd7cfb-ede3-4dad-9116-fd82459b481b {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:06 devstack sudo[90539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f5165008-9684-462c-ae75-17451963e6f3.05cd7cfb-ede3-4dad-9116-fd82459b481b
Feb 27 01:31:06 devstack sudo[90539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:07 devstack sudo[90539]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:07 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f5165008-9684-462c-ae75-17451963e6f3.05cd7cfb-ede3-4dad-9116-fd82459b481b" returned: 0 in 0.547s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:07 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5165008-9684-462c-ae75-17451963e6f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83106) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:31:07 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb97701-8b59-4dca-bf8f-8f6994e980a4]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:31:07 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f5165008-9684-462c-ae75-17451963e6f3 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:07 devstack sudo[90544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f5165008-9684-462c-ae75-17451963e6f3
Feb 27 01:31:07 devstack sudo[90544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:07 devstack sudo[90544]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:07 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f5165008-9684-462c-ae75-17451963e6f3" returned: 0 in 0.500s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:07 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f5165008-9684-462c-ae75-17451963e6f3.05cd7cfb-ede3-4dad-9116-fd82459b481b {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:07 devstack sudo[90549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f5165008-9684-462c-ae75-17451963e6f3.05cd7cfb-ede3-4dad-9116-fd82459b481b
Feb 27 01:31:07 devstack sudo[90549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:08 devstack sudo[90549]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:08 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f5165008-9684-462c-ae75-17451963e6f3.05cd7cfb-ede3-4dad-9116-fd82459b481b" returned: 0 in 0.432s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:08 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f5165008-9684-462c-ae75-17451963e6f3.05cd7cfb-ede3-4dad-9116-fd82459b481b {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:08 devstack sudo[90554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f5165008-9684-462c-ae75-17451963e6f3.05cd7cfb-ede3-4dad-9116-fd82459b481b
Feb 27 01:31:08 devstack sudo[90554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:08 devstack sudo[90554]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:08 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f5165008-9684-462c-ae75-17451963e6f3.05cd7cfb-ede3-4dad-9116-fd82459b481b" returned: 0 in 0.384s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:08 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] Lock "cinder-quobyte-05cd7cfb-ede3-4dad-9116-fd82459b481b" released by "_delete_snapshot" :: held 1.922s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:31:08 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.494s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:08 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98dd6b4c-456c-4f5b-8cf0-1ba7007d7ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2b49da8-8ecc-40f9-8a4d-7273a7a543e2', 'volume_size': 1, 'source_volid': 'f5165008-9684-462c-ae75-17451963e6f3', 'source_volstatus': 'available'}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:08 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (850b41b9-e667-4536-b8ec-407b1a25f8a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:08 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] Volume volume-d2b49da8-8ecc-40f9-8a4d-7273a7a543e2 (d2b49da8-8ecc-40f9-8a4d-7273a7a543e2): created successfully
Feb 27 01:31:08 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (850b41b9-e667-4536-b8ec-407b1a25f8a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:08 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] Flow 'volume_create_manager' (f6b764b0-4e37-4633-8f95-15a6505bfec1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:31:08 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-12c662fa-ebc0-47dd-8ce7-efc44ef7d505 tempest-VolumeDependencyTests-62967508 None] Created volume successfully.
Feb 27 01:31:09 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-3e44a7b0-1e5e-48e5-b1a9-83f992980ef8 tempest-VolumeDependencyTests-62967508 None] Acquiring lock "cinder-f5165008-9684-462c-ae75-17451963e6f3-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:31:09 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-3e44a7b0-1e5e-48e5-b1a9-83f992980ef8 tempest-VolumeDependencyTests-62967508 None] Lock "cinder-f5165008-9684-462c-ae75-17451963e6f3-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:31:09 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-3e44a7b0-1e5e-48e5-b1a9-83f992980ef8 tempest-VolumeDependencyTests-62967508 None] Acquiring lock "cinder-quobyte-f5165008-9684-462c-ae75-17451963e6f3" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:31:09 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-3e44a7b0-1e5e-48e5-b1a9-83f992980ef8 tempest-VolumeDependencyTests-62967508 None] Lock "cinder-quobyte-f5165008-9684-462c-ae75-17451963e6f3" acquired by "delete_volume" :: waited 0.007s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:31:09 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe68766-4c79-499e-9a06-48d72ba97b34]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:31:09 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-3e44a7b0-1e5e-48e5-b1a9-83f992980ef8 tempest-VolumeDependencyTests-62967508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f5165008-9684-462c-ae75-17451963e6f3 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:09 devstack sudo[90557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f5165008-9684-462c-ae75-17451963e6f3
Feb 27 01:31:09 devstack sudo[90557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:10 devstack sudo[90557]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:10 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-3e44a7b0-1e5e-48e5-b1a9-83f992980ef8 tempest-VolumeDependencyTests-62967508 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f5165008-9684-462c-ae75-17451963e6f3" returned: 0 in 0.500s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:10 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-3e44a7b0-1e5e-48e5-b1a9-83f992980ef8 tempest-VolumeDependencyTests-62967508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f5165008-9684-462c-ae75-17451963e6f3 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:10 devstack sudo[90562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f5165008-9684-462c-ae75-17451963e6f3
Feb 27 01:31:10 devstack sudo[90562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:10 devstack sudo[90562]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:10 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-3e44a7b0-1e5e-48e5-b1a9-83f992980ef8 tempest-VolumeDependencyTests-62967508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-f5165008-9684-462c-ae75-17451963e6f3" returned: 0 in 0.417s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:10 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-3e44a7b0-1e5e-48e5-b1a9-83f992980ef8 tempest-VolumeDependencyTests-62967508 None] Lock "cinder-quobyte-f5165008-9684-462c-ae75-17451963e6f3" released by "delete_volume" :: held 0.950s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:31:10 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-3e44a7b0-1e5e-48e5-b1a9-83f992980ef8 tempest-VolumeDependencyTests-62967508 None] Created reservations ['4610c256-6451-4e6e-b300-5be5b5aab4cd', 'e886d371-703e-472a-86bc-7c46dda781b3', '3976728a-4711-4fda-973f-092a0cb52188', 'f150dd89-17d6-4162-b495-6f60da4e7d77'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:31:10 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-3e44a7b0-1e5e-48e5-b1a9-83f992980ef8 tempest-VolumeDependencyTests-62967508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:10 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-3e44a7b0-1e5e-48e5-b1a9-83f992980ef8 tempest-VolumeDependencyTests-62967508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:10 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-3e44a7b0-1e5e-48e5-b1a9-83f992980ef8 tempest-VolumeDependencyTests-62967508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:31:10 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-3e44a7b0-1e5e-48e5-b1a9-83f992980ef8 tempest-VolumeDependencyTests-62967508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:31:10 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-3e44a7b0-1e5e-48e5-b1a9-83f992980ef8 tempest-VolumeDependencyTests-62967508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:10 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-3e44a7b0-1e5e-48e5-b1a9-83f992980ef8 tempest-VolumeDependencyTests-62967508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:10 devstack sudo[90565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:31:10 devstack sudo[90565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:10 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-9f8eb59e-40e9-4d27-9aed-97d44886eeaf tempest-VolumeDependencyTests-62967508 None] Acquiring lock "cinder-d2b49da8-8ecc-40f9-8a4d-7273a7a543e2-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:31:10 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-9f8eb59e-40e9-4d27-9aed-97d44886eeaf tempest-VolumeDependencyTests-62967508 None] Lock "cinder-d2b49da8-8ecc-40f9-8a4d-7273a7a543e2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:31:10 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-9f8eb59e-40e9-4d27-9aed-97d44886eeaf tempest-VolumeDependencyTests-62967508 None] Acquiring lock "cinder-quobyte-d2b49da8-8ecc-40f9-8a4d-7273a7a543e2" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:31:10 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-9f8eb59e-40e9-4d27-9aed-97d44886eeaf tempest-VolumeDependencyTests-62967508 None] Lock "cinder-quobyte-d2b49da8-8ecc-40f9-8a4d-7273a7a543e2" acquired by "delete_volume" :: waited 0.011s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:31:10 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0dd6ab-03c2-47e3-80ac-69be40cb0a6c]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:31:10 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9f8eb59e-40e9-4d27-9aed-97d44886eeaf tempest-VolumeDependencyTests-62967508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-d2b49da8-8ecc-40f9-8a4d-7273a7a543e2 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:10 devstack sudo[90567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-d2b49da8-8ecc-40f9-8a4d-7273a7a543e2
Feb 27 01:31:10 devstack sudo[90567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:11 devstack sudo[90565]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:11 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-3e44a7b0-1e5e-48e5-b1a9-83f992980ef8 tempest-VolumeDependencyTests-62967508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.520s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:11 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-3e44a7b0-1e5e-48e5-b1a9-83f992980ef8 tempest-VolumeDependencyTests-62967508 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:31:11 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-3e44a7b0-1e5e-48e5-b1a9-83f992980ef8 tempest-VolumeDependencyTests-62967508 None] Deleted volume successfully.
Feb 27 01:31:11 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-3e44a7b0-1e5e-48e5-b1a9-83f992980ef8 tempest-VolumeDependencyTests-62967508 None] Lock "cinder-f5165008-9684-462c-ae75-17451963e6f3-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:31:11 devstack sudo[90567]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:11 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9f8eb59e-40e9-4d27-9aed-97d44886eeaf tempest-VolumeDependencyTests-62967508 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-d2b49da8-8ecc-40f9-8a4d-7273a7a543e2" returned: 0 in 0.571s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:11 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9f8eb59e-40e9-4d27-9aed-97d44886eeaf tempest-VolumeDependencyTests-62967508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-d2b49da8-8ecc-40f9-8a4d-7273a7a543e2 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:11 devstack sudo[90573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-d2b49da8-8ecc-40f9-8a4d-7273a7a543e2
Feb 27 01:31:11 devstack sudo[90573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:11 devstack sudo[90573]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:11 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9f8eb59e-40e9-4d27-9aed-97d44886eeaf tempest-VolumeDependencyTests-62967508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-d2b49da8-8ecc-40f9-8a4d-7273a7a543e2" returned: 0 in 0.481s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:11 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-9f8eb59e-40e9-4d27-9aed-97d44886eeaf tempest-VolumeDependencyTests-62967508 None] Lock "cinder-quobyte-d2b49da8-8ecc-40f9-8a4d-7273a7a543e2" released by "delete_volume" :: held 1.078s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:31:11 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-9f8eb59e-40e9-4d27-9aed-97d44886eeaf tempest-VolumeDependencyTests-62967508 None] Created reservations ['f77d3028-be9b-48c5-be06-0f803f6ef268', '761b8aee-6396-45ed-86ec-0b8e76596036', 'f414ff5a-8fc2-484b-9e74-4b7d56d47875', '0635c63a-b409-48d6-878a-61a597430986'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:31:11 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-9f8eb59e-40e9-4d27-9aed-97d44886eeaf tempest-VolumeDependencyTests-62967508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:11 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-9f8eb59e-40e9-4d27-9aed-97d44886eeaf tempest-VolumeDependencyTests-62967508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:11 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-9f8eb59e-40e9-4d27-9aed-97d44886eeaf tempest-VolumeDependencyTests-62967508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:31:11 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-9f8eb59e-40e9-4d27-9aed-97d44886eeaf tempest-VolumeDependencyTests-62967508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:31:11 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-9f8eb59e-40e9-4d27-9aed-97d44886eeaf tempest-VolumeDependencyTests-62967508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:11 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9f8eb59e-40e9-4d27-9aed-97d44886eeaf tempest-VolumeDependencyTests-62967508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:11 devstack sudo[90576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:31:11 devstack sudo[90576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:12 devstack sudo[90576]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:12 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9f8eb59e-40e9-4d27-9aed-97d44886eeaf tempest-VolumeDependencyTests-62967508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.480s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:12 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-9f8eb59e-40e9-4d27-9aed-97d44886eeaf tempest-VolumeDependencyTests-62967508 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:31:12 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-9f8eb59e-40e9-4d27-9aed-97d44886eeaf tempest-VolumeDependencyTests-62967508 None] Deleted volume successfully.
Feb 27 01:31:12 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-9f8eb59e-40e9-4d27-9aed-97d44886eeaf tempest-VolumeDependencyTests-62967508 None] Lock "cinder-d2b49da8-8ecc-40f9-8a4d-7273a7a543e2-delete_volume" released by "delete_volume" :: held 1.726s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:31:12 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-798c015b-6225-4572-a9d3-ff43fce333bb tempest-VolumeDependencyTests-62967508 None] Acquiring lock "cinder-d8d04c99-f6da-42f8-a531-e67d414c42db-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:31:12 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-798c015b-6225-4572-a9d3-ff43fce333bb tempest-VolumeDependencyTests-62967508 None] Lock "cinder-d8d04c99-f6da-42f8-a531-e67d414c42db-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:31:12 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-798c015b-6225-4572-a9d3-ff43fce333bb tempest-VolumeDependencyTests-62967508 None] Acquiring lock "cinder-quobyte-d8d04c99-f6da-42f8-a531-e67d414c42db" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:31:12 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-798c015b-6225-4572-a9d3-ff43fce333bb tempest-VolumeDependencyTests-62967508 None] Lock "cinder-quobyte-d8d04c99-f6da-42f8-a531-e67d414c42db" acquired by "delete_volume" :: waited 0.010s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:31:13 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89b2092-3d6c-4680-af07-b24fb64cfe26]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:31:13 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-798c015b-6225-4572-a9d3-ff43fce333bb tempest-VolumeDependencyTests-62967508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-d8d04c99-f6da-42f8-a531-e67d414c42db {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:13 devstack sudo[90580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-d8d04c99-f6da-42f8-a531-e67d414c42db
Feb 27 01:31:13 devstack sudo[90580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:13 devstack sudo[90580]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:13 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-798c015b-6225-4572-a9d3-ff43fce333bb tempest-VolumeDependencyTests-62967508 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-d8d04c99-f6da-42f8-a531-e67d414c42db" returned: 0 in 0.492s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:13 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-798c015b-6225-4572-a9d3-ff43fce333bb tempest-VolumeDependencyTests-62967508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-d8d04c99-f6da-42f8-a531-e67d414c42db {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:13 devstack sudo[90585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-d8d04c99-f6da-42f8-a531-e67d414c42db
Feb 27 01:31:13 devstack sudo[90585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:13 devstack sudo[90585]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:13 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-798c015b-6225-4572-a9d3-ff43fce333bb tempest-VolumeDependencyTests-62967508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-d8d04c99-f6da-42f8-a531-e67d414c42db" returned: 0 in 0.415s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:13 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-798c015b-6225-4572-a9d3-ff43fce333bb tempest-VolumeDependencyTests-62967508 None] Lock "cinder-quobyte-d8d04c99-f6da-42f8-a531-e67d414c42db" released by "delete_volume" :: held 0.941s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:31:13 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-798c015b-6225-4572-a9d3-ff43fce333bb tempest-VolumeDependencyTests-62967508 None] Created reservations ['85cdd3c4-ea4c-4cda-b917-4ec31e850d8c', 'e22dafa0-552d-4c30-9ec2-5498ea9fe7fa', '97f5f44c-1019-4913-ae09-c7f186b48342', '40a2249c-d48f-4382-8d48-25512c11acc5'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:31:14 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-798c015b-6225-4572-a9d3-ff43fce333bb tempest-VolumeDependencyTests-62967508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:14 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-798c015b-6225-4572-a9d3-ff43fce333bb tempest-VolumeDependencyTests-62967508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:14 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-798c015b-6225-4572-a9d3-ff43fce333bb tempest-VolumeDependencyTests-62967508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:31:14 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-798c015b-6225-4572-a9d3-ff43fce333bb tempest-VolumeDependencyTests-62967508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:31:14 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-798c015b-6225-4572-a9d3-ff43fce333bb tempest-VolumeDependencyTests-62967508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:14 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-798c015b-6225-4572-a9d3-ff43fce333bb tempest-VolumeDependencyTests-62967508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:14 devstack sudo[90588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:31:14 devstack sudo[90588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:14 devstack sudo[90588]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:14 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-798c015b-6225-4572-a9d3-ff43fce333bb tempest-VolumeDependencyTests-62967508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.526s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:14 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-798c015b-6225-4572-a9d3-ff43fce333bb tempest-VolumeDependencyTests-62967508 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:31:14 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-798c015b-6225-4572-a9d3-ff43fce333bb tempest-VolumeDependencyTests-62967508 None] Deleted volume successfully.
Feb 27 01:31:14 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-798c015b-6225-4572-a9d3-ff43fce333bb tempest-VolumeDependencyTests-62967508 None] Lock "cinder-d8d04c99-f6da-42f8-a531-e67d414c42db-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:31:21 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b893324-8b14-4fad-9fc8-4bc6349d1f91 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:31:21 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-4b893324-8b14-4fad-9fc8-4bc6349d1f91 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Flow 'volume_create_manager' (3e740a17-c2c0-4ff0-9d42-429f1814eaf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:31:21 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-4b893324-8b14-4fad-9fc8-4bc6349d1f91 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e8b4f15-7a93-4c6d-b0ce-a5c4e7d5c348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:21 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-4b893324-8b14-4fad-9fc8-4bc6349d1f91 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e8b4f15-7a93-4c6d-b0ce-a5c4e7d5c348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:31:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-587467903',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5815fcc3-2905-43da-8853-be45cfc92d87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b73782ca97844d9f9a5a8eb4f4722b89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:31:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:31:22Z,use_quota=True,user_id='da6d7809bdb24bf1b6059fd5ecf5bf87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:21 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-4b893324-8b14-4fad-9fc8-4bc6349d1f91 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e45905ee-0746-48aa-9c6d-13d61a50f049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:21 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-4b893324-8b14-4fad-9fc8-4bc6349d1f91 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e45905ee-0746-48aa-9c6d-13d61a50f049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:21 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-4b893324-8b14-4fad-9fc8-4bc6349d1f91 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c19396f-0d33-47c8-b988-b76a93f7b9b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:21 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-4b893324-8b14-4fad-9fc8-4bc6349d1f91 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c19396f-0d33-47c8-b988-b76a93f7b9b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5815fcc3-2905-43da-8853-be45cfc92d87', 'volume_name': 'volume-5815fcc3-2905-43da-8853-be45cfc92d87', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:21 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-4b893324-8b14-4fad-9fc8-4bc6349d1f91 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22344c2e-f46a-483f-86ef-4321457c6891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:21 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-4b893324-8b14-4fad-9fc8-4bc6349d1f91 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22344c2e-f46a-483f-86ef-4321457c6891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:21 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-4b893324-8b14-4fad-9fc8-4bc6349d1f91 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc7632ec-8011-40c7-a062-9ceccf450f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:21 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-4b893324-8b14-4fad-9fc8-4bc6349d1f91 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Volume 5815fcc3-2905-43da-8853-be45cfc92d87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5815fcc3-2905-43da-8853-be45cfc92d87', 'volume_size': 1}
Feb 27 01:31:21 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-4b893324-8b14-4fad-9fc8-4bc6349d1f91 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:21 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-4b893324-8b14-4fad-9fc8-4bc6349d1f91 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:21 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-4b893324-8b14-4fad-9fc8-4bc6349d1f91 tempest-CreateVolumesFromSnapshotTest-1650134941 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:31:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-587467903',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5815fcc3-2905-43da-8853-be45cfc92d87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b73782ca97844d9f9a5a8eb4f4722b89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:31:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:31:22Z,use_quota=True,user_id='da6d7809bdb24bf1b6059fd5ecf5bf87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:31:21 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-4b893324-8b14-4fad-9fc8-4bc6349d1f91 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Creating volume 5815fcc3-2905-43da-8853-be45cfc92d87 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:31:21 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-4b893324-8b14-4fad-9fc8-4bc6349d1f91 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:21 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-4b893324-8b14-4fad-9fc8-4bc6349d1f91 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:21 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-4b893324-8b14-4fad-9fc8-4bc6349d1f91 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:31:21 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-4b893324-8b14-4fad-9fc8-4bc6349d1f91 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:31:21 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-4b893324-8b14-4fad-9fc8-4bc6349d1f91 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:21 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-4b893324-8b14-4fad-9fc8-4bc6349d1f91 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:31:21 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-4b893324-8b14-4fad-9fc8-4bc6349d1f91 tempest-CreateVolumesFromSnapshotTest-1650134941 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:31:21 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-4b893324-8b14-4fad-9fc8-4bc6349d1f91 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5815fcc3-2905-43da-8853-be45cfc92d87 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:22 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dc4be98-2c6f-432c-b396-d1352abb5952 tempest-VolumeDependencyTests-1629780687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:31:22 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-8dc4be98-2c6f-432c-b396-d1352abb5952 tempest-VolumeDependencyTests-1629780687 None] Flow 'volume_create_manager' (949b544d-c12f-4ae5-9265-bf6a771ba048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:31:22 devstack sudo[90631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5815fcc3-2905-43da-8853-be45cfc92d87 1073741824
Feb 27 01:31:22 devstack sudo[90631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:22 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-8dc4be98-2c6f-432c-b396-d1352abb5952 tempest-VolumeDependencyTests-1629780687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6caed389-285c-4a55-a8cb-670bcbfeb9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:22 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-8dc4be98-2c6f-432c-b396-d1352abb5952 tempest-VolumeDependencyTests-1629780687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6caed389-285c-4a55-a8cb-670bcbfeb9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:31:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-852115382',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd4d9c8f-dd57-4215-b446-acc20caccba2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae46202a7c8e473eb29eb42c73fcbd9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:31:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:31:22Z,use_quota=True,user_id='b3008ba5718f4609b1c16d3b5395869c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:22 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-8dc4be98-2c6f-432c-b396-d1352abb5952 tempest-VolumeDependencyTests-1629780687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d55f553a-b22c-403e-9da5-d6bdf76edcc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:22 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-8dc4be98-2c6f-432c-b396-d1352abb5952 tempest-VolumeDependencyTests-1629780687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d55f553a-b22c-403e-9da5-d6bdf76edcc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:22 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-8dc4be98-2c6f-432c-b396-d1352abb5952 tempest-VolumeDependencyTests-1629780687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e712a5d-928d-4ca2-9e5e-6125b061855e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:22 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-8dc4be98-2c6f-432c-b396-d1352abb5952 tempest-VolumeDependencyTests-1629780687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e712a5d-928d-4ca2-9e5e-6125b061855e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd4d9c8f-dd57-4215-b446-acc20caccba2', 'volume_name': 'volume-dd4d9c8f-dd57-4215-b446-acc20caccba2', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:22 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-8dc4be98-2c6f-432c-b396-d1352abb5952 tempest-VolumeDependencyTests-1629780687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cb7020d-a311-4fc2-b9e2-26ca70b12782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:22 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-8dc4be98-2c6f-432c-b396-d1352abb5952 tempest-VolumeDependencyTests-1629780687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cb7020d-a311-4fc2-b9e2-26ca70b12782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:22 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-8dc4be98-2c6f-432c-b396-d1352abb5952 tempest-VolumeDependencyTests-1629780687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d45edc11-1911-45a8-ab93-5bd6f6a2ff38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:22 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-8dc4be98-2c6f-432c-b396-d1352abb5952 tempest-VolumeDependencyTests-1629780687 None] Volume dd4d9c8f-dd57-4215-b446-acc20caccba2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd4d9c8f-dd57-4215-b446-acc20caccba2', 'volume_size': 1}
Feb 27 01:31:22 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-8dc4be98-2c6f-432c-b396-d1352abb5952 tempest-VolumeDependencyTests-1629780687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:22 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f0cb37b-a98f-4ca6-b4e1-6e619e18e1da tempest-CreateVolumesFromImageTest-1511424860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:31:22 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-5f0cb37b-a98f-4ca6-b4e1-6e619e18e1da tempest-CreateVolumesFromImageTest-1511424860 None] Flow 'volume_create_manager' (1135d543-af9b-4957-889b-fb000fe732cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:31:22 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-5f0cb37b-a98f-4ca6-b4e1-6e619e18e1da tempest-CreateVolumesFromImageTest-1511424860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (693c686b-1ee4-4e79-8a3f-fc71f9da0338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:22 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-5f0cb37b-a98f-4ca6-b4e1-6e619e18e1da tempest-CreateVolumesFromImageTest-1511424860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (693c686b-1ee4-4e79-8a3f-fc71f9da0338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:31:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2104128227',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a80a223a-724c-47fa-8584-1e0a344b6925,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c3bffc334b24540a19d37fc486ddfe9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:31:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:31:22Z,use_quota=True,user_id='7a069f261fb249ebbcf23dd310fe080e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:22 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-5f0cb37b-a98f-4ca6-b4e1-6e619e18e1da tempest-CreateVolumesFromImageTest-1511424860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1717bf3e-d48b-45f1-8adc-4cbad115c7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:22 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-5f0cb37b-a98f-4ca6-b4e1-6e619e18e1da tempest-CreateVolumesFromImageTest-1511424860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1717bf3e-d48b-45f1-8adc-4cbad115c7de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:22 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-5f0cb37b-a98f-4ca6-b4e1-6e619e18e1da tempest-CreateVolumesFromImageTest-1511424860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1dd74e6-5057-4b53-bd22-dc721227d4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:22 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-5f0cb37b-a98f-4ca6-b4e1-6e619e18e1da tempest-CreateVolumesFromImageTest-1511424860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1dd74e6-5057-4b53-bd22-dc721227d4ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a80a223a-724c-47fa-8584-1e0a344b6925', 'volume_name': 'volume-a80a223a-724c-47fa-8584-1e0a344b6925', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:22 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-5f0cb37b-a98f-4ca6-b4e1-6e619e18e1da tempest-CreateVolumesFromImageTest-1511424860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ecfc6ee-3d4b-4fc5-9c46-4989f0a0ebd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:22 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-5f0cb37b-a98f-4ca6-b4e1-6e619e18e1da tempest-CreateVolumesFromImageTest-1511424860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ecfc6ee-3d4b-4fc5-9c46-4989f0a0ebd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:22 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-5f0cb37b-a98f-4ca6-b4e1-6e619e18e1da tempest-CreateVolumesFromImageTest-1511424860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12f1afff-d705-4533-881b-8cd922be63ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:22 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-5f0cb37b-a98f-4ca6-b4e1-6e619e18e1da tempest-CreateVolumesFromImageTest-1511424860 None] Volume a80a223a-724c-47fa-8584-1e0a344b6925: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a80a223a-724c-47fa-8584-1e0a344b6925', 'volume_size': 1}
Feb 27 01:31:22 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-5f0cb37b-a98f-4ca6-b4e1-6e619e18e1da tempest-CreateVolumesFromImageTest-1511424860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:22 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e776a67-f409-4c03-b0a7-d5bb4e048518 tempest-CreateVolumesFromImageTest-1511424860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:31:22 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-8e776a67-f409-4c03-b0a7-d5bb4e048518 tempest-CreateVolumesFromImageTest-1511424860 None] Flow 'volume_create_manager' (ffadfc1b-86e0-44d5-9b6a-5a290f2fffd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:31:22 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-8e776a67-f409-4c03-b0a7-d5bb4e048518 tempest-CreateVolumesFromImageTest-1511424860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33b0d845-4e5e-4f85-8c35-52f628bd3690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:22 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-8e776a67-f409-4c03-b0a7-d5bb4e048518 tempest-CreateVolumesFromImageTest-1511424860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33b0d845-4e5e-4f85-8c35-52f628bd3690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:31:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-889484618',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2773dcd8-bf3a-4a4c-940c-ed7bc327995e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c3bffc334b24540a19d37fc486ddfe9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:31:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:31:23Z,use_quota=True,user_id='7a069f261fb249ebbcf23dd310fe080e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:22 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-8e776a67-f409-4c03-b0a7-d5bb4e048518 tempest-CreateVolumesFromImageTest-1511424860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8251fbf-1724-4cb5-b837-29e802ff3ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:22 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-8e776a67-f409-4c03-b0a7-d5bb4e048518 tempest-CreateVolumesFromImageTest-1511424860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8251fbf-1724-4cb5-b837-29e802ff3ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:22 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-8e776a67-f409-4c03-b0a7-d5bb4e048518 tempest-CreateVolumesFromImageTest-1511424860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53a81da7-6cca-44fe-b3ec-6e0e592d21ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:22 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-8e776a67-f409-4c03-b0a7-d5bb4e048518 tempest-CreateVolumesFromImageTest-1511424860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53a81da7-6cca-44fe-b3ec-6e0e592d21ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2773dcd8-bf3a-4a4c-940c-ed7bc327995e', 'volume_name': 'volume-2773dcd8-bf3a-4a4c-940c-ed7bc327995e', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:22 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-8e776a67-f409-4c03-b0a7-d5bb4e048518 tempest-CreateVolumesFromImageTest-1511424860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (601b1000-cd87-4078-b2d5-80416b970e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:22 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-8e776a67-f409-4c03-b0a7-d5bb4e048518 tempest-CreateVolumesFromImageTest-1511424860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (601b1000-cd87-4078-b2d5-80416b970e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:22 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-8e776a67-f409-4c03-b0a7-d5bb4e048518 tempest-CreateVolumesFromImageTest-1511424860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (260c6e3b-97bf-4330-a063-523ac9247fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:22 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-8e776a67-f409-4c03-b0a7-d5bb4e048518 tempest-CreateVolumesFromImageTest-1511424860 None] Volume 2773dcd8-bf3a-4a4c-940c-ed7bc327995e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2773dcd8-bf3a-4a4c-940c-ed7bc327995e', 'volume_size': 1}
Feb 27 01:31:22 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-8e776a67-f409-4c03-b0a7-d5bb4e048518 tempest-CreateVolumesFromImageTest-1511424860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:22 devstack sudo[90631]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:22 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-4b893324-8b14-4fad-9fc8-4bc6349d1f91 tempest-CreateVolumesFromSnapshotTest-1650134941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5815fcc3-2905-43da-8853-be45cfc92d87 1073741824" returned: 0 in 0.804s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:22 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-4b893324-8b14-4fad-9fc8-4bc6349d1f91 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5815fcc3-2905-43da-8853-be45cfc92d87 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:22 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3eece19-d96f-4664-aa67-188510db68c1 tempest-CreateVolumesFromImageTest-1511424860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:31:22 devstack sudo[90637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5815fcc3-2905-43da-8853-be45cfc92d87
Feb 27 01:31:22 devstack sudo[90637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:22 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d3eece19-d96f-4664-aa67-188510db68c1 tempest-CreateVolumesFromImageTest-1511424860 None] Flow 'volume_create_manager' (fa425d96-181e-4ba4-878d-e9704c587ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:31:22 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d3eece19-d96f-4664-aa67-188510db68c1 tempest-CreateVolumesFromImageTest-1511424860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb7b2696-26ab-4210-bb4d-0e25346eecad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:22 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d3eece19-d96f-4664-aa67-188510db68c1 tempest-CreateVolumesFromImageTest-1511424860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb7b2696-26ab-4210-bb4d-0e25346eecad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:31:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-43941382',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fb734cd-ad09-4109-bd5f-06c257424017,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c3bffc334b24540a19d37fc486ddfe9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:31:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:31:23Z,use_quota=True,user_id='7a069f261fb249ebbcf23dd310fe080e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:22 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d3eece19-d96f-4664-aa67-188510db68c1 tempest-CreateVolumesFromImageTest-1511424860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd2fb3c7-6ed1-42dd-824e-234c89ed095f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:22 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d3eece19-d96f-4664-aa67-188510db68c1 tempest-CreateVolumesFromImageTest-1511424860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd2fb3c7-6ed1-42dd-824e-234c89ed095f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:23 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d3eece19-d96f-4664-aa67-188510db68c1 tempest-CreateVolumesFromImageTest-1511424860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9db05d2-6f06-41e7-bcd6-5a67dd02c080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:23 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d3eece19-d96f-4664-aa67-188510db68c1 tempest-CreateVolumesFromImageTest-1511424860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9db05d2-6f06-41e7-bcd6-5a67dd02c080) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fb734cd-ad09-4109-bd5f-06c257424017', 'volume_name': 'volume-7fb734cd-ad09-4109-bd5f-06c257424017', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:23 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d3eece19-d96f-4664-aa67-188510db68c1 tempest-CreateVolumesFromImageTest-1511424860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbfbe89c-599d-40e2-a6d8-451cf5ea0b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:23 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d3eece19-d96f-4664-aa67-188510db68c1 tempest-CreateVolumesFromImageTest-1511424860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbfbe89c-599d-40e2-a6d8-451cf5ea0b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:23 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d3eece19-d96f-4664-aa67-188510db68c1 tempest-CreateVolumesFromImageTest-1511424860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0d092eb-b903-4e9a-9149-ffc78aaafe18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:23 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-d3eece19-d96f-4664-aa67-188510db68c1 tempest-CreateVolumesFromImageTest-1511424860 None] Volume 7fb734cd-ad09-4109-bd5f-06c257424017: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fb734cd-ad09-4109-bd5f-06c257424017', 'volume_size': 1}
Feb 27 01:31:23 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-d3eece19-d96f-4664-aa67-188510db68c1 tempest-CreateVolumesFromImageTest-1511424860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:23 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-98fd0ab8-17b3-4e49-b28c-cfc570505c99 tempest-CreateVolumesFromImageTest-1511424860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:31:23 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-98fd0ab8-17b3-4e49-b28c-cfc570505c99 tempest-CreateVolumesFromImageTest-1511424860 None] Flow 'volume_create_manager' (4c4f89a5-d2f1-4bf3-8e13-bc3f8db816e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:31:23 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-98fd0ab8-17b3-4e49-b28c-cfc570505c99 tempest-CreateVolumesFromImageTest-1511424860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c992a10f-251e-4151-883e-493f9c0c11f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:23 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-98fd0ab8-17b3-4e49-b28c-cfc570505c99 tempest-CreateVolumesFromImageTest-1511424860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c992a10f-251e-4151-883e-493f9c0c11f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:31:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1432252471',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9e092a6-bcb9-4012-85d3-352ffe913c92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c3bffc334b24540a19d37fc486ddfe9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:31:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:31:23Z,use_quota=True,user_id='7a069f261fb249ebbcf23dd310fe080e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:23 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-98fd0ab8-17b3-4e49-b28c-cfc570505c99 tempest-CreateVolumesFromImageTest-1511424860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (466c9333-de6d-4856-8c83-239c0e7c2eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:23 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-98fd0ab8-17b3-4e49-b28c-cfc570505c99 tempest-CreateVolumesFromImageTest-1511424860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (466c9333-de6d-4856-8c83-239c0e7c2eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:23 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-98fd0ab8-17b3-4e49-b28c-cfc570505c99 tempest-CreateVolumesFromImageTest-1511424860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (406977a4-5ebc-481e-8fd4-1ba711815387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:23 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-98fd0ab8-17b3-4e49-b28c-cfc570505c99 tempest-CreateVolumesFromImageTest-1511424860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (406977a4-5ebc-481e-8fd4-1ba711815387) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9e092a6-bcb9-4012-85d3-352ffe913c92', 'volume_name': 'volume-d9e092a6-bcb9-4012-85d3-352ffe913c92', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:23 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-98fd0ab8-17b3-4e49-b28c-cfc570505c99 tempest-CreateVolumesFromImageTest-1511424860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (892fc2c7-de94-4ae9-8096-8f04052a82e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:23 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-98fd0ab8-17b3-4e49-b28c-cfc570505c99 tempest-CreateVolumesFromImageTest-1511424860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (892fc2c7-de94-4ae9-8096-8f04052a82e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:23 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-98fd0ab8-17b3-4e49-b28c-cfc570505c99 tempest-CreateVolumesFromImageTest-1511424860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e43aafbd-4d8a-4624-825a-b71c3cd93036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:23 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-98fd0ab8-17b3-4e49-b28c-cfc570505c99 tempest-CreateVolumesFromImageTest-1511424860 None] Volume d9e092a6-bcb9-4012-85d3-352ffe913c92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9e092a6-bcb9-4012-85d3-352ffe913c92', 'volume_size': 1}
Feb 27 01:31:23 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-98fd0ab8-17b3-4e49-b28c-cfc570505c99 tempest-CreateVolumesFromImageTest-1511424860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:23 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-d933b674-fa31-4a75-864f-93f344a49734 tempest-CreateVolumesFromImageTest-1511424860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:31:23 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d933b674-fa31-4a75-864f-93f344a49734 tempest-CreateVolumesFromImageTest-1511424860 None] Flow 'volume_create_manager' (bcced1ca-290c-4ed1-849d-a9c03f24e6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:31:23 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d933b674-fa31-4a75-864f-93f344a49734 tempest-CreateVolumesFromImageTest-1511424860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7bb424f-8303-431c-87d5-e7f7bbe9f601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:23 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d933b674-fa31-4a75-864f-93f344a49734 tempest-CreateVolumesFromImageTest-1511424860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7bb424f-8303-431c-87d5-e7f7bbe9f601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:31:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-263288439',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03f113eb-acef-407d-b978-4c7192102543,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c3bffc334b24540a19d37fc486ddfe9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:31:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:31:23Z,use_quota=True,user_id='7a069f261fb249ebbcf23dd310fe080e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:23 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d933b674-fa31-4a75-864f-93f344a49734 tempest-CreateVolumesFromImageTest-1511424860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d400cf3c-3d91-4bf6-9fba-5614cd5a4167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:23 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d933b674-fa31-4a75-864f-93f344a49734 tempest-CreateVolumesFromImageTest-1511424860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d400cf3c-3d91-4bf6-9fba-5614cd5a4167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:23 devstack sudo[90637]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:23 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d933b674-fa31-4a75-864f-93f344a49734 tempest-CreateVolumesFromImageTest-1511424860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e718fec0-7444-4794-8ac2-9ad353f844f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:23 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d933b674-fa31-4a75-864f-93f344a49734 tempest-CreateVolumesFromImageTest-1511424860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e718fec0-7444-4794-8ac2-9ad353f844f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03f113eb-acef-407d-b978-4c7192102543', 'volume_name': 'volume-03f113eb-acef-407d-b978-4c7192102543', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:23 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d933b674-fa31-4a75-864f-93f344a49734 tempest-CreateVolumesFromImageTest-1511424860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eec20cd-62cb-4960-84e6-d7221b774809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:23 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d933b674-fa31-4a75-864f-93f344a49734 tempest-CreateVolumesFromImageTest-1511424860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eec20cd-62cb-4960-84e6-d7221b774809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:23 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d933b674-fa31-4a75-864f-93f344a49734 tempest-CreateVolumesFromImageTest-1511424860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (919c24fd-ef5f-47eb-b2f9-302c3d3acf97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:23 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-d933b674-fa31-4a75-864f-93f344a49734 tempest-CreateVolumesFromImageTest-1511424860 None] Volume 03f113eb-acef-407d-b978-4c7192102543: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03f113eb-acef-407d-b978-4c7192102543', 'volume_size': 1}
Feb 27 01:31:23 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-d933b674-fa31-4a75-864f-93f344a49734 tempest-CreateVolumesFromImageTest-1511424860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:23 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-4b893324-8b14-4fad-9fc8-4bc6349d1f91 tempest-CreateVolumesFromSnapshotTest-1650134941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5815fcc3-2905-43da-8853-be45cfc92d87" returned: 0 in 0.654s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:23 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-4b893324-8b14-4fad-9fc8-4bc6349d1f91 tempest-CreateVolumesFromSnapshotTest-1650134941 None] <== create_volume: return (1516ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:31:23 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-4b893324-8b14-4fad-9fc8-4bc6349d1f91 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.523s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:23 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-8dc4be98-2c6f-432c-b396-d1352abb5952 tempest-VolumeDependencyTests-1629780687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.433s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:23 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-8dc4be98-2c6f-432c-b396-d1352abb5952 tempest-VolumeDependencyTests-1629780687 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:31:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-852115382',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd4d9c8f-dd57-4215-b446-acc20caccba2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae46202a7c8e473eb29eb42c73fcbd9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:31:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:31:22Z,use_quota=True,user_id='b3008ba5718f4609b1c16d3b5395869c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:31:23 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-8dc4be98-2c6f-432c-b396-d1352abb5952 tempest-VolumeDependencyTests-1629780687 None] Creating volume dd4d9c8f-dd57-4215-b446-acc20caccba2 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:31:23 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-8dc4be98-2c6f-432c-b396-d1352abb5952 tempest-VolumeDependencyTests-1629780687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:23 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-8dc4be98-2c6f-432c-b396-d1352abb5952 tempest-VolumeDependencyTests-1629780687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:23 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-8dc4be98-2c6f-432c-b396-d1352abb5952 tempest-VolumeDependencyTests-1629780687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:31:23 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-8dc4be98-2c6f-432c-b396-d1352abb5952 tempest-VolumeDependencyTests-1629780687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:31:23 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-8dc4be98-2c6f-432c-b396-d1352abb5952 tempest-VolumeDependencyTests-1629780687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:23 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-8dc4be98-2c6f-432c-b396-d1352abb5952 tempest-VolumeDependencyTests-1629780687 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:31:23 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-8dc4be98-2c6f-432c-b396-d1352abb5952 tempest-VolumeDependencyTests-1629780687 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:31:23 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-8dc4be98-2c6f-432c-b396-d1352abb5952 tempest-VolumeDependencyTests-1629780687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4d9c8f-dd57-4215-b446-acc20caccba2 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:23 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-4b893324-8b14-4fad-9fc8-4bc6349d1f91 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc7632ec-8011-40c7-a062-9ceccf450f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5815fcc3-2905-43da-8853-be45cfc92d87', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:23 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-4b893324-8b14-4fad-9fc8-4bc6349d1f91 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (490d4ec0-a1cb-4803-85cf-f3db3306a719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:23 devstack sudo[90640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4d9c8f-dd57-4215-b446-acc20caccba2 1073741824
Feb 27 01:31:23 devstack sudo[90640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:23 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-4b893324-8b14-4fad-9fc8-4bc6349d1f91 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Volume volume-5815fcc3-2905-43da-8853-be45cfc92d87 (5815fcc3-2905-43da-8853-be45cfc92d87): created successfully
Feb 27 01:31:23 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-4b893324-8b14-4fad-9fc8-4bc6349d1f91 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (490d4ec0-a1cb-4803-85cf-f3db3306a719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:23 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-4b893324-8b14-4fad-9fc8-4bc6349d1f91 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Flow 'volume_create_manager' (3e740a17-c2c0-4ff0-9d42-429f1814eaf5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:31:23 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-4b893324-8b14-4fad-9fc8-4bc6349d1f91 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Created volume successfully.
Feb 27 01:31:24 devstack sudo[90640]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:24 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-8dc4be98-2c6f-432c-b396-d1352abb5952 tempest-VolumeDependencyTests-1629780687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4d9c8f-dd57-4215-b446-acc20caccba2 1073741824" returned: 0 in 0.696s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:24 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-afaca548-f325-418b-a34a-022caac5c9b0 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:24 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-8dc4be98-2c6f-432c-b396-d1352abb5952 tempest-VolumeDependencyTests-1629780687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4d9c8f-dd57-4215-b446-acc20caccba2 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:24 devstack sudo[90647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4d9c8f-dd57-4215-b446-acc20caccba2
Feb 27 01:31:24 devstack sudo[90647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:24 devstack sudo[90647]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:24 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-8dc4be98-2c6f-432c-b396-d1352abb5952 tempest-VolumeDependencyTests-1629780687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4d9c8f-dd57-4215-b446-acc20caccba2" returned: 0 in 0.451s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:24 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-8dc4be98-2c6f-432c-b396-d1352abb5952 tempest-VolumeDependencyTests-1629780687 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:31:24 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-8dc4be98-2c6f-432c-b396-d1352abb5952 tempest-VolumeDependencyTests-1629780687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:24 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-5f0cb37b-a98f-4ca6-b4e1-6e619e18e1da tempest-CreateVolumesFromImageTest-1511424860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.240s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:24 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-5f0cb37b-a98f-4ca6-b4e1-6e619e18e1da tempest-CreateVolumesFromImageTest-1511424860 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:31:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2104128227',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a80a223a-724c-47fa-8584-1e0a344b6925,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c3bffc334b24540a19d37fc486ddfe9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:31:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:31:22Z,use_quota=True,user_id='7a069f261fb249ebbcf23dd310fe080e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:31:24 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-5f0cb37b-a98f-4ca6-b4e1-6e619e18e1da tempest-CreateVolumesFromImageTest-1511424860 None] Creating volume a80a223a-724c-47fa-8584-1e0a344b6925 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:31:24 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-5f0cb37b-a98f-4ca6-b4e1-6e619e18e1da tempest-CreateVolumesFromImageTest-1511424860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:24 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-5f0cb37b-a98f-4ca6-b4e1-6e619e18e1da tempest-CreateVolumesFromImageTest-1511424860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:24 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-5f0cb37b-a98f-4ca6-b4e1-6e619e18e1da tempest-CreateVolumesFromImageTest-1511424860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:31:24 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-5f0cb37b-a98f-4ca6-b4e1-6e619e18e1da tempest-CreateVolumesFromImageTest-1511424860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:31:24 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-5f0cb37b-a98f-4ca6-b4e1-6e619e18e1da tempest-CreateVolumesFromImageTest-1511424860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:24 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-5f0cb37b-a98f-4ca6-b4e1-6e619e18e1da tempest-CreateVolumesFromImageTest-1511424860 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:31:24 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-5f0cb37b-a98f-4ca6-b4e1-6e619e18e1da tempest-CreateVolumesFromImageTest-1511424860 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:31:24 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5f0cb37b-a98f-4ca6-b4e1-6e619e18e1da tempest-CreateVolumesFromImageTest-1511424860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-a80a223a-724c-47fa-8584-1e0a344b6925 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:24 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-8dc4be98-2c6f-432c-b396-d1352abb5952 tempest-VolumeDependencyTests-1629780687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d45edc11-1911-45a8-ab93-5bd6f6a2ff38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd4d9c8f-dd57-4215-b446-acc20caccba2', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:24 devstack sudo[90650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-a80a223a-724c-47fa-8584-1e0a344b6925 1073741824
Feb 27 01:31:24 devstack sudo[90650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:24 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-8dc4be98-2c6f-432c-b396-d1352abb5952 tempest-VolumeDependencyTests-1629780687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae7fbc4b-7372-4ccb-bb87-737f1d0a1ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:24 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-8dc4be98-2c6f-432c-b396-d1352abb5952 tempest-VolumeDependencyTests-1629780687 None] Volume volume-dd4d9c8f-dd57-4215-b446-acc20caccba2 (dd4d9c8f-dd57-4215-b446-acc20caccba2): created successfully
Feb 27 01:31:24 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-8dc4be98-2c6f-432c-b396-d1352abb5952 tempest-VolumeDependencyTests-1629780687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae7fbc4b-7372-4ccb-bb87-737f1d0a1ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:24 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-8dc4be98-2c6f-432c-b396-d1352abb5952 tempest-VolumeDependencyTests-1629780687 None] Flow 'volume_create_manager' (949b544d-c12f-4ae5-9265-bf6a771ba048) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:31:24 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-8dc4be98-2c6f-432c-b396-d1352abb5952 tempest-VolumeDependencyTests-1629780687 None] Created volume successfully.
Feb 27 01:31:25 devstack sudo[90650]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:25 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5f0cb37b-a98f-4ca6-b4e1-6e619e18e1da tempest-CreateVolumesFromImageTest-1511424860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-a80a223a-724c-47fa-8584-1e0a344b6925 1073741824" returned: 0 in 0.647s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:25 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-c6aeedba-7409-4dc9-853c-e1915efd89de tempest-VolumeDependencyTests-1629780687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:25 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5f0cb37b-a98f-4ca6-b4e1-6e619e18e1da tempest-CreateVolumesFromImageTest-1511424860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-a80a223a-724c-47fa-8584-1e0a344b6925 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:25 devstack sudo[90655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-a80a223a-724c-47fa-8584-1e0a344b6925
Feb 27 01:31:25 devstack sudo[90655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:25 devstack sudo[90655]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:25 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5f0cb37b-a98f-4ca6-b4e1-6e619e18e1da tempest-CreateVolumesFromImageTest-1511424860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-a80a223a-724c-47fa-8584-1e0a344b6925" returned: 0 in 0.432s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:25 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-5f0cb37b-a98f-4ca6-b4e1-6e619e18e1da tempest-CreateVolumesFromImageTest-1511424860 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:31:25 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-5f0cb37b-a98f-4ca6-b4e1-6e619e18e1da tempest-CreateVolumesFromImageTest-1511424860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:25 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-8e776a67-f409-4c03-b0a7-d5bb4e048518 tempest-CreateVolumesFromImageTest-1511424860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.106s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:25 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-8e776a67-f409-4c03-b0a7-d5bb4e048518 tempest-CreateVolumesFromImageTest-1511424860 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:31:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-889484618',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2773dcd8-bf3a-4a4c-940c-ed7bc327995e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c3bffc334b24540a19d37fc486ddfe9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:31:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:31:23Z,use_quota=True,user_id='7a069f261fb249ebbcf23dd310fe080e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:31:25 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-8e776a67-f409-4c03-b0a7-d5bb4e048518 tempest-CreateVolumesFromImageTest-1511424860 None] Creating volume 2773dcd8-bf3a-4a4c-940c-ed7bc327995e {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:31:25 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-8e776a67-f409-4c03-b0a7-d5bb4e048518 tempest-CreateVolumesFromImageTest-1511424860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:25 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-8e776a67-f409-4c03-b0a7-d5bb4e048518 tempest-CreateVolumesFromImageTest-1511424860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:25 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-8e776a67-f409-4c03-b0a7-d5bb4e048518 tempest-CreateVolumesFromImageTest-1511424860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:31:25 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-8e776a67-f409-4c03-b0a7-d5bb4e048518 tempest-CreateVolumesFromImageTest-1511424860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:31:25 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-8e776a67-f409-4c03-b0a7-d5bb4e048518 tempest-CreateVolumesFromImageTest-1511424860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:25 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-8e776a67-f409-4c03-b0a7-d5bb4e048518 tempest-CreateVolumesFromImageTest-1511424860 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:31:25 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-8e776a67-f409-4c03-b0a7-d5bb4e048518 tempest-CreateVolumesFromImageTest-1511424860 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:31:25 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-8e776a67-f409-4c03-b0a7-d5bb4e048518 tempest-CreateVolumesFromImageTest-1511424860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-2773dcd8-bf3a-4a4c-940c-ed7bc327995e 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:25 devstack sudo[90658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-2773dcd8-bf3a-4a4c-940c-ed7bc327995e 1073741824
Feb 27 01:31:25 devstack sudo[90658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:25 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-5f0cb37b-a98f-4ca6-b4e1-6e619e18e1da tempest-CreateVolumesFromImageTest-1511424860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12f1afff-d705-4533-881b-8cd922be63ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a80a223a-724c-47fa-8584-1e0a344b6925', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:25 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-5f0cb37b-a98f-4ca6-b4e1-6e619e18e1da tempest-CreateVolumesFromImageTest-1511424860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec237869-354d-474e-be93-d2d160c3285b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:25 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-5f0cb37b-a98f-4ca6-b4e1-6e619e18e1da tempest-CreateVolumesFromImageTest-1511424860 None] Volume volume-a80a223a-724c-47fa-8584-1e0a344b6925 (a80a223a-724c-47fa-8584-1e0a344b6925): created successfully
Feb 27 01:31:25 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-5f0cb37b-a98f-4ca6-b4e1-6e619e18e1da tempest-CreateVolumesFromImageTest-1511424860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec237869-354d-474e-be93-d2d160c3285b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:25 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-5f0cb37b-a98f-4ca6-b4e1-6e619e18e1da tempest-CreateVolumesFromImageTest-1511424860 None] Flow 'volume_create_manager' (1135d543-af9b-4957-889b-fb000fe732cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:31:25 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-5f0cb37b-a98f-4ca6-b4e1-6e619e18e1da tempest-CreateVolumesFromImageTest-1511424860 None] Created volume successfully.
Feb 27 01:31:26 devstack sudo[90658]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:26 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-8e776a67-f409-4c03-b0a7-d5bb4e048518 tempest-CreateVolumesFromImageTest-1511424860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-2773dcd8-bf3a-4a4c-940c-ed7bc327995e 1073741824" returned: 0 in 0.589s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:26 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-8e776a67-f409-4c03-b0a7-d5bb4e048518 tempest-CreateVolumesFromImageTest-1511424860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-2773dcd8-bf3a-4a4c-940c-ed7bc327995e {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:26 devstack sudo[90663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-2773dcd8-bf3a-4a4c-940c-ed7bc327995e
Feb 27 01:31:26 devstack sudo[90663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:27 devstack sudo[90663]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-8e776a67-f409-4c03-b0a7-d5bb4e048518 tempest-CreateVolumesFromImageTest-1511424860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-2773dcd8-bf3a-4a4c-940c-ed7bc327995e" returned: 0 in 0.630s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:27 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-8e776a67-f409-4c03-b0a7-d5bb4e048518 tempest-CreateVolumesFromImageTest-1511424860 None] <== create_volume: return (1249ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:31:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-8e776a67-f409-4c03-b0a7-d5bb4e048518 tempest-CreateVolumesFromImageTest-1511424860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.252s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-d3eece19-d96f-4664-aa67-188510db68c1 tempest-CreateVolumesFromImageTest-1511424860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.062s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:27 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-d3eece19-d96f-4664-aa67-188510db68c1 tempest-CreateVolumesFromImageTest-1511424860 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:31:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-43941382',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fb734cd-ad09-4109-bd5f-06c257424017,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c3bffc334b24540a19d37fc486ddfe9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:31:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:31:23Z,use_quota=True,user_id='7a069f261fb249ebbcf23dd310fe080e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:31:27 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-d3eece19-d96f-4664-aa67-188510db68c1 tempest-CreateVolumesFromImageTest-1511424860 None] Creating volume 7fb734cd-ad09-4109-bd5f-06c257424017 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:31:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-d3eece19-d96f-4664-aa67-188510db68c1 tempest-CreateVolumesFromImageTest-1511424860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-d3eece19-d96f-4664-aa67-188510db68c1 tempest-CreateVolumesFromImageTest-1511424860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:27 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-d3eece19-d96f-4664-aa67-188510db68c1 tempest-CreateVolumesFromImageTest-1511424860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:31:27 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-d3eece19-d96f-4664-aa67-188510db68c1 tempest-CreateVolumesFromImageTest-1511424860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:31:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-d3eece19-d96f-4664-aa67-188510db68c1 tempest-CreateVolumesFromImageTest-1511424860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:27 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-d3eece19-d96f-4664-aa67-188510db68c1 tempest-CreateVolumesFromImageTest-1511424860 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:31:27 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-d3eece19-d96f-4664-aa67-188510db68c1 tempest-CreateVolumesFromImageTest-1511424860 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:31:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d3eece19-d96f-4664-aa67-188510db68c1 tempest-CreateVolumesFromImageTest-1511424860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-7fb734cd-ad09-4109-bd5f-06c257424017 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:27 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-8e776a67-f409-4c03-b0a7-d5bb4e048518 tempest-CreateVolumesFromImageTest-1511424860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (260c6e3b-97bf-4330-a063-523ac9247fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2773dcd8-bf3a-4a4c-940c-ed7bc327995e', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:27 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-8e776a67-f409-4c03-b0a7-d5bb4e048518 tempest-CreateVolumesFromImageTest-1511424860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (504bd6f0-79ad-4e04-b2d8-4f59e3a8ca85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:27 devstack sudo[90666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-7fb734cd-ad09-4109-bd5f-06c257424017 1073741824
Feb 27 01:31:27 devstack sudo[90666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:27 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-8e776a67-f409-4c03-b0a7-d5bb4e048518 tempest-CreateVolumesFromImageTest-1511424860 None] Volume volume-2773dcd8-bf3a-4a4c-940c-ed7bc327995e (2773dcd8-bf3a-4a4c-940c-ed7bc327995e): created successfully
Feb 27 01:31:27 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-8e776a67-f409-4c03-b0a7-d5bb4e048518 tempest-CreateVolumesFromImageTest-1511424860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (504bd6f0-79ad-4e04-b2d8-4f59e3a8ca85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:27 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-8e776a67-f409-4c03-b0a7-d5bb4e048518 tempest-CreateVolumesFromImageTest-1511424860 None] Flow 'volume_create_manager' (ffadfc1b-86e0-44d5-9b6a-5a290f2fffd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:31:27 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-8e776a67-f409-4c03-b0a7-d5bb4e048518 tempest-CreateVolumesFromImageTest-1511424860 None] Created volume successfully.
Feb 27 01:31:27 devstack sudo[90666]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d3eece19-d96f-4664-aa67-188510db68c1 tempest-CreateVolumesFromImageTest-1511424860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-7fb734cd-ad09-4109-bd5f-06c257424017 1073741824" returned: 0 in 0.784s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:27 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d3eece19-d96f-4664-aa67-188510db68c1 tempest-CreateVolumesFromImageTest-1511424860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-7fb734cd-ad09-4109-bd5f-06c257424017 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:27 devstack sudo[90671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-7fb734cd-ad09-4109-bd5f-06c257424017
Feb 27 01:31:27 devstack sudo[90671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:28 devstack sudo[90671]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:28 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d3eece19-d96f-4664-aa67-188510db68c1 tempest-CreateVolumesFromImageTest-1511424860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-7fb734cd-ad09-4109-bd5f-06c257424017" returned: 0 in 0.497s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:28 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-d3eece19-d96f-4664-aa67-188510db68c1 tempest-CreateVolumesFromImageTest-1511424860 None] <== create_volume: return (1316ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:31:28 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-d3eece19-d96f-4664-aa67-188510db68c1 tempest-CreateVolumesFromImageTest-1511424860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.322s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:28 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-98fd0ab8-17b3-4e49-b28c-cfc570505c99 tempest-CreateVolumesFromImageTest-1511424860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.231s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:28 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-98fd0ab8-17b3-4e49-b28c-cfc570505c99 tempest-CreateVolumesFromImageTest-1511424860 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:31:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1432252471',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9e092a6-bcb9-4012-85d3-352ffe913c92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c3bffc334b24540a19d37fc486ddfe9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:31:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:31:23Z,use_quota=True,user_id='7a069f261fb249ebbcf23dd310fe080e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:31:28 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-98fd0ab8-17b3-4e49-b28c-cfc570505c99 tempest-CreateVolumesFromImageTest-1511424860 None] Creating volume d9e092a6-bcb9-4012-85d3-352ffe913c92 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:31:28 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-98fd0ab8-17b3-4e49-b28c-cfc570505c99 tempest-CreateVolumesFromImageTest-1511424860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:28 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-98fd0ab8-17b3-4e49-b28c-cfc570505c99 tempest-CreateVolumesFromImageTest-1511424860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:28 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-98fd0ab8-17b3-4e49-b28c-cfc570505c99 tempest-CreateVolumesFromImageTest-1511424860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:31:28 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-98fd0ab8-17b3-4e49-b28c-cfc570505c99 tempest-CreateVolumesFromImageTest-1511424860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:31:28 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-98fd0ab8-17b3-4e49-b28c-cfc570505c99 tempest-CreateVolumesFromImageTest-1511424860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:28 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-98fd0ab8-17b3-4e49-b28c-cfc570505c99 tempest-CreateVolumesFromImageTest-1511424860 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:31:28 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-98fd0ab8-17b3-4e49-b28c-cfc570505c99 tempest-CreateVolumesFromImageTest-1511424860 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:31:28 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-98fd0ab8-17b3-4e49-b28c-cfc570505c99 tempest-CreateVolumesFromImageTest-1511424860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-d9e092a6-bcb9-4012-85d3-352ffe913c92 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:28 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d3eece19-d96f-4664-aa67-188510db68c1 tempest-CreateVolumesFromImageTest-1511424860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0d092eb-b903-4e9a-9149-ffc78aaafe18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fb734cd-ad09-4109-bd5f-06c257424017', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:28 devstack sudo[90674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-d9e092a6-bcb9-4012-85d3-352ffe913c92 1073741824
Feb 27 01:31:28 devstack sudo[90674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:28 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d3eece19-d96f-4664-aa67-188510db68c1 tempest-CreateVolumesFromImageTest-1511424860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3d03f35-863c-495b-ae4c-dfb5449448fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:28 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-d3eece19-d96f-4664-aa67-188510db68c1 tempest-CreateVolumesFromImageTest-1511424860 None] Volume volume-7fb734cd-ad09-4109-bd5f-06c257424017 (7fb734cd-ad09-4109-bd5f-06c257424017): created successfully
Feb 27 01:31:28 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d3eece19-d96f-4664-aa67-188510db68c1 tempest-CreateVolumesFromImageTest-1511424860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3d03f35-863c-495b-ae4c-dfb5449448fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:28 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d3eece19-d96f-4664-aa67-188510db68c1 tempest-CreateVolumesFromImageTest-1511424860 None] Flow 'volume_create_manager' (fa425d96-181e-4ba4-878d-e9704c587ab0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:31:28 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-d3eece19-d96f-4664-aa67-188510db68c1 tempest-CreateVolumesFromImageTest-1511424860 None] Created volume successfully.
Feb 27 01:31:29 devstack sudo[90674]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:29 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-98fd0ab8-17b3-4e49-b28c-cfc570505c99 tempest-CreateVolumesFromImageTest-1511424860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-d9e092a6-bcb9-4012-85d3-352ffe913c92 1073741824" returned: 0 in 0.641s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:29 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-98fd0ab8-17b3-4e49-b28c-cfc570505c99 tempest-CreateVolumesFromImageTest-1511424860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-d9e092a6-bcb9-4012-85d3-352ffe913c92 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:29 devstack sudo[90679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-d9e092a6-bcb9-4012-85d3-352ffe913c92
Feb 27 01:31:29 devstack sudo[90679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:29 devstack sudo[90679]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:29 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-98fd0ab8-17b3-4e49-b28c-cfc570505c99 tempest-CreateVolumesFromImageTest-1511424860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-d9e092a6-bcb9-4012-85d3-352ffe913c92" returned: 0 in 0.527s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:29 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-98fd0ab8-17b3-4e49-b28c-cfc570505c99 tempest-CreateVolumesFromImageTest-1511424860 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:31:29 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-98fd0ab8-17b3-4e49-b28c-cfc570505c99 tempest-CreateVolumesFromImageTest-1511424860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.212s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:29 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-d933b674-fa31-4a75-864f-93f344a49734 tempest-CreateVolumesFromImageTest-1511424860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.129s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:29 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-d933b674-fa31-4a75-864f-93f344a49734 tempest-CreateVolumesFromImageTest-1511424860 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:31:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-263288439',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03f113eb-acef-407d-b978-4c7192102543,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c3bffc334b24540a19d37fc486ddfe9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:31:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:31:23Z,use_quota=True,user_id='7a069f261fb249ebbcf23dd310fe080e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:31:29 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-d933b674-fa31-4a75-864f-93f344a49734 tempest-CreateVolumesFromImageTest-1511424860 None] Creating volume 03f113eb-acef-407d-b978-4c7192102543 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:31:29 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-d933b674-fa31-4a75-864f-93f344a49734 tempest-CreateVolumesFromImageTest-1511424860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:29 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-d933b674-fa31-4a75-864f-93f344a49734 tempest-CreateVolumesFromImageTest-1511424860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:29 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-d933b674-fa31-4a75-864f-93f344a49734 tempest-CreateVolumesFromImageTest-1511424860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:31:29 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-d933b674-fa31-4a75-864f-93f344a49734 tempest-CreateVolumesFromImageTest-1511424860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:31:29 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-d933b674-fa31-4a75-864f-93f344a49734 tempest-CreateVolumesFromImageTest-1511424860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:29 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-d933b674-fa31-4a75-864f-93f344a49734 tempest-CreateVolumesFromImageTest-1511424860 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:31:29 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-d933b674-fa31-4a75-864f-93f344a49734 tempest-CreateVolumesFromImageTest-1511424860 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:31:29 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d933b674-fa31-4a75-864f-93f344a49734 tempest-CreateVolumesFromImageTest-1511424860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-03f113eb-acef-407d-b978-4c7192102543 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:29 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-98fd0ab8-17b3-4e49-b28c-cfc570505c99 tempest-CreateVolumesFromImageTest-1511424860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e43aafbd-4d8a-4624-825a-b71c3cd93036) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9e092a6-bcb9-4012-85d3-352ffe913c92', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:29 devstack sudo[90682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-03f113eb-acef-407d-b978-4c7192102543 1073741824
Feb 27 01:31:29 devstack sudo[90682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:29 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-98fd0ab8-17b3-4e49-b28c-cfc570505c99 tempest-CreateVolumesFromImageTest-1511424860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f781d8a2-62e4-45a5-be88-836e31fe948e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:29 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-98fd0ab8-17b3-4e49-b28c-cfc570505c99 tempest-CreateVolumesFromImageTest-1511424860 None] Volume volume-d9e092a6-bcb9-4012-85d3-352ffe913c92 (d9e092a6-bcb9-4012-85d3-352ffe913c92): created successfully
Feb 27 01:31:29 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-98fd0ab8-17b3-4e49-b28c-cfc570505c99 tempest-CreateVolumesFromImageTest-1511424860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f781d8a2-62e4-45a5-be88-836e31fe948e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:29 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-98fd0ab8-17b3-4e49-b28c-cfc570505c99 tempest-CreateVolumesFromImageTest-1511424860 None] Flow 'volume_create_manager' (4c4f89a5-d2f1-4bf3-8e13-bc3f8db816e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:31:29 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-98fd0ab8-17b3-4e49-b28c-cfc570505c99 tempest-CreateVolumesFromImageTest-1511424860 None] Created volume successfully.
Feb 27 01:31:30 devstack sudo[90682]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:30 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d933b674-fa31-4a75-864f-93f344a49734 tempest-CreateVolumesFromImageTest-1511424860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-03f113eb-acef-407d-b978-4c7192102543 1073741824" returned: 0 in 0.668s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:30 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d933b674-fa31-4a75-864f-93f344a49734 tempest-CreateVolumesFromImageTest-1511424860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-03f113eb-acef-407d-b978-4c7192102543 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:30 devstack sudo[90687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-03f113eb-acef-407d-b978-4c7192102543
Feb 27 01:31:30 devstack sudo[90687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:30 devstack sudo[90687]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:30 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d933b674-fa31-4a75-864f-93f344a49734 tempest-CreateVolumesFromImageTest-1511424860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-03f113eb-acef-407d-b978-4c7192102543" returned: 0 in 0.460s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:30 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-d933b674-fa31-4a75-864f-93f344a49734 tempest-CreateVolumesFromImageTest-1511424860 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:31:30 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-d933b674-fa31-4a75-864f-93f344a49734 tempest-CreateVolumesFromImageTest-1511424860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:30 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-afaca548-f325-418b-a34a-022caac5c9b0 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.569s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:30 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-afaca548-f325-418b-a34a-022caac5c9b0 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Creating offline snapshot 73ab7430-84e2-400c-adc7-ea3648c62814 of volume 5815fcc3-2905-43da-8853-be45cfc92d87 {{(pid=83106) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:31:30 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d933b674-fa31-4a75-864f-93f344a49734 tempest-CreateVolumesFromImageTest-1511424860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (919c24fd-ef5f-47eb-b2f9-302c3d3acf97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03f113eb-acef-407d-b978-4c7192102543', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:30 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d933b674-fa31-4a75-864f-93f344a49734 tempest-CreateVolumesFromImageTest-1511424860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8566797c-868b-44e7-991a-f9a379dbd52b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:30 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe79a4e1-5b7e-4c58-a82a-53167cb6fafb]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:31:30 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-afaca548-f325-418b-a34a-022caac5c9b0 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5815fcc3-2905-43da-8853-be45cfc92d87 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:30 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-d933b674-fa31-4a75-864f-93f344a49734 tempest-CreateVolumesFromImageTest-1511424860 None] Volume volume-03f113eb-acef-407d-b978-4c7192102543 (03f113eb-acef-407d-b978-4c7192102543): created successfully
Feb 27 01:31:30 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d933b674-fa31-4a75-864f-93f344a49734 tempest-CreateVolumesFromImageTest-1511424860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8566797c-868b-44e7-991a-f9a379dbd52b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:30 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-d933b674-fa31-4a75-864f-93f344a49734 tempest-CreateVolumesFromImageTest-1511424860 None] Flow 'volume_create_manager' (bcced1ca-290c-4ed1-849d-a9c03f24e6d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:31:30 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-d933b674-fa31-4a75-864f-93f344a49734 tempest-CreateVolumesFromImageTest-1511424860 None] Created volume successfully.
Feb 27 01:31:30 devstack sudo[90690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5815fcc3-2905-43da-8853-be45cfc92d87
Feb 27 01:31:30 devstack sudo[90690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:31 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-db3cb165-0072-4adf-a248-0637f17b469a tempest-CreateVolumesFromImageTest-1511424860 None] Acquiring lock "cinder-03f113eb-acef-407d-b978-4c7192102543-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:31:31 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-db3cb165-0072-4adf-a248-0637f17b469a tempest-CreateVolumesFromImageTest-1511424860 None] Lock "cinder-03f113eb-acef-407d-b978-4c7192102543-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:31:31 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-db3cb165-0072-4adf-a248-0637f17b469a tempest-CreateVolumesFromImageTest-1511424860 None] Acquiring lock "cinder-quobyte-03f113eb-acef-407d-b978-4c7192102543" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:31:31 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-db3cb165-0072-4adf-a248-0637f17b469a tempest-CreateVolumesFromImageTest-1511424860 None] Lock "cinder-quobyte-03f113eb-acef-407d-b978-4c7192102543" acquired by "delete_volume" :: waited 0.010s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:31:31 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6fb04d6-cc60-4c60-a80a-8e3729c9714a]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:31:31 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-db3cb165-0072-4adf-a248-0637f17b469a tempest-CreateVolumesFromImageTest-1511424860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-03f113eb-acef-407d-b978-4c7192102543 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:31 devstack sudo[90692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-03f113eb-acef-407d-b978-4c7192102543
Feb 27 01:31:31 devstack sudo[90692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:31 devstack sudo[90690]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:31 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-afaca548-f325-418b-a34a-022caac5c9b0 tempest-CreateVolumesFromSnapshotTest-1650134941 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5815fcc3-2905-43da-8853-be45cfc92d87" returned: 0 in 0.765s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:31 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-afaca548-f325-418b-a34a-022caac5c9b0 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5815fcc3-2905-43da-8853-be45cfc92d87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5815fcc3-2905-43da-8853-be45cfc92d87.73ab7430-84e2-400c-adc7-ea3648c62814 1G {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:31 devstack sudo[90697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5815fcc3-2905-43da-8853-be45cfc92d87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5815fcc3-2905-43da-8853-be45cfc92d87.73ab7430-84e2-400c-adc7-ea3648c62814 1G
Feb 27 01:31:31 devstack sudo[90697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:32 devstack sudo[90692]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:32 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-db3cb165-0072-4adf-a248-0637f17b469a tempest-CreateVolumesFromImageTest-1511424860 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-03f113eb-acef-407d-b978-4c7192102543" returned: 0 in 0.822s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:32 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-db3cb165-0072-4adf-a248-0637f17b469a tempest-CreateVolumesFromImageTest-1511424860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-03f113eb-acef-407d-b978-4c7192102543 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:32 devstack sudo[90705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-03f113eb-acef-407d-b978-4c7192102543
Feb 27 01:31:32 devstack sudo[90705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:32 devstack sudo[90697]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:32 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-afaca548-f325-418b-a34a-022caac5c9b0 tempest-CreateVolumesFromSnapshotTest-1650134941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5815fcc3-2905-43da-8853-be45cfc92d87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5815fcc3-2905-43da-8853-be45cfc92d87.73ab7430-84e2-400c-adc7-ea3648c62814 1G" returned: 0 in 0.674s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:32 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-afaca548-f325-418b-a34a-022caac5c9b0 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5815fcc3-2905-43da-8853-be45cfc92d87 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5815fcc3-2905-43da-8853-be45cfc92d87.73ab7430-84e2-400c-adc7-ea3648c62814 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:32 devstack sudo[90707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5815fcc3-2905-43da-8853-be45cfc92d87 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5815fcc3-2905-43da-8853-be45cfc92d87.73ab7430-84e2-400c-adc7-ea3648c62814
Feb 27 01:31:32 devstack sudo[90707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:32 devstack sudo[90705]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:32 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-db3cb165-0072-4adf-a248-0637f17b469a tempest-CreateVolumesFromImageTest-1511424860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-03f113eb-acef-407d-b978-4c7192102543" returned: 0 in 0.603s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:32 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-db3cb165-0072-4adf-a248-0637f17b469a tempest-CreateVolumesFromImageTest-1511424860 None] Lock "cinder-quobyte-03f113eb-acef-407d-b978-4c7192102543" released by "delete_volume" :: held 1.459s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:31:32 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-db3cb165-0072-4adf-a248-0637f17b469a tempest-CreateVolumesFromImageTest-1511424860 None] Created reservations ['74fbf77d-c44e-4ab8-82bf-7e5f30e9b4a5', '69517347-65ef-4fff-9306-652d66228448', 'cb607043-2cd2-4b22-870c-04a58f9493ab', 'f0d144b7-e294-4cb8-b132-d5b8590bc22f'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:31:32 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-db3cb165-0072-4adf-a248-0637f17b469a tempest-CreateVolumesFromImageTest-1511424860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:32 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-db3cb165-0072-4adf-a248-0637f17b469a tempest-CreateVolumesFromImageTest-1511424860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:32 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-db3cb165-0072-4adf-a248-0637f17b469a tempest-CreateVolumesFromImageTest-1511424860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:31:32 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-db3cb165-0072-4adf-a248-0637f17b469a tempest-CreateVolumesFromImageTest-1511424860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:31:32 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-db3cb165-0072-4adf-a248-0637f17b469a tempest-CreateVolumesFromImageTest-1511424860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:32 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-db3cb165-0072-4adf-a248-0637f17b469a tempest-CreateVolumesFromImageTest-1511424860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:32 devstack sudo[90713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:31:32 devstack sudo[90713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:32 devstack sudo[90707]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:32 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-afaca548-f325-418b-a34a-022caac5c9b0 tempest-CreateVolumesFromSnapshotTest-1650134941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5815fcc3-2905-43da-8853-be45cfc92d87 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5815fcc3-2905-43da-8853-be45cfc92d87.73ab7430-84e2-400c-adc7-ea3648c62814" returned: 0 in 0.568s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:32 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-afaca548-f325-418b-a34a-022caac5c9b0 tempest-CreateVolumesFromSnapshotTest-1650134941 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5815fcc3-2905-43da-8853-be45cfc92d87.73ab7430-84e2-400c-adc7-ea3648c62814 is being set with open permissions: ugo+rw
Feb 27 01:31:32 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-afaca548-f325-418b-a34a-022caac5c9b0 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5815fcc3-2905-43da-8853-be45cfc92d87.73ab7430-84e2-400c-adc7-ea3648c62814 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:32 devstack sudo[90716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5815fcc3-2905-43da-8853-be45cfc92d87.73ab7430-84e2-400c-adc7-ea3648c62814
Feb 27 01:31:32 devstack sudo[90716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:33 devstack sudo[90716]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:33 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-afaca548-f325-418b-a34a-022caac5c9b0 tempest-CreateVolumesFromSnapshotTest-1650134941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5815fcc3-2905-43da-8853-be45cfc92d87.73ab7430-84e2-400c-adc7-ea3648c62814" returned: 0 in 0.519s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:33 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-beb950dc-1cb5-4a8b-bd41-a37a0a7d3d0f tempest-CreateVolumesFromImageTest-1511424860 None] Acquiring lock "cinder-d9e092a6-bcb9-4012-85d3-352ffe913c92-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:31:33 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-afaca548-f325-418b-a34a-022caac5c9b0 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5815fcc3-2905-43da-8853-be45cfc92d87.info {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:33 devstack sudo[90713]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:33 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-beb950dc-1cb5-4a8b-bd41-a37a0a7d3d0f tempest-CreateVolumesFromImageTest-1511424860 None] Lock "cinder-d9e092a6-bcb9-4012-85d3-352ffe913c92-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:31:33 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-db3cb165-0072-4adf-a248-0637f17b469a tempest-CreateVolumesFromImageTest-1511424860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.639s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:33 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-db3cb165-0072-4adf-a248-0637f17b469a tempest-CreateVolumesFromImageTest-1511424860 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:31:33 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-db3cb165-0072-4adf-a248-0637f17b469a tempest-CreateVolumesFromImageTest-1511424860 None] Deleted volume successfully.
Feb 27 01:31:33 devstack sudo[90720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5815fcc3-2905-43da-8853-be45cfc92d87.info
Feb 27 01:31:33 devstack sudo[90720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:33 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-db3cb165-0072-4adf-a248-0637f17b469a tempest-CreateVolumesFromImageTest-1511424860 None] Lock "cinder-03f113eb-acef-407d-b978-4c7192102543-delete_volume" released by "delete_volume" :: held 2.292s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:31:33 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-beb950dc-1cb5-4a8b-bd41-a37a0a7d3d0f tempest-CreateVolumesFromImageTest-1511424860 None] Acquiring lock "cinder-quobyte-d9e092a6-bcb9-4012-85d3-352ffe913c92" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:31:33 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-beb950dc-1cb5-4a8b-bd41-a37a0a7d3d0f tempest-CreateVolumesFromImageTest-1511424860 None] Lock "cinder-quobyte-d9e092a6-bcb9-4012-85d3-352ffe913c92" acquired by "delete_volume" :: waited 0.008s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:31:33 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1515116-88bb-4def-9920-3652ca417491]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:31:33 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-beb950dc-1cb5-4a8b-bd41-a37a0a7d3d0f tempest-CreateVolumesFromImageTest-1511424860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-d9e092a6-bcb9-4012-85d3-352ffe913c92 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:33 devstack sudo[90722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-d9e092a6-bcb9-4012-85d3-352ffe913c92
Feb 27 01:31:33 devstack sudo[90722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:33 devstack sudo[90720]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:33 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-afaca548-f325-418b-a34a-022caac5c9b0 tempest-CreateVolumesFromSnapshotTest-1650134941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5815fcc3-2905-43da-8853-be45cfc92d87.info" returned: 0 in 0.584s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:33 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-afaca548-f325-418b-a34a-022caac5c9b0 tempest-CreateVolumesFromSnapshotTest-1650134941 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5815fcc3-2905-43da-8853-be45cfc92d87.info is being set with open permissions: ugo+rw
Feb 27 01:31:33 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-afaca548-f325-418b-a34a-022caac5c9b0 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5815fcc3-2905-43da-8853-be45cfc92d87.info {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:34 devstack sudo[90728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5815fcc3-2905-43da-8853-be45cfc92d87.info
Feb 27 01:31:34 devstack sudo[90728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:34 devstack sudo[90722]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:34 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-beb950dc-1cb5-4a8b-bd41-a37a0a7d3d0f tempest-CreateVolumesFromImageTest-1511424860 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-d9e092a6-bcb9-4012-85d3-352ffe913c92" returned: 0 in 0.604s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:34 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-beb950dc-1cb5-4a8b-bd41-a37a0a7d3d0f tempest-CreateVolumesFromImageTest-1511424860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-d9e092a6-bcb9-4012-85d3-352ffe913c92 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:34 devstack sudo[90730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-d9e092a6-bcb9-4012-85d3-352ffe913c92
Feb 27 01:31:34 devstack sudo[90730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:34 devstack sudo[90728]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:34 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-afaca548-f325-418b-a34a-022caac5c9b0 tempest-CreateVolumesFromSnapshotTest-1650134941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5815fcc3-2905-43da-8853-be45cfc92d87.info" returned: 0 in 0.486s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:34 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-afaca548-f325-418b-a34a-022caac5c9b0 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.702s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:34 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-c6aeedba-7409-4dc9-853c-e1915efd89de tempest-VolumeDependencyTests-1629780687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.134s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:34 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-c6aeedba-7409-4dc9-853c-e1915efd89de tempest-VolumeDependencyTests-1629780687 None] Creating offline snapshot 2f0a7b04-507b-402b-a1af-5dd3cf26e9e9 of volume dd4d9c8f-dd57-4215-b446-acc20caccba2 {{(pid=83106) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:31:34 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-afaca548-f325-418b-a34a-022caac5c9b0 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Create snapshot completed successfully
Feb 27 01:31:34 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ccdf9e-78b1-4d6b-a253-3af5d4781136]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:31:34 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c6aeedba-7409-4dc9-853c-e1915efd89de tempest-VolumeDependencyTests-1629780687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4d9c8f-dd57-4215-b446-acc20caccba2 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:34 devstack sudo[90734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4d9c8f-dd57-4215-b446-acc20caccba2
Feb 27 01:31:34 devstack sudo[90734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:34 devstack sudo[90730]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:34 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-beb950dc-1cb5-4a8b-bd41-a37a0a7d3d0f tempest-CreateVolumesFromImageTest-1511424860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-d9e092a6-bcb9-4012-85d3-352ffe913c92" returned: 0 in 0.731s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:34 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-beb950dc-1cb5-4a8b-bd41-a37a0a7d3d0f tempest-CreateVolumesFromImageTest-1511424860 None] Lock "cinder-quobyte-d9e092a6-bcb9-4012-85d3-352ffe913c92" released by "delete_volume" :: held 1.361s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:31:34 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-beb950dc-1cb5-4a8b-bd41-a37a0a7d3d0f tempest-CreateVolumesFromImageTest-1511424860 None] Created reservations ['d1c8f217-1f66-43fd-9b94-c717552195de', 'ab5f186c-a2b9-4160-af68-bc8808ed5183', 'f43fd9db-04e6-4f5e-8c55-469274f2eea5', '53b5ee3b-a5d3-4a6d-a5e9-287db0ade8f9'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:31:35 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-beb950dc-1cb5-4a8b-bd41-a37a0a7d3d0f tempest-CreateVolumesFromImageTest-1511424860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:35 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-beb950dc-1cb5-4a8b-bd41-a37a0a7d3d0f tempest-CreateVolumesFromImageTest-1511424860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:35 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-beb950dc-1cb5-4a8b-bd41-a37a0a7d3d0f tempest-CreateVolumesFromImageTest-1511424860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:31:35 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-beb950dc-1cb5-4a8b-bd41-a37a0a7d3d0f tempest-CreateVolumesFromImageTest-1511424860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:31:35 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-beb950dc-1cb5-4a8b-bd41-a37a0a7d3d0f tempest-CreateVolumesFromImageTest-1511424860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:35 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-beb950dc-1cb5-4a8b-bd41-a37a0a7d3d0f tempest-CreateVolumesFromImageTest-1511424860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:35 devstack sudo[90737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:31:35 devstack sudo[90737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:35 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4a14a0c-6678-4ef4-944f-2844616e5b88 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:31:35 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a4a14a0c-6678-4ef4-944f-2844616e5b88 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Flow 'volume_create_manager' (17bf5e56-9c38-4d04-a2f1-3af5c4ab118a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:31:35 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a4a14a0c-6678-4ef4-944f-2844616e5b88 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c41e470d-c837-49bf-b3e3-0eb2ea4ddc04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:35 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a4a14a0c-6678-4ef4-944f-2844616e5b88 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c41e470d-c837-49bf-b3e3-0eb2ea4ddc04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:31:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-890492443',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9b3bb4c-7235-406f-9359-225fd1a282d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b73782ca97844d9f9a5a8eb4f4722b89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:31:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:31:35Z,use_quota=True,user_id='da6d7809bdb24bf1b6059fd5ecf5bf87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:35 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a4a14a0c-6678-4ef4-944f-2844616e5b88 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75a51dcc-cb12-4fbd-a7c4-742d7f5583b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:35 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a4a14a0c-6678-4ef4-944f-2844616e5b88 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75a51dcc-cb12-4fbd-a7c4-742d7f5583b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:35 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a4a14a0c-6678-4ef4-944f-2844616e5b88 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ba08467-4274-40b0-b1c1-8d935447a6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:35 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a4a14a0c-6678-4ef4-944f-2844616e5b88 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ba08467-4274-40b0-b1c1-8d935447a6d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9b3bb4c-7235-406f-9359-225fd1a282d1', 'volume_name': 'volume-c9b3bb4c-7235-406f-9359-225fd1a282d1', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:35 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a4a14a0c-6678-4ef4-944f-2844616e5b88 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f7129a3-fba3-4fb5-96d3-3e7a63d3fb0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:35 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a4a14a0c-6678-4ef4-944f-2844616e5b88 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f7129a3-fba3-4fb5-96d3-3e7a63d3fb0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:35 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a4a14a0c-6678-4ef4-944f-2844616e5b88 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17dd6565-b5a3-4a55-bdeb-9bee9fae9f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:35 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-a4a14a0c-6678-4ef4-944f-2844616e5b88 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Volume c9b3bb4c-7235-406f-9359-225fd1a282d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9b3bb4c-7235-406f-9359-225fd1a282d1', 'volume_size': 1}
Feb 27 01:31:35 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-a4a14a0c-6678-4ef4-944f-2844616e5b88 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:35 devstack sudo[90734]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:35 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c6aeedba-7409-4dc9-853c-e1915efd89de tempest-VolumeDependencyTests-1629780687 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4d9c8f-dd57-4215-b446-acc20caccba2" returned: 0 in 0.909s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:35 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c6aeedba-7409-4dc9-853c-e1915efd89de tempest-VolumeDependencyTests-1629780687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4d9c8f-dd57-4215-b446-acc20caccba2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4d9c8f-dd57-4215-b446-acc20caccba2.2f0a7b04-507b-402b-a1af-5dd3cf26e9e9 1G {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:35 devstack sudo[90742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4d9c8f-dd57-4215-b446-acc20caccba2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4d9c8f-dd57-4215-b446-acc20caccba2.2f0a7b04-507b-402b-a1af-5dd3cf26e9e9 1G
Feb 27 01:31:35 devstack sudo[90742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:35 devstack sudo[90737]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:35 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-beb950dc-1cb5-4a8b-bd41-a37a0a7d3d0f tempest-CreateVolumesFromImageTest-1511424860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.662s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:35 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-beb950dc-1cb5-4a8b-bd41-a37a0a7d3d0f tempest-CreateVolumesFromImageTest-1511424860 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:31:35 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-beb950dc-1cb5-4a8b-bd41-a37a0a7d3d0f tempest-CreateVolumesFromImageTest-1511424860 None] Deleted volume successfully.
Feb 27 01:31:35 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-593a4ea5-4edb-48b9-ac2a-c183d63a8ee6 tempest-CreateVolumesFromImageTest-1511424860 None] Acquiring lock "cinder-7fb734cd-ad09-4109-bd5f-06c257424017-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:31:35 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-beb950dc-1cb5-4a8b-bd41-a37a0a7d3d0f tempest-CreateVolumesFromImageTest-1511424860 None] Lock "cinder-d9e092a6-bcb9-4012-85d3-352ffe913c92-delete_volume" released by "delete_volume" :: held 2.302s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:31:35 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-593a4ea5-4edb-48b9-ac2a-c183d63a8ee6 tempest-CreateVolumesFromImageTest-1511424860 None] Lock "cinder-7fb734cd-ad09-4109-bd5f-06c257424017-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:31:35 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-593a4ea5-4edb-48b9-ac2a-c183d63a8ee6 tempest-CreateVolumesFromImageTest-1511424860 None] Acquiring lock "cinder-quobyte-7fb734cd-ad09-4109-bd5f-06c257424017" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:31:35 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-593a4ea5-4edb-48b9-ac2a-c183d63a8ee6 tempest-CreateVolumesFromImageTest-1511424860 None] Lock "cinder-quobyte-7fb734cd-ad09-4109-bd5f-06c257424017" acquired by "delete_volume" :: waited 0.009s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:31:35 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[47769eb0-105f-4b2e-a6ab-676a678c158b]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:31:35 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-593a4ea5-4edb-48b9-ac2a-c183d63a8ee6 tempest-CreateVolumesFromImageTest-1511424860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-7fb734cd-ad09-4109-bd5f-06c257424017 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:35 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-c55d4130-a2f8-4e71-8a91-9cfad60282f7 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:31:35 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c55d4130-a2f8-4e71-8a91-9cfad60282f7 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Flow 'volume_create_manager' (e610f84d-3c2d-4af0-9acc-5219b48a2cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:31:35 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c55d4130-a2f8-4e71-8a91-9cfad60282f7 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7771b087-6593-4829-a883-7cf45545b6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:35 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c55d4130-a2f8-4e71-8a91-9cfad60282f7 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7771b087-6593-4829-a883-7cf45545b6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:31:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1269642522',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bd003fb-9b49-491f-af9a-bc449a84823e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b73782ca97844d9f9a5a8eb4f4722b89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:31:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:31:36Z,use_quota=True,user_id='da6d7809bdb24bf1b6059fd5ecf5bf87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:35 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c55d4130-a2f8-4e71-8a91-9cfad60282f7 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b05c44f6-3f9b-4b0f-93f0-02570cebf23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:35 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c55d4130-a2f8-4e71-8a91-9cfad60282f7 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b05c44f6-3f9b-4b0f-93f0-02570cebf23b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:35 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c55d4130-a2f8-4e71-8a91-9cfad60282f7 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (135b156e-4fbc-4c23-85d7-6012dacdadc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:35 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c55d4130-a2f8-4e71-8a91-9cfad60282f7 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (135b156e-4fbc-4c23-85d7-6012dacdadc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bd003fb-9b49-491f-af9a-bc449a84823e', 'volume_name': 'volume-8bd003fb-9b49-491f-af9a-bc449a84823e', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:35 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c55d4130-a2f8-4e71-8a91-9cfad60282f7 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (864f9cab-e96d-4f1a-91f0-a4421d9fc0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:35 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c55d4130-a2f8-4e71-8a91-9cfad60282f7 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (864f9cab-e96d-4f1a-91f0-a4421d9fc0f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:35 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c55d4130-a2f8-4e71-8a91-9cfad60282f7 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef086500-9a76-47e1-aeef-21d19046f01c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:35 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-c55d4130-a2f8-4e71-8a91-9cfad60282f7 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Volume 8bd003fb-9b49-491f-af9a-bc449a84823e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bd003fb-9b49-491f-af9a-bc449a84823e', 'volume_size': 1}
Feb 27 01:31:35 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-c55d4130-a2f8-4e71-8a91-9cfad60282f7 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:35 devstack sudo[90745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-7fb734cd-ad09-4109-bd5f-06c257424017
Feb 27 01:31:35 devstack sudo[90745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:36 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-2257485a-791d-4962-b2b3-13ccdbe6c58b tempest-CreateVolumesFromSnapshotTest-1650134941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:31:36 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-2257485a-791d-4962-b2b3-13ccdbe6c58b tempest-CreateVolumesFromSnapshotTest-1650134941 None] Flow 'volume_create_manager' (6d489519-486d-438d-bca4-ab77815bf9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:31:36 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-2257485a-791d-4962-b2b3-13ccdbe6c58b tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9657f99-8b92-4a56-b529-5420e7fd8e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:36 devstack sudo[90742]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:36 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-2257485a-791d-4962-b2b3-13ccdbe6c58b tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9657f99-8b92-4a56-b529-5420e7fd8e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:31:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-111422669',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e0c9a06-b384-44de-b251-7579811d20e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b73782ca97844d9f9a5a8eb4f4722b89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:31:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:31:36Z,use_quota=True,user_id='da6d7809bdb24bf1b6059fd5ecf5bf87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:36 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-2257485a-791d-4962-b2b3-13ccdbe6c58b tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9193b47-c028-4cf5-b275-d75efe30ccc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:36 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-2257485a-791d-4962-b2b3-13ccdbe6c58b tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9193b47-c028-4cf5-b275-d75efe30ccc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:36 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-2257485a-791d-4962-b2b3-13ccdbe6c58b tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dcf356c-438e-4d8c-8de6-6596e807fcb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:36 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-2257485a-791d-4962-b2b3-13ccdbe6c58b tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dcf356c-438e-4d8c-8de6-6596e807fcb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e0c9a06-b384-44de-b251-7579811d20e0', 'volume_name': 'volume-0e0c9a06-b384-44de-b251-7579811d20e0', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:36 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-2257485a-791d-4962-b2b3-13ccdbe6c58b tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c1a2cc2-cfac-441c-aabc-b997be2bca9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:36 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-2257485a-791d-4962-b2b3-13ccdbe6c58b tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c1a2cc2-cfac-441c-aabc-b997be2bca9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:36 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-2257485a-791d-4962-b2b3-13ccdbe6c58b tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15cc5f6f-4164-4407-a0e7-38a261602b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:36 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-2257485a-791d-4962-b2b3-13ccdbe6c58b tempest-CreateVolumesFromSnapshotTest-1650134941 None] Volume 0e0c9a06-b384-44de-b251-7579811d20e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e0c9a06-b384-44de-b251-7579811d20e0', 'volume_size': 1}
Feb 27 01:31:36 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-2257485a-791d-4962-b2b3-13ccdbe6c58b tempest-CreateVolumesFromSnapshotTest-1650134941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:36 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c6aeedba-7409-4dc9-853c-e1915efd89de tempest-VolumeDependencyTests-1629780687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4d9c8f-dd57-4215-b446-acc20caccba2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4d9c8f-dd57-4215-b446-acc20caccba2.2f0a7b04-507b-402b-a1af-5dd3cf26e9e9 1G" returned: 0 in 0.801s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:36 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c6aeedba-7409-4dc9-853c-e1915efd89de tempest-VolumeDependencyTests-1629780687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd4d9c8f-dd57-4215-b446-acc20caccba2 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4d9c8f-dd57-4215-b446-acc20caccba2.2f0a7b04-507b-402b-a1af-5dd3cf26e9e9 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:36 devstack sudo[90750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd4d9c8f-dd57-4215-b446-acc20caccba2 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4d9c8f-dd57-4215-b446-acc20caccba2.2f0a7b04-507b-402b-a1af-5dd3cf26e9e9
Feb 27 01:31:36 devstack sudo[90750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:36 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-f89514de-71a7-4d05-99b3-c67d08e4a16c tempest-CreateVolumesFromSnapshotTest-1650134941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:31:36 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-f89514de-71a7-4d05-99b3-c67d08e4a16c tempest-CreateVolumesFromSnapshotTest-1650134941 None] Flow 'volume_create_manager' (6ec4da56-4b7a-4270-a71c-66fd26007ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:31:36 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-f89514de-71a7-4d05-99b3-c67d08e4a16c tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3648ff4-298c-4f40-809b-9ce6f2871bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:36 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-f89514de-71a7-4d05-99b3-c67d08e4a16c tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3648ff4-298c-4f40-809b-9ce6f2871bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:31:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-531041952',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21e42b91-4af1-4309-b920-a0e227fdfb62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b73782ca97844d9f9a5a8eb4f4722b89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:31:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:31:36Z,use_quota=True,user_id='da6d7809bdb24bf1b6059fd5ecf5bf87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:36 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-f89514de-71a7-4d05-99b3-c67d08e4a16c tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65a3bc7e-1f6a-4f5b-a76b-65473cd87a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:36 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-f89514de-71a7-4d05-99b3-c67d08e4a16c tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65a3bc7e-1f6a-4f5b-a76b-65473cd87a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:36 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-f89514de-71a7-4d05-99b3-c67d08e4a16c tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (793994b6-b2b0-4af0-84fa-3c26f8ba7b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:36 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-f89514de-71a7-4d05-99b3-c67d08e4a16c tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (793994b6-b2b0-4af0-84fa-3c26f8ba7b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21e42b91-4af1-4309-b920-a0e227fdfb62', 'volume_name': 'volume-21e42b91-4af1-4309-b920-a0e227fdfb62', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:36 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-f89514de-71a7-4d05-99b3-c67d08e4a16c tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f40bf995-f11a-47cf-b38e-0695eb578a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:36 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-f89514de-71a7-4d05-99b3-c67d08e4a16c tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f40bf995-f11a-47cf-b38e-0695eb578a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:36 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-f89514de-71a7-4d05-99b3-c67d08e4a16c tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df615e3c-0223-4e41-b466-efce8e5c8af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:36 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-f89514de-71a7-4d05-99b3-c67d08e4a16c tempest-CreateVolumesFromSnapshotTest-1650134941 None] Volume 21e42b91-4af1-4309-b920-a0e227fdfb62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21e42b91-4af1-4309-b920-a0e227fdfb62', 'volume_size': 1}
Feb 27 01:31:36 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-f89514de-71a7-4d05-99b3-c67d08e4a16c tempest-CreateVolumesFromSnapshotTest-1650134941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:36 devstack sudo[90745]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:36 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-593a4ea5-4edb-48b9-ac2a-c183d63a8ee6 tempest-CreateVolumesFromImageTest-1511424860 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-7fb734cd-ad09-4109-bd5f-06c257424017" returned: 0 in 0.908s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:36 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-593a4ea5-4edb-48b9-ac2a-c183d63a8ee6 tempest-CreateVolumesFromImageTest-1511424860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-7fb734cd-ad09-4109-bd5f-06c257424017 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:36 devstack sudo[90755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-7fb734cd-ad09-4109-bd5f-06c257424017
Feb 27 01:31:36 devstack sudo[90755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:36 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f7a090d-d8c7-4044-8472-ad0f8b33a2fe tempest-CreateVolumesFromSnapshotTest-1650134941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:31:36 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1f7a090d-d8c7-4044-8472-ad0f8b33a2fe tempest-CreateVolumesFromSnapshotTest-1650134941 None] Flow 'volume_create_manager' (d5e27177-0f68-4ad0-af10-7a2a6b13b7f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:31:36 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1f7a090d-d8c7-4044-8472-ad0f8b33a2fe tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f62e9f37-af75-4a34-aa91-68cd22aed1ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:36 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1f7a090d-d8c7-4044-8472-ad0f8b33a2fe tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f62e9f37-af75-4a34-aa91-68cd22aed1ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:31:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1739177765',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=213ca0f0-adcd-46a3-8325-c9d47c31a737,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b73782ca97844d9f9a5a8eb4f4722b89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:31:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:31:37Z,use_quota=True,user_id='da6d7809bdb24bf1b6059fd5ecf5bf87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:36 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1f7a090d-d8c7-4044-8472-ad0f8b33a2fe tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df4cebba-3e8d-4097-8cf0-20119ad6a245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:36 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1f7a090d-d8c7-4044-8472-ad0f8b33a2fe tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df4cebba-3e8d-4097-8cf0-20119ad6a245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:36 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1f7a090d-d8c7-4044-8472-ad0f8b33a2fe tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78ed74fb-89b3-4dc6-aa73-ef7e5e16d978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:36 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1f7a090d-d8c7-4044-8472-ad0f8b33a2fe tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78ed74fb-89b3-4dc6-aa73-ef7e5e16d978) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '213ca0f0-adcd-46a3-8325-c9d47c31a737', 'volume_name': 'volume-213ca0f0-adcd-46a3-8325-c9d47c31a737', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:36 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1f7a090d-d8c7-4044-8472-ad0f8b33a2fe tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fef4496-a43a-471a-abe1-f927a828e9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:36 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1f7a090d-d8c7-4044-8472-ad0f8b33a2fe tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fef4496-a43a-471a-abe1-f927a828e9b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:36 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1f7a090d-d8c7-4044-8472-ad0f8b33a2fe tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f16e50f0-84f1-417d-a4e1-82560acb487b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:36 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-1f7a090d-d8c7-4044-8472-ad0f8b33a2fe tempest-CreateVolumesFromSnapshotTest-1650134941 None] Volume 213ca0f0-adcd-46a3-8325-c9d47c31a737: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-213ca0f0-adcd-46a3-8325-c9d47c31a737', 'volume_size': 1}
Feb 27 01:31:36 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-1f7a090d-d8c7-4044-8472-ad0f8b33a2fe tempest-CreateVolumesFromSnapshotTest-1650134941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:37 devstack sudo[90750]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c6aeedba-7409-4dc9-853c-e1915efd89de tempest-VolumeDependencyTests-1629780687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd4d9c8f-dd57-4215-b446-acc20caccba2 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4d9c8f-dd57-4215-b446-acc20caccba2.2f0a7b04-507b-402b-a1af-5dd3cf26e9e9" returned: 0 in 0.736s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:37 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-c6aeedba-7409-4dc9-853c-e1915efd89de tempest-VolumeDependencyTests-1629780687 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4d9c8f-dd57-4215-b446-acc20caccba2.2f0a7b04-507b-402b-a1af-5dd3cf26e9e9 is being set with open permissions: ugo+rw
Feb 27 01:31:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c6aeedba-7409-4dc9-853c-e1915efd89de tempest-VolumeDependencyTests-1629780687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4d9c8f-dd57-4215-b446-acc20caccba2.2f0a7b04-507b-402b-a1af-5dd3cf26e9e9 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:37 devstack sudo[90760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4d9c8f-dd57-4215-b446-acc20caccba2.2f0a7b04-507b-402b-a1af-5dd3cf26e9e9
Feb 27 01:31:37 devstack sudo[90760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:37 devstack sudo[90755]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-593a4ea5-4edb-48b9-ac2a-c183d63a8ee6 tempest-CreateVolumesFromImageTest-1511424860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-7fb734cd-ad09-4109-bd5f-06c257424017" returned: 0 in 0.493s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:37 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-593a4ea5-4edb-48b9-ac2a-c183d63a8ee6 tempest-CreateVolumesFromImageTest-1511424860 None] Lock "cinder-quobyte-7fb734cd-ad09-4109-bd5f-06c257424017" released by "delete_volume" :: held 1.438s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:31:37 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-593a4ea5-4edb-48b9-ac2a-c183d63a8ee6 tempest-CreateVolumesFromImageTest-1511424860 None] Created reservations ['9b6333d9-f31b-4299-bfc6-dd562d691c60', '05d46644-cc84-4495-8848-a56d1769f144', '01594fd5-3316-4a04-a011-865c9225c0f6', '7e05c302-a1ff-44d8-9bb0-0235c466a28f'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:31:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-593a4ea5-4edb-48b9-ac2a-c183d63a8ee6 tempest-CreateVolumesFromImageTest-1511424860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-593a4ea5-4edb-48b9-ac2a-c183d63a8ee6 tempest-CreateVolumesFromImageTest-1511424860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:37 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-593a4ea5-4edb-48b9-ac2a-c183d63a8ee6 tempest-CreateVolumesFromImageTest-1511424860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:31:37 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-593a4ea5-4edb-48b9-ac2a-c183d63a8ee6 tempest-CreateVolumesFromImageTest-1511424860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:31:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-593a4ea5-4edb-48b9-ac2a-c183d63a8ee6 tempest-CreateVolumesFromImageTest-1511424860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-593a4ea5-4edb-48b9-ac2a-c183d63a8ee6 tempest-CreateVolumesFromImageTest-1511424860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:37 devstack sudo[90763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:31:37 devstack sudo[90763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:37 devstack sudo[90760]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c6aeedba-7409-4dc9-853c-e1915efd89de tempest-VolumeDependencyTests-1629780687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4d9c8f-dd57-4215-b446-acc20caccba2.2f0a7b04-507b-402b-a1af-5dd3cf26e9e9" returned: 0 in 0.517s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c6aeedba-7409-4dc9-853c-e1915efd89de tempest-VolumeDependencyTests-1629780687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4d9c8f-dd57-4215-b446-acc20caccba2.info {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:37 devstack sudo[90766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4d9c8f-dd57-4215-b446-acc20caccba2.info
Feb 27 01:31:37 devstack sudo[90766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:37 devstack sudo[90763]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:37 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-593a4ea5-4edb-48b9-ac2a-c183d63a8ee6 tempest-CreateVolumesFromImageTest-1511424860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.471s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:37 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-593a4ea5-4edb-48b9-ac2a-c183d63a8ee6 tempest-CreateVolumesFromImageTest-1511424860 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:31:37 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-593a4ea5-4edb-48b9-ac2a-c183d63a8ee6 tempest-CreateVolumesFromImageTest-1511424860 None] Deleted volume successfully.
Feb 27 01:31:37 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-593a4ea5-4edb-48b9-ac2a-c183d63a8ee6 tempest-CreateVolumesFromImageTest-1511424860 None] Lock "cinder-7fb734cd-ad09-4109-bd5f-06c257424017-delete_volume" released by "delete_volume" :: held 2.085s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:31:37 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-8c98d5c3-2801-430d-9ad7-f62aa864514f tempest-CreateVolumesFromImageTest-1511424860 None] Acquiring lock "cinder-2773dcd8-bf3a-4a4c-940c-ed7bc327995e-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:31:37 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-8c98d5c3-2801-430d-9ad7-f62aa864514f tempest-CreateVolumesFromImageTest-1511424860 None] Lock "cinder-2773dcd8-bf3a-4a4c-940c-ed7bc327995e-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:31:37 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-8c98d5c3-2801-430d-9ad7-f62aa864514f tempest-CreateVolumesFromImageTest-1511424860 None] Acquiring lock "cinder-quobyte-2773dcd8-bf3a-4a4c-940c-ed7bc327995e" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:31:37 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-8c98d5c3-2801-430d-9ad7-f62aa864514f tempest-CreateVolumesFromImageTest-1511424860 None] Lock "cinder-quobyte-2773dcd8-bf3a-4a4c-940c-ed7bc327995e" acquired by "delete_volume" :: waited 0.046s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:31:38 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e751b4-e243-4817-8278-d8ddc1e5e45c]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:31:38 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-8c98d5c3-2801-430d-9ad7-f62aa864514f tempest-CreateVolumesFromImageTest-1511424860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-2773dcd8-bf3a-4a4c-940c-ed7bc327995e {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:38 devstack sudo[90766]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:38 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c6aeedba-7409-4dc9-853c-e1915efd89de tempest-VolumeDependencyTests-1629780687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4d9c8f-dd57-4215-b446-acc20caccba2.info" returned: 0 in 0.568s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:38 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-c6aeedba-7409-4dc9-853c-e1915efd89de tempest-VolumeDependencyTests-1629780687 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4d9c8f-dd57-4215-b446-acc20caccba2.info is being set with open permissions: ugo+rw
Feb 27 01:31:38 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c6aeedba-7409-4dc9-853c-e1915efd89de tempest-VolumeDependencyTests-1629780687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4d9c8f-dd57-4215-b446-acc20caccba2.info {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:38 devstack sudo[90769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-2773dcd8-bf3a-4a4c-940c-ed7bc327995e
Feb 27 01:31:38 devstack sudo[90769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:38 devstack sudo[90771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4d9c8f-dd57-4215-b446-acc20caccba2.info
Feb 27 01:31:38 devstack sudo[90771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:38 devstack sudo[90771]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:38 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c6aeedba-7409-4dc9-853c-e1915efd89de tempest-VolumeDependencyTests-1629780687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4d9c8f-dd57-4215-b446-acc20caccba2.info" returned: 0 in 0.517s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:38 devstack sudo[90769]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:38 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-c6aeedba-7409-4dc9-853c-e1915efd89de tempest-VolumeDependencyTests-1629780687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.151s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:38 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-a4a14a0c-6678-4ef4-944f-2844616e5b88 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.203s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:38 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-a4a14a0c-6678-4ef4-944f-2844616e5b88 tempest-CreateVolumesFromSnapshotTest-1650134941 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:31:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-890492443',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9b3bb4c-7235-406f-9359-225fd1a282d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b73782ca97844d9f9a5a8eb4f4722b89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:31:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:31:35Z,use_quota=True,user_id='da6d7809bdb24bf1b6059fd5ecf5bf87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:31:38 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-a4a14a0c-6678-4ef4-944f-2844616e5b88 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Creating volume c9b3bb4c-7235-406f-9359-225fd1a282d1 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:31:38 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-a4a14a0c-6678-4ef4-944f-2844616e5b88 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:38 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-a4a14a0c-6678-4ef4-944f-2844616e5b88 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:38 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-a4a14a0c-6678-4ef4-944f-2844616e5b88 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:31:38 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-a4a14a0c-6678-4ef4-944f-2844616e5b88 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:31:38 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-a4a14a0c-6678-4ef4-944f-2844616e5b88 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:38 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-a4a14a0c-6678-4ef4-944f-2844616e5b88 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:31:38 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-a4a14a0c-6678-4ef4-944f-2844616e5b88 tempest-CreateVolumesFromSnapshotTest-1650134941 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:31:38 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a4a14a0c-6678-4ef4-944f-2844616e5b88 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c9b3bb4c-7235-406f-9359-225fd1a282d1 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:38 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-8c98d5c3-2801-430d-9ad7-f62aa864514f tempest-CreateVolumesFromImageTest-1511424860 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-2773dcd8-bf3a-4a4c-940c-ed7bc327995e" returned: 0 in 0.673s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:38 devstack sudo[90778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c9b3bb4c-7235-406f-9359-225fd1a282d1 1073741824
Feb 27 01:31:38 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-8c98d5c3-2801-430d-9ad7-f62aa864514f tempest-CreateVolumesFromImageTest-1511424860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-2773dcd8-bf3a-4a4c-940c-ed7bc327995e {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:38 devstack sudo[90778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:38 devstack sudo[90780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-2773dcd8-bf3a-4a4c-940c-ed7bc327995e
Feb 27 01:31:38 devstack sudo[90780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:38 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-c6aeedba-7409-4dc9-853c-e1915efd89de tempest-VolumeDependencyTests-1629780687 None] Create snapshot completed successfully
Feb 27 01:31:39 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-12ee81f9-f50f-49aa-9134-16ba1dd72a32 tempest-SnapshotDependencyTests-277758335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:31:39 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-12ee81f9-f50f-49aa-9134-16ba1dd72a32 tempest-SnapshotDependencyTests-277758335 None] Flow 'volume_create_manager' (a0a5990d-7413-433a-a2fd-6dafe2f6ef76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:31:39 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-12ee81f9-f50f-49aa-9134-16ba1dd72a32 tempest-SnapshotDependencyTests-277758335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (314fea1a-4910-4476-8643-43353239b736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:39 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-12ee81f9-f50f-49aa-9134-16ba1dd72a32 tempest-SnapshotDependencyTests-277758335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (314fea1a-4910-4476-8643-43353239b736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:31:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-440609272',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0170b02c-0d22-4644-98ef-dbbd753a8989,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43e5a9252e0244bc8ff1b7e9f20ca60b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:31:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:31:39Z,use_quota=True,user_id='fede7c59fa3c416297fcece65bdb9b73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:39 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-12ee81f9-f50f-49aa-9134-16ba1dd72a32 tempest-SnapshotDependencyTests-277758335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d629d3e6-5e4e-44ab-bf1a-e8f5d05eb060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:39 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-12ee81f9-f50f-49aa-9134-16ba1dd72a32 tempest-SnapshotDependencyTests-277758335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d629d3e6-5e4e-44ab-bf1a-e8f5d05eb060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:39 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-12ee81f9-f50f-49aa-9134-16ba1dd72a32 tempest-SnapshotDependencyTests-277758335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1782cd13-6707-4c35-98f2-194c652f3869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:39 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-12ee81f9-f50f-49aa-9134-16ba1dd72a32 tempest-SnapshotDependencyTests-277758335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1782cd13-6707-4c35-98f2-194c652f3869) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0170b02c-0d22-4644-98ef-dbbd753a8989', 'volume_name': 'volume-0170b02c-0d22-4644-98ef-dbbd753a8989', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:39 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-12ee81f9-f50f-49aa-9134-16ba1dd72a32 tempest-SnapshotDependencyTests-277758335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bad2da69-d043-4207-a5bd-6b3c8808df20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:39 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-12ee81f9-f50f-49aa-9134-16ba1dd72a32 tempest-SnapshotDependencyTests-277758335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bad2da69-d043-4207-a5bd-6b3c8808df20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:39 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-12ee81f9-f50f-49aa-9134-16ba1dd72a32 tempest-SnapshotDependencyTests-277758335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (303438ea-fd43-4e27-ac69-fbb78e7ca61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:39 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-12ee81f9-f50f-49aa-9134-16ba1dd72a32 tempest-SnapshotDependencyTests-277758335 None] Volume 0170b02c-0d22-4644-98ef-dbbd753a8989: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0170b02c-0d22-4644-98ef-dbbd753a8989', 'volume_size': 1}
Feb 27 01:31:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-12ee81f9-f50f-49aa-9134-16ba1dd72a32 tempest-SnapshotDependencyTests-277758335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:39 devstack sudo[90780]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-8c98d5c3-2801-430d-9ad7-f62aa864514f tempest-CreateVolumesFromImageTest-1511424860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-2773dcd8-bf3a-4a4c-940c-ed7bc327995e" returned: 0 in 0.506s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:39 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-8c98d5c3-2801-430d-9ad7-f62aa864514f tempest-CreateVolumesFromImageTest-1511424860 None] Lock "cinder-quobyte-2773dcd8-bf3a-4a4c-940c-ed7bc327995e" released by "delete_volume" :: held 1.223s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:31:39 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-8c98d5c3-2801-430d-9ad7-f62aa864514f tempest-CreateVolumesFromImageTest-1511424860 None] Created reservations ['40570ab9-2ca4-41d7-acf5-162e7d508e50', '83da5fab-cb55-404f-9af8-ed0372247616', '2fdbc474-c76c-4d68-8edb-3edc28a1294a', '7e75cac0-a8ae-48ad-98a6-0be705c9eda9'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:31:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-8c98d5c3-2801-430d-9ad7-f62aa864514f tempest-CreateVolumesFromImageTest-1511424860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-8c98d5c3-2801-430d-9ad7-f62aa864514f tempest-CreateVolumesFromImageTest-1511424860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:39 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-8c98d5c3-2801-430d-9ad7-f62aa864514f tempest-CreateVolumesFromImageTest-1511424860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:31:39 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-8c98d5c3-2801-430d-9ad7-f62aa864514f tempest-CreateVolumesFromImageTest-1511424860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:31:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-8c98d5c3-2801-430d-9ad7-f62aa864514f tempest-CreateVolumesFromImageTest-1511424860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-8c98d5c3-2801-430d-9ad7-f62aa864514f tempest-CreateVolumesFromImageTest-1511424860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:39 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-349c6d87-3ece-42c8-a31c-63bdec1c8a55 tempest-VolumeDependencyTests-1629780687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:31:39 devstack sudo[90786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:31:39 devstack sudo[90786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:39 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-349c6d87-3ece-42c8-a31c-63bdec1c8a55 tempest-VolumeDependencyTests-1629780687 None] Flow 'volume_create_manager' (72c22c31-1d4c-462f-9afd-76c1a2432cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:31:39 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-349c6d87-3ece-42c8-a31c-63bdec1c8a55 tempest-VolumeDependencyTests-1629780687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (908eae5e-67b6-40f8-83b6-0be70bf326e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:39 devstack sudo[90778]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:39 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-349c6d87-3ece-42c8-a31c-63bdec1c8a55 tempest-VolumeDependencyTests-1629780687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (908eae5e-67b6-40f8-83b6-0be70bf326e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:31:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1300006283',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2c71716-5455-472c-afc3-f5230e47eb3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae46202a7c8e473eb29eb42c73fcbd9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:31:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2f0a7b04-507b-402b-a1af-5dd3cf26e9e9,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:31:39Z,use_quota=True,user_id='b3008ba5718f4609b1c16d3b5395869c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:39 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-349c6d87-3ece-42c8-a31c-63bdec1c8a55 tempest-VolumeDependencyTests-1629780687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01ce31b3-c888-4fd9-9a5a-01a0e30eb442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:39 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-349c6d87-3ece-42c8-a31c-63bdec1c8a55 tempest-VolumeDependencyTests-1629780687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01ce31b3-c888-4fd9-9a5a-01a0e30eb442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:39 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-349c6d87-3ece-42c8-a31c-63bdec1c8a55 tempest-VolumeDependencyTests-1629780687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2514d85e-ecd3-4b07-a608-ef3e6f3a3506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:39 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-349c6d87-3ece-42c8-a31c-63bdec1c8a55 tempest-VolumeDependencyTests-1629780687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2514d85e-ecd3-4b07-a608-ef3e6f3a3506) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a2c71716-5455-472c-afc3-f5230e47eb3c', 'volume_name': 'volume-a2c71716-5455-472c-afc3-f5230e47eb3c', 'volume_size': 1, 'snapshot_id': '2f0a7b04-507b-402b-a1af-5dd3cf26e9e9'}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:39 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-349c6d87-3ece-42c8-a31c-63bdec1c8a55 tempest-VolumeDependencyTests-1629780687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2b51287-cbaa-4d0e-8d05-be26fc7e80ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:39 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-349c6d87-3ece-42c8-a31c-63bdec1c8a55 tempest-VolumeDependencyTests-1629780687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2b51287-cbaa-4d0e-8d05-be26fc7e80ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:39 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-349c6d87-3ece-42c8-a31c-63bdec1c8a55 tempest-VolumeDependencyTests-1629780687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fb6c8bb-6d60-4418-84e3-39f1bae11973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:39 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-349c6d87-3ece-42c8-a31c-63bdec1c8a55 tempest-VolumeDependencyTests-1629780687 None] Volume a2c71716-5455-472c-afc3-f5230e47eb3c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a2c71716-5455-472c-afc3-f5230e47eb3c', 'volume_size': 1, 'snapshot_id': '2f0a7b04-507b-402b-a1af-5dd3cf26e9e9'}
Feb 27 01:31:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-349c6d87-3ece-42c8-a31c-63bdec1c8a55 tempest-VolumeDependencyTests-1629780687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a4a14a0c-6678-4ef4-944f-2844616e5b88 tempest-CreateVolumesFromSnapshotTest-1650134941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c9b3bb4c-7235-406f-9359-225fd1a282d1 1073741824" returned: 0 in 0.737s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a4a14a0c-6678-4ef4-944f-2844616e5b88 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c9b3bb4c-7235-406f-9359-225fd1a282d1 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:39 devstack sudo[90788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c9b3bb4c-7235-406f-9359-225fd1a282d1
Feb 27 01:31:39 devstack sudo[90788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:39 devstack sudo[90786]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-8c98d5c3-2801-430d-9ad7-f62aa864514f tempest-CreateVolumesFromImageTest-1511424860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.415s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:39 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-8c98d5c3-2801-430d-9ad7-f62aa864514f tempest-CreateVolumesFromImageTest-1511424860 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:31:39 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-8c98d5c3-2801-430d-9ad7-f62aa864514f tempest-CreateVolumesFromImageTest-1511424860 None] Deleted volume successfully.
Feb 27 01:31:39 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-8c98d5c3-2801-430d-9ad7-f62aa864514f tempest-CreateVolumesFromImageTest-1511424860 None] Lock "cinder-2773dcd8-bf3a-4a4c-940c-ed7bc327995e-delete_volume" released by "delete_volume" :: held 1.827s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:31:39 devstack sudo[90788]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a4a14a0c-6678-4ef4-944f-2844616e5b88 tempest-CreateVolumesFromSnapshotTest-1650134941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c9b3bb4c-7235-406f-9359-225fd1a282d1" returned: 0 in 0.526s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:39 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-a4a14a0c-6678-4ef4-944f-2844616e5b88 tempest-CreateVolumesFromSnapshotTest-1650134941 None] <== create_volume: return (1290ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:31:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-a4a14a0c-6678-4ef4-944f-2844616e5b88 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.293s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-c55d4130-a2f8-4e71-8a91-9cfad60282f7 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.041s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:39 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-c55d4130-a2f8-4e71-8a91-9cfad60282f7 tempest-CreateVolumesFromSnapshotTest-1650134941 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:31:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1269642522',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bd003fb-9b49-491f-af9a-bc449a84823e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b73782ca97844d9f9a5a8eb4f4722b89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:31:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:31:36Z,use_quota=True,user_id='da6d7809bdb24bf1b6059fd5ecf5bf87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:31:39 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-c55d4130-a2f8-4e71-8a91-9cfad60282f7 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Creating volume 8bd003fb-9b49-491f-af9a-bc449a84823e {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:31:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-c55d4130-a2f8-4e71-8a91-9cfad60282f7 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-c55d4130-a2f8-4e71-8a91-9cfad60282f7 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:39 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-c55d4130-a2f8-4e71-8a91-9cfad60282f7 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:31:39 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-c55d4130-a2f8-4e71-8a91-9cfad60282f7 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:31:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-c55d4130-a2f8-4e71-8a91-9cfad60282f7 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:39 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-c55d4130-a2f8-4e71-8a91-9cfad60282f7 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:31:39 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-c55d4130-a2f8-4e71-8a91-9cfad60282f7 tempest-CreateVolumesFromSnapshotTest-1650134941 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:31:39 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c55d4130-a2f8-4e71-8a91-9cfad60282f7 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8bd003fb-9b49-491f-af9a-bc449a84823e 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:39 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a4a14a0c-6678-4ef4-944f-2844616e5b88 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17dd6565-b5a3-4a55-bdeb-9bee9fae9f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9b3bb4c-7235-406f-9359-225fd1a282d1', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:39 devstack sudo[90792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8bd003fb-9b49-491f-af9a-bc449a84823e 1073741824
Feb 27 01:31:39 devstack sudo[90792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:39 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a4a14a0c-6678-4ef4-944f-2844616e5b88 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (043bfd68-cb5b-4991-a3c8-f6f61e048365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:40 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-a4a14a0c-6678-4ef4-944f-2844616e5b88 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Volume volume-c9b3bb4c-7235-406f-9359-225fd1a282d1 (c9b3bb4c-7235-406f-9359-225fd1a282d1): created successfully
Feb 27 01:31:40 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a4a14a0c-6678-4ef4-944f-2844616e5b88 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (043bfd68-cb5b-4991-a3c8-f6f61e048365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:40 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a4a14a0c-6678-4ef4-944f-2844616e5b88 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Flow 'volume_create_manager' (17bf5e56-9c38-4d04-a2f1-3af5c4ab118a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:31:40 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-a4a14a0c-6678-4ef4-944f-2844616e5b88 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Created volume successfully.
Feb 27 01:31:40 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-20e3485d-a780-415d-b682-308763f691b9 tempest-CreateVolumesFromImageTest-1511424860 None] Acquiring lock "cinder-a80a223a-724c-47fa-8584-1e0a344b6925-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:31:40 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-20e3485d-a780-415d-b682-308763f691b9 tempest-CreateVolumesFromImageTest-1511424860 None] Lock "cinder-a80a223a-724c-47fa-8584-1e0a344b6925-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:31:40 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-20e3485d-a780-415d-b682-308763f691b9 tempest-CreateVolumesFromImageTest-1511424860 None] Acquiring lock "cinder-quobyte-a80a223a-724c-47fa-8584-1e0a344b6925" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:31:40 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-20e3485d-a780-415d-b682-308763f691b9 tempest-CreateVolumesFromImageTest-1511424860 None] Lock "cinder-quobyte-a80a223a-724c-47fa-8584-1e0a344b6925" acquired by "delete_volume" :: waited 0.011s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:31:40 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[364a5627-7f70-48df-be7a-23679b2521a1]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:31:40 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-20e3485d-a780-415d-b682-308763f691b9 tempest-CreateVolumesFromImageTest-1511424860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-a80a223a-724c-47fa-8584-1e0a344b6925 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:40 devstack sudo[90794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-a80a223a-724c-47fa-8584-1e0a344b6925
Feb 27 01:31:40 devstack sudo[90794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:40 devstack sudo[90792]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:40 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c55d4130-a2f8-4e71-8a91-9cfad60282f7 tempest-CreateVolumesFromSnapshotTest-1650134941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8bd003fb-9b49-491f-af9a-bc449a84823e 1073741824" returned: 0 in 0.578s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:40 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c55d4130-a2f8-4e71-8a91-9cfad60282f7 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8bd003fb-9b49-491f-af9a-bc449a84823e {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:40 devstack sudo[90799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8bd003fb-9b49-491f-af9a-bc449a84823e
Feb 27 01:31:40 devstack sudo[90799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:40 devstack sudo[90794]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:40 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-20e3485d-a780-415d-b682-308763f691b9 tempest-CreateVolumesFromImageTest-1511424860 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-a80a223a-724c-47fa-8584-1e0a344b6925" returned: 0 in 0.560s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:40 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-20e3485d-a780-415d-b682-308763f691b9 tempest-CreateVolumesFromImageTest-1511424860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-a80a223a-724c-47fa-8584-1e0a344b6925 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:40 devstack sudo[90804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-a80a223a-724c-47fa-8584-1e0a344b6925
Feb 27 01:31:40 devstack sudo[90804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:41 devstack sudo[90799]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:41 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c55d4130-a2f8-4e71-8a91-9cfad60282f7 tempest-CreateVolumesFromSnapshotTest-1650134941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8bd003fb-9b49-491f-af9a-bc449a84823e" returned: 0 in 0.476s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:41 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-c55d4130-a2f8-4e71-8a91-9cfad60282f7 tempest-CreateVolumesFromSnapshotTest-1650134941 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:31:41 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-c55d4130-a2f8-4e71-8a91-9cfad60282f7 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:41 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-2257485a-791d-4962-b2b3-13ccdbe6c58b tempest-CreateVolumesFromSnapshotTest-1650134941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.783s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:41 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-2257485a-791d-4962-b2b3-13ccdbe6c58b tempest-CreateVolumesFromSnapshotTest-1650134941 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:31:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-111422669',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e0c9a06-b384-44de-b251-7579811d20e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b73782ca97844d9f9a5a8eb4f4722b89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:31:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:31:36Z,use_quota=True,user_id='da6d7809bdb24bf1b6059fd5ecf5bf87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:31:41 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-2257485a-791d-4962-b2b3-13ccdbe6c58b tempest-CreateVolumesFromSnapshotTest-1650134941 None] Creating volume 0e0c9a06-b384-44de-b251-7579811d20e0 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:31:41 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-2257485a-791d-4962-b2b3-13ccdbe6c58b tempest-CreateVolumesFromSnapshotTest-1650134941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:41 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-2257485a-791d-4962-b2b3-13ccdbe6c58b tempest-CreateVolumesFromSnapshotTest-1650134941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:41 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-2257485a-791d-4962-b2b3-13ccdbe6c58b tempest-CreateVolumesFromSnapshotTest-1650134941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:31:41 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-2257485a-791d-4962-b2b3-13ccdbe6c58b tempest-CreateVolumesFromSnapshotTest-1650134941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:31:41 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-2257485a-791d-4962-b2b3-13ccdbe6c58b tempest-CreateVolumesFromSnapshotTest-1650134941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:41 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-2257485a-791d-4962-b2b3-13ccdbe6c58b tempest-CreateVolumesFromSnapshotTest-1650134941 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:31:41 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-2257485a-791d-4962-b2b3-13ccdbe6c58b tempest-CreateVolumesFromSnapshotTest-1650134941 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:31:41 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-2257485a-791d-4962-b2b3-13ccdbe6c58b tempest-CreateVolumesFromSnapshotTest-1650134941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0e0c9a06-b384-44de-b251-7579811d20e0 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:41 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c55d4130-a2f8-4e71-8a91-9cfad60282f7 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef086500-9a76-47e1-aeef-21d19046f01c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bd003fb-9b49-491f-af9a-bc449a84823e', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:41 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c55d4130-a2f8-4e71-8a91-9cfad60282f7 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4ce6d10-1fd2-4359-acd6-7dbdf389330e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:41 devstack sudo[90807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0e0c9a06-b384-44de-b251-7579811d20e0 1073741824
Feb 27 01:31:41 devstack sudo[90807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:41 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-c55d4130-a2f8-4e71-8a91-9cfad60282f7 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Volume volume-8bd003fb-9b49-491f-af9a-bc449a84823e (8bd003fb-9b49-491f-af9a-bc449a84823e): created successfully
Feb 27 01:31:41 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c55d4130-a2f8-4e71-8a91-9cfad60282f7 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4ce6d10-1fd2-4359-acd6-7dbdf389330e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:41 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c55d4130-a2f8-4e71-8a91-9cfad60282f7 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Flow 'volume_create_manager' (e610f84d-3c2d-4af0-9acc-5219b48a2cff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:31:41 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-c55d4130-a2f8-4e71-8a91-9cfad60282f7 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Created volume successfully.
Feb 27 01:31:41 devstack sudo[90804]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:41 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-20e3485d-a780-415d-b682-308763f691b9 tempest-CreateVolumesFromImageTest-1511424860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-a80a223a-724c-47fa-8584-1e0a344b6925" returned: 0 in 0.554s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:41 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-20e3485d-a780-415d-b682-308763f691b9 tempest-CreateVolumesFromImageTest-1511424860 None] Lock "cinder-quobyte-a80a223a-724c-47fa-8584-1e0a344b6925" released by "delete_volume" :: held 1.155s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:31:41 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-20e3485d-a780-415d-b682-308763f691b9 tempest-CreateVolumesFromImageTest-1511424860 None] Created reservations ['d6e57ce8-0fec-4791-8387-790d10bc0b2a', 'ddfe3875-d45d-4680-b6f1-5ca95a579e49', 'eb33b542-df08-41a1-9d7c-91315ab87ff3', '81bab27f-20a3-4d8e-8c3a-f46108c335ab'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:31:41 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-20e3485d-a780-415d-b682-308763f691b9 tempest-CreateVolumesFromImageTest-1511424860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:41 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-20e3485d-a780-415d-b682-308763f691b9 tempest-CreateVolumesFromImageTest-1511424860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:41 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-20e3485d-a780-415d-b682-308763f691b9 tempest-CreateVolumesFromImageTest-1511424860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:31:41 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-20e3485d-a780-415d-b682-308763f691b9 tempest-CreateVolumesFromImageTest-1511424860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:31:41 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-20e3485d-a780-415d-b682-308763f691b9 tempest-CreateVolumesFromImageTest-1511424860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:41 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-20e3485d-a780-415d-b682-308763f691b9 tempest-CreateVolumesFromImageTest-1511424860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:41 devstack sudo[90813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:31:41 devstack sudo[90813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:41 devstack sudo[90807]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:41 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-2257485a-791d-4962-b2b3-13ccdbe6c58b tempest-CreateVolumesFromSnapshotTest-1650134941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0e0c9a06-b384-44de-b251-7579811d20e0 1073741824" returned: 0 in 0.568s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:41 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-2257485a-791d-4962-b2b3-13ccdbe6c58b tempest-CreateVolumesFromSnapshotTest-1650134941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0e0c9a06-b384-44de-b251-7579811d20e0 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:41 devstack sudo[90815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0e0c9a06-b384-44de-b251-7579811d20e0
Feb 27 01:31:41 devstack sudo[90815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:41 devstack sudo[90813]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:41 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-20e3485d-a780-415d-b682-308763f691b9 tempest-CreateVolumesFromImageTest-1511424860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.466s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:41 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-20e3485d-a780-415d-b682-308763f691b9 tempest-CreateVolumesFromImageTest-1511424860 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:31:41 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-20e3485d-a780-415d-b682-308763f691b9 tempest-CreateVolumesFromImageTest-1511424860 None] Deleted volume successfully.
Feb 27 01:31:41 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-20e3485d-a780-415d-b682-308763f691b9 tempest-CreateVolumesFromImageTest-1511424860 None] Lock "cinder-a80a223a-724c-47fa-8584-1e0a344b6925-delete_volume" released by "delete_volume" :: held 1.755s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:31:42 devstack sudo[90815]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:42 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-2257485a-791d-4962-b2b3-13ccdbe6c58b tempest-CreateVolumesFromSnapshotTest-1650134941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0e0c9a06-b384-44de-b251-7579811d20e0" returned: 0 in 0.431s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:42 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-2257485a-791d-4962-b2b3-13ccdbe6c58b tempest-CreateVolumesFromSnapshotTest-1650134941 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:31:42 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-2257485a-791d-4962-b2b3-13ccdbe6c58b tempest-CreateVolumesFromSnapshotTest-1650134941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:42 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-f89514de-71a7-4d05-99b3-c67d08e4a16c tempest-CreateVolumesFromSnapshotTest-1650134941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.590s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:42 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-f89514de-71a7-4d05-99b3-c67d08e4a16c tempest-CreateVolumesFromSnapshotTest-1650134941 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:31:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-531041952',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21e42b91-4af1-4309-b920-a0e227fdfb62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b73782ca97844d9f9a5a8eb4f4722b89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:31:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:31:36Z,use_quota=True,user_id='da6d7809bdb24bf1b6059fd5ecf5bf87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:31:42 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-f89514de-71a7-4d05-99b3-c67d08e4a16c tempest-CreateVolumesFromSnapshotTest-1650134941 None] Creating volume 21e42b91-4af1-4309-b920-a0e227fdfb62 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:31:42 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-f89514de-71a7-4d05-99b3-c67d08e4a16c tempest-CreateVolumesFromSnapshotTest-1650134941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:42 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-f89514de-71a7-4d05-99b3-c67d08e4a16c tempest-CreateVolumesFromSnapshotTest-1650134941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:42 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-f89514de-71a7-4d05-99b3-c67d08e4a16c tempest-CreateVolumesFromSnapshotTest-1650134941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:31:42 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-f89514de-71a7-4d05-99b3-c67d08e4a16c tempest-CreateVolumesFromSnapshotTest-1650134941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:31:42 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-f89514de-71a7-4d05-99b3-c67d08e4a16c tempest-CreateVolumesFromSnapshotTest-1650134941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:42 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-f89514de-71a7-4d05-99b3-c67d08e4a16c tempest-CreateVolumesFromSnapshotTest-1650134941 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:31:42 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-f89514de-71a7-4d05-99b3-c67d08e4a16c tempest-CreateVolumesFromSnapshotTest-1650134941 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:31:42 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-f89514de-71a7-4d05-99b3-c67d08e4a16c tempest-CreateVolumesFromSnapshotTest-1650134941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-21e42b91-4af1-4309-b920-a0e227fdfb62 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:42 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-2257485a-791d-4962-b2b3-13ccdbe6c58b tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15cc5f6f-4164-4407-a0e7-38a261602b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e0c9a06-b384-44de-b251-7579811d20e0', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:42 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-2257485a-791d-4962-b2b3-13ccdbe6c58b tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c01e15a-5587-47ef-bf72-651978ab857e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:42 devstack sudo[90819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-21e42b91-4af1-4309-b920-a0e227fdfb62 1073741824
Feb 27 01:31:42 devstack sudo[90819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:42 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-2257485a-791d-4962-b2b3-13ccdbe6c58b tempest-CreateVolumesFromSnapshotTest-1650134941 None] Volume volume-0e0c9a06-b384-44de-b251-7579811d20e0 (0e0c9a06-b384-44de-b251-7579811d20e0): created successfully
Feb 27 01:31:42 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-2257485a-791d-4962-b2b3-13ccdbe6c58b tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c01e15a-5587-47ef-bf72-651978ab857e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:42 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-2257485a-791d-4962-b2b3-13ccdbe6c58b tempest-CreateVolumesFromSnapshotTest-1650134941 None] Flow 'volume_create_manager' (6d489519-486d-438d-bca4-ab77815bf9ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:31:42 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-2257485a-791d-4962-b2b3-13ccdbe6c58b tempest-CreateVolumesFromSnapshotTest-1650134941 None] Created volume successfully.
Feb 27 01:31:42 devstack sudo[90819]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:42 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-f89514de-71a7-4d05-99b3-c67d08e4a16c tempest-CreateVolumesFromSnapshotTest-1650134941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-21e42b91-4af1-4309-b920-a0e227fdfb62 1073741824" returned: 0 in 0.524s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:42 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-f89514de-71a7-4d05-99b3-c67d08e4a16c tempest-CreateVolumesFromSnapshotTest-1650134941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-21e42b91-4af1-4309-b920-a0e227fdfb62 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:42 devstack sudo[90824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-21e42b91-4af1-4309-b920-a0e227fdfb62
Feb 27 01:31:42 devstack sudo[90824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:43 devstack sudo[90824]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:43 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-f89514de-71a7-4d05-99b3-c67d08e4a16c tempest-CreateVolumesFromSnapshotTest-1650134941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-21e42b91-4af1-4309-b920-a0e227fdfb62" returned: 0 in 0.494s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:43 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-f89514de-71a7-4d05-99b3-c67d08e4a16c tempest-CreateVolumesFromSnapshotTest-1650134941 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:31:43 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-f89514de-71a7-4d05-99b3-c67d08e4a16c tempest-CreateVolumesFromSnapshotTest-1650134941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:43 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-1f7a090d-d8c7-4044-8472-ad0f8b33a2fe tempest-CreateVolumesFromSnapshotTest-1650134941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.276s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:43 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-1f7a090d-d8c7-4044-8472-ad0f8b33a2fe tempest-CreateVolumesFromSnapshotTest-1650134941 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:31:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1739177765',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=213ca0f0-adcd-46a3-8325-c9d47c31a737,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b73782ca97844d9f9a5a8eb4f4722b89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:31:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:31:37Z,use_quota=True,user_id='da6d7809bdb24bf1b6059fd5ecf5bf87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:31:43 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-1f7a090d-d8c7-4044-8472-ad0f8b33a2fe tempest-CreateVolumesFromSnapshotTest-1650134941 None] Creating volume 213ca0f0-adcd-46a3-8325-c9d47c31a737 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:31:43 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-1f7a090d-d8c7-4044-8472-ad0f8b33a2fe tempest-CreateVolumesFromSnapshotTest-1650134941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:43 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-1f7a090d-d8c7-4044-8472-ad0f8b33a2fe tempest-CreateVolumesFromSnapshotTest-1650134941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:43 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-1f7a090d-d8c7-4044-8472-ad0f8b33a2fe tempest-CreateVolumesFromSnapshotTest-1650134941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:31:43 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-1f7a090d-d8c7-4044-8472-ad0f8b33a2fe tempest-CreateVolumesFromSnapshotTest-1650134941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:31:43 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-1f7a090d-d8c7-4044-8472-ad0f8b33a2fe tempest-CreateVolumesFromSnapshotTest-1650134941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:43 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-1f7a090d-d8c7-4044-8472-ad0f8b33a2fe tempest-CreateVolumesFromSnapshotTest-1650134941 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:31:43 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-1f7a090d-d8c7-4044-8472-ad0f8b33a2fe tempest-CreateVolumesFromSnapshotTest-1650134941 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:31:43 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-1f7a090d-d8c7-4044-8472-ad0f8b33a2fe tempest-CreateVolumesFromSnapshotTest-1650134941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-213ca0f0-adcd-46a3-8325-c9d47c31a737 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:43 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-f89514de-71a7-4d05-99b3-c67d08e4a16c tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df615e3c-0223-4e41-b466-efce8e5c8af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21e42b91-4af1-4309-b920-a0e227fdfb62', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:43 devstack sudo[90828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-213ca0f0-adcd-46a3-8325-c9d47c31a737 1073741824
Feb 27 01:31:43 devstack sudo[90828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:43 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-f89514de-71a7-4d05-99b3-c67d08e4a16c tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60b41ee9-aca2-4df3-811e-58c8131896da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:43 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-f89514de-71a7-4d05-99b3-c67d08e4a16c tempest-CreateVolumesFromSnapshotTest-1650134941 None] Volume volume-21e42b91-4af1-4309-b920-a0e227fdfb62 (21e42b91-4af1-4309-b920-a0e227fdfb62): created successfully
Feb 27 01:31:43 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-f89514de-71a7-4d05-99b3-c67d08e4a16c tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60b41ee9-aca2-4df3-811e-58c8131896da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:43 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-f89514de-71a7-4d05-99b3-c67d08e4a16c tempest-CreateVolumesFromSnapshotTest-1650134941 None] Flow 'volume_create_manager' (6ec4da56-4b7a-4270-a71c-66fd26007ccd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:31:43 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-f89514de-71a7-4d05-99b3-c67d08e4a16c tempest-CreateVolumesFromSnapshotTest-1650134941 None] Created volume successfully.
Feb 27 01:31:43 devstack sudo[90828]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:43 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-1f7a090d-d8c7-4044-8472-ad0f8b33a2fe tempest-CreateVolumesFromSnapshotTest-1650134941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-213ca0f0-adcd-46a3-8325-c9d47c31a737 1073741824" returned: 0 in 0.592s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:43 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-1f7a090d-d8c7-4044-8472-ad0f8b33a2fe tempest-CreateVolumesFromSnapshotTest-1650134941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-213ca0f0-adcd-46a3-8325-c9d47c31a737 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:43 devstack sudo[90834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-213ca0f0-adcd-46a3-8325-c9d47c31a737
Feb 27 01:31:43 devstack sudo[90834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:44 devstack sudo[90834]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:44 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-1f7a090d-d8c7-4044-8472-ad0f8b33a2fe tempest-CreateVolumesFromSnapshotTest-1650134941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-213ca0f0-adcd-46a3-8325-c9d47c31a737" returned: 0 in 0.435s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:44 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-1f7a090d-d8c7-4044-8472-ad0f8b33a2fe tempest-CreateVolumesFromSnapshotTest-1650134941 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:31:44 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-1f7a090d-d8c7-4044-8472-ad0f8b33a2fe tempest-CreateVolumesFromSnapshotTest-1650134941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:44 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-12ee81f9-f50f-49aa-9134-16ba1dd72a32 tempest-SnapshotDependencyTests-277758335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.038s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:44 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-12ee81f9-f50f-49aa-9134-16ba1dd72a32 tempest-SnapshotDependencyTests-277758335 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:31:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-440609272',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0170b02c-0d22-4644-98ef-dbbd753a8989,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43e5a9252e0244bc8ff1b7e9f20ca60b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:31:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:31:39Z,use_quota=True,user_id='fede7c59fa3c416297fcece65bdb9b73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:31:44 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-12ee81f9-f50f-49aa-9134-16ba1dd72a32 tempest-SnapshotDependencyTests-277758335 None] Creating volume 0170b02c-0d22-4644-98ef-dbbd753a8989 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:31:44 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-12ee81f9-f50f-49aa-9134-16ba1dd72a32 tempest-SnapshotDependencyTests-277758335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:44 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-12ee81f9-f50f-49aa-9134-16ba1dd72a32 tempest-SnapshotDependencyTests-277758335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:44 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-12ee81f9-f50f-49aa-9134-16ba1dd72a32 tempest-SnapshotDependencyTests-277758335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:31:44 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-12ee81f9-f50f-49aa-9134-16ba1dd72a32 tempest-SnapshotDependencyTests-277758335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:31:44 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-12ee81f9-f50f-49aa-9134-16ba1dd72a32 tempest-SnapshotDependencyTests-277758335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:44 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-12ee81f9-f50f-49aa-9134-16ba1dd72a32 tempest-SnapshotDependencyTests-277758335 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:31:44 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-12ee81f9-f50f-49aa-9134-16ba1dd72a32 tempest-SnapshotDependencyTests-277758335 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:31:44 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-12ee81f9-f50f-49aa-9134-16ba1dd72a32 tempest-SnapshotDependencyTests-277758335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0170b02c-0d22-4644-98ef-dbbd753a8989 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:44 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1f7a090d-d8c7-4044-8472-ad0f8b33a2fe tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f16e50f0-84f1-417d-a4e1-82560acb487b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-213ca0f0-adcd-46a3-8325-c9d47c31a737', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:44 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1f7a090d-d8c7-4044-8472-ad0f8b33a2fe tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69eaf1a9-60ff-4952-803d-b4a3db5a08db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:44 devstack sudo[90837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0170b02c-0d22-4644-98ef-dbbd753a8989 1073741824
Feb 27 01:31:44 devstack sudo[90837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:44 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-1f7a090d-d8c7-4044-8472-ad0f8b33a2fe tempest-CreateVolumesFromSnapshotTest-1650134941 None] Volume volume-213ca0f0-adcd-46a3-8325-c9d47c31a737 (213ca0f0-adcd-46a3-8325-c9d47c31a737): created successfully
Feb 27 01:31:44 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1f7a090d-d8c7-4044-8472-ad0f8b33a2fe tempest-CreateVolumesFromSnapshotTest-1650134941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69eaf1a9-60ff-4952-803d-b4a3db5a08db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:44 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-1f7a090d-d8c7-4044-8472-ad0f8b33a2fe tempest-CreateVolumesFromSnapshotTest-1650134941 None] Flow 'volume_create_manager' (d5e27177-0f68-4ad0-af10-7a2a6b13b7f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:31:44 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-1f7a090d-d8c7-4044-8472-ad0f8b33a2fe tempest-CreateVolumesFromSnapshotTest-1650134941 None] Created volume successfully.
Feb 27 01:31:44 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-60939681-f0a3-4a8e-a319-703fec241bd5 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Acquiring lock "cinder-213ca0f0-adcd-46a3-8325-c9d47c31a737-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:31:44 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc85646c-bdda-478a-b171-b515c8945741 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:31:44 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-fc85646c-bdda-478a-b171-b515c8945741 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Flow 'volume_create_manager' (218639ad-5d51-4755-ac86-a6599c97dac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:31:44 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-fc85646c-bdda-478a-b171-b515c8945741 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdf6b145-71f1-4993-96e1-9a000d758317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:44 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-fc85646c-bdda-478a-b171-b515c8945741 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdf6b145-71f1-4993-96e1-9a000d758317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-85733853',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eef7f087-6b13-4dcc-afc9-6632c83019db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0ef4aee4972409c886107e52dd842a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:31:44Z,use_quota=True,user_id='0c6c9b06e2a940108c8e5dc157cdb4eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:44 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-fc85646c-bdda-478a-b171-b515c8945741 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aef19f4-dc9f-4a6f-8286-b96c03eebf61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:44 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-fc85646c-bdda-478a-b171-b515c8945741 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aef19f4-dc9f-4a6f-8286-b96c03eebf61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:44 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-fc85646c-bdda-478a-b171-b515c8945741 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42658b43-e41b-4fa1-8db4-3570aa4eff3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:44 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-fc85646c-bdda-478a-b171-b515c8945741 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42658b43-e41b-4fa1-8db4-3570aa4eff3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eef7f087-6b13-4dcc-afc9-6632c83019db', 'volume_name': 'volume-eef7f087-6b13-4dcc-afc9-6632c83019db', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:44 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-fc85646c-bdda-478a-b171-b515c8945741 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ff0190c-06c9-4d43-91ad-1c78c9df52a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:44 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-fc85646c-bdda-478a-b171-b515c8945741 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ff0190c-06c9-4d43-91ad-1c78c9df52a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:44 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-fc85646c-bdda-478a-b171-b515c8945741 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eff6327e-219e-4109-85b6-335892fa7072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:44 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-fc85646c-bdda-478a-b171-b515c8945741 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Volume eef7f087-6b13-4dcc-afc9-6632c83019db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eef7f087-6b13-4dcc-afc9-6632c83019db', 'volume_size': 1}
Feb 27 01:31:44 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-fc85646c-bdda-478a-b171-b515c8945741 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:44 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-60939681-f0a3-4a8e-a319-703fec241bd5 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Lock "cinder-213ca0f0-adcd-46a3-8325-c9d47c31a737-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:31:44 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-60939681-f0a3-4a8e-a319-703fec241bd5 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Acquiring lock "cinder-quobyte-213ca0f0-adcd-46a3-8325-c9d47c31a737" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:31:44 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-60939681-f0a3-4a8e-a319-703fec241bd5 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Lock "cinder-quobyte-213ca0f0-adcd-46a3-8325-c9d47c31a737" acquired by "delete_volume" :: waited 0.008s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:31:44 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb1a77ef-4d36-4a18-b03e-c51e590439ca]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:31:44 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-60939681-f0a3-4a8e-a319-703fec241bd5 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-213ca0f0-adcd-46a3-8325-c9d47c31a737 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:44 devstack sudo[90839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-213ca0f0-adcd-46a3-8325-c9d47c31a737
Feb 27 01:31:44 devstack sudo[90839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:44 devstack sudo[90837]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:44 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-12ee81f9-f50f-49aa-9134-16ba1dd72a32 tempest-SnapshotDependencyTests-277758335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0170b02c-0d22-4644-98ef-dbbd753a8989 1073741824" returned: 0 in 0.543s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:44 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-12ee81f9-f50f-49aa-9134-16ba1dd72a32 tempest-SnapshotDependencyTests-277758335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0170b02c-0d22-4644-98ef-dbbd753a8989 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:44 devstack sudo[90844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0170b02c-0d22-4644-98ef-dbbd753a8989
Feb 27 01:31:44 devstack sudo[90844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:45 devstack sudo[90839]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:45 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-60939681-f0a3-4a8e-a319-703fec241bd5 tempest-CreateVolumesFromSnapshotTest-1650134941 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-213ca0f0-adcd-46a3-8325-c9d47c31a737" returned: 0 in 0.524s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:45 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-60939681-f0a3-4a8e-a319-703fec241bd5 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-213ca0f0-adcd-46a3-8325-c9d47c31a737 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:45 devstack sudo[90849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-213ca0f0-adcd-46a3-8325-c9d47c31a737
Feb 27 01:31:45 devstack sudo[90849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:45 devstack sudo[90844]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:45 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-12ee81f9-f50f-49aa-9134-16ba1dd72a32 tempest-SnapshotDependencyTests-277758335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0170b02c-0d22-4644-98ef-dbbd753a8989" returned: 0 in 0.428s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:45 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-12ee81f9-f50f-49aa-9134-16ba1dd72a32 tempest-SnapshotDependencyTests-277758335 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:31:45 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-12ee81f9-f50f-49aa-9134-16ba1dd72a32 tempest-SnapshotDependencyTests-277758335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:45 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-349c6d87-3ece-42c8-a31c-63bdec1c8a55 tempest-VolumeDependencyTests-1629780687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.832s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:45 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-349c6d87-3ece-42c8-a31c-63bdec1c8a55 tempest-VolumeDependencyTests-1629780687 None] Acquiring lock "cinder-quobyte-2f0a7b04-507b-402b-a1af-5dd3cf26e9e9-a2c71716-5455-472c-afc3-f5230e47eb3c" by "_create_volume_from_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:31:45 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-12ee81f9-f50f-49aa-9134-16ba1dd72a32 tempest-SnapshotDependencyTests-277758335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (303438ea-fd43-4e27-ac69-fbb78e7ca61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0170b02c-0d22-4644-98ef-dbbd753a8989', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:45 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-12ee81f9-f50f-49aa-9134-16ba1dd72a32 tempest-SnapshotDependencyTests-277758335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84f3f98b-fe66-40bc-bf2c-715f83175068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:45 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-12ee81f9-f50f-49aa-9134-16ba1dd72a32 tempest-SnapshotDependencyTests-277758335 None] Volume volume-0170b02c-0d22-4644-98ef-dbbd753a8989 (0170b02c-0d22-4644-98ef-dbbd753a8989): created successfully
Feb 27 01:31:45 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-12ee81f9-f50f-49aa-9134-16ba1dd72a32 tempest-SnapshotDependencyTests-277758335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84f3f98b-fe66-40bc-bf2c-715f83175068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:45 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-12ee81f9-f50f-49aa-9134-16ba1dd72a32 tempest-SnapshotDependencyTests-277758335 None] Flow 'volume_create_manager' (a0a5990d-7413-433a-a2fd-6dafe2f6ef76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:31:45 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-349c6d87-3ece-42c8-a31c-63bdec1c8a55 tempest-VolumeDependencyTests-1629780687 None] Lock "cinder-quobyte-2f0a7b04-507b-402b-a1af-5dd3cf26e9e9-a2c71716-5455-472c-afc3-f5230e47eb3c" acquired by "_create_volume_from_snapshot" :: waited 0.039s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:31:45 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-349c6d87-3ece-42c8-a31c-63bdec1c8a55 tempest-VolumeDependencyTests-1629780687 None] Creating volume a2c71716-5455-472c-afc3-f5230e47eb3c from snapshot 2f0a7b04-507b-402b-a1af-5dd3cf26e9e9 {{(pid=83106) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Feb 27 01:31:45 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-349c6d87-3ece-42c8-a31c-63bdec1c8a55 tempest-VolumeDependencyTests-1629780687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:45 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-349c6d87-3ece-42c8-a31c-63bdec1c8a55 tempest-VolumeDependencyTests-1629780687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:45 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-349c6d87-3ece-42c8-a31c-63bdec1c8a55 tempest-VolumeDependencyTests-1629780687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:31:45 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-349c6d87-3ece-42c8-a31c-63bdec1c8a55 tempest-VolumeDependencyTests-1629780687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:31:45 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-349c6d87-3ece-42c8-a31c-63bdec1c8a55 tempest-VolumeDependencyTests-1629780687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:45 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-349c6d87-3ece-42c8-a31c-63bdec1c8a55 tempest-VolumeDependencyTests-1629780687 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:31:45 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-349c6d87-3ece-42c8-a31c-63bdec1c8a55 tempest-VolumeDependencyTests-1629780687 None] Acquiring lock "cinder-quobyte-a2c71716-5455-472c-afc3-f5230e47eb3c" by "_copy_volume_from_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:31:45 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-12ee81f9-f50f-49aa-9134-16ba1dd72a32 tempest-SnapshotDependencyTests-277758335 None] Created volume successfully.
Feb 27 01:31:45 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-349c6d87-3ece-42c8-a31c-63bdec1c8a55 tempest-VolumeDependencyTests-1629780687 None] Lock "cinder-quobyte-a2c71716-5455-472c-afc3-f5230e47eb3c" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:31:45 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-349c6d87-3ece-42c8-a31c-63bdec1c8a55 tempest-VolumeDependencyTests-1629780687 None] snapshot: 2f0a7b04-507b-402b-a1af-5dd3cf26e9e9, volume: a2c71716-5455-472c-afc3-f5230e47eb3c,  {{(pid=83106) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Feb 27 01:31:45 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-349c6d87-3ece-42c8-a31c-63bdec1c8a55 tempest-VolumeDependencyTests-1629780687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:45 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-349c6d87-3ece-42c8-a31c-63bdec1c8a55 tempest-VolumeDependencyTests-1629780687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:45 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-349c6d87-3ece-42c8-a31c-63bdec1c8a55 tempest-VolumeDependencyTests-1629780687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:31:45 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-349c6d87-3ece-42c8-a31c-63bdec1c8a55 tempest-VolumeDependencyTests-1629780687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:31:45 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-349c6d87-3ece-42c8-a31c-63bdec1c8a55 tempest-VolumeDependencyTests-1629780687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:45 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e3e629-7090-4061-a82c-65ae125bd325]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:31:45 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-349c6d87-3ece-42c8-a31c-63bdec1c8a55 tempest-VolumeDependencyTests-1629780687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4d9c8f-dd57-4215-b446-acc20caccba2.2f0a7b04-507b-402b-a1af-5dd3cf26e9e9 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:45 devstack sudo[90852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4d9c8f-dd57-4215-b446-acc20caccba2.2f0a7b04-507b-402b-a1af-5dd3cf26e9e9
Feb 27 01:31:45 devstack sudo[90852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:45 devstack sudo[90849]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:45 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-60939681-f0a3-4a8e-a319-703fec241bd5 tempest-CreateVolumesFromSnapshotTest-1650134941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-213ca0f0-adcd-46a3-8325-c9d47c31a737" returned: 0 in 0.453s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:45 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-60939681-f0a3-4a8e-a319-703fec241bd5 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Lock "cinder-quobyte-213ca0f0-adcd-46a3-8325-c9d47c31a737" released by "delete_volume" :: held 1.003s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:31:45 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-60939681-f0a3-4a8e-a319-703fec241bd5 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Created reservations ['62b27ac2-d790-4598-b36b-bff3161b0f04', 'c93a46db-0215-4178-835a-38038729c658', '84e96006-1d2f-48f4-99ed-b8e87dff6dfe', '8438c62d-d2cd-411e-a3cb-2fd71e2dd866'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:31:45 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-60939681-f0a3-4a8e-a319-703fec241bd5 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:45 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-60939681-f0a3-4a8e-a319-703fec241bd5 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:45 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-60939681-f0a3-4a8e-a319-703fec241bd5 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:31:45 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-60939681-f0a3-4a8e-a319-703fec241bd5 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:31:45 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-60939681-f0a3-4a8e-a319-703fec241bd5 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:45 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-60939681-f0a3-4a8e-a319-703fec241bd5 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:45 devstack sudo[90855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:31:45 devstack sudo[90855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:45 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-7b092c09-fd22-4dd0-8500-9eac03e82ac7 tempest-SnapshotDependencyTests-277758335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:45 devstack sudo[90852]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:45 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-349c6d87-3ece-42c8-a31c-63bdec1c8a55 tempest-VolumeDependencyTests-1629780687 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4d9c8f-dd57-4215-b446-acc20caccba2.2f0a7b04-507b-402b-a1af-5dd3cf26e9e9" returned: 0 in 0.526s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:45 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-349c6d87-3ece-42c8-a31c-63bdec1c8a55 tempest-VolumeDependencyTests-1629780687 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd4d9c8f-dd57-4215-b446-acc20caccba2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83106) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:31:45 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-349c6d87-3ece-42c8-a31c-63bdec1c8a55 tempest-VolumeDependencyTests-1629780687 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4d9c8f-dd57-4215-b446-acc20caccba2 {{(pid=83106) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Feb 27 01:31:45 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-349c6d87-3ece-42c8-a31c-63bdec1c8a55 tempest-VolumeDependencyTests-1629780687 None] Creating direct copy from snapshot {{(pid=83106) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Feb 27 01:31:45 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d61c454-e5a8-43fc-9ffc-920032419171]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:31:45 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-349c6d87-3ece-42c8-a31c-63bdec1c8a55 tempest-VolumeDependencyTests-1629780687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4d9c8f-dd57-4215-b446-acc20caccba2 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:45 devstack sudo[90860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4d9c8f-dd57-4215-b446-acc20caccba2
Feb 27 01:31:45 devstack sudo[90860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:46 devstack sudo[90855]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:46 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-60939681-f0a3-4a8e-a319-703fec241bd5 tempest-CreateVolumesFromSnapshotTest-1650134941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.435s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:46 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-60939681-f0a3-4a8e-a319-703fec241bd5 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:31:46 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-60939681-f0a3-4a8e-a319-703fec241bd5 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Deleted volume successfully.
Feb 27 01:31:46 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-60939681-f0a3-4a8e-a319-703fec241bd5 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Lock "cinder-213ca0f0-adcd-46a3-8325-c9d47c31a737-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:31:46 devstack sudo[90860]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:46 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-349c6d87-3ece-42c8-a31c-63bdec1c8a55 tempest-VolumeDependencyTests-1629780687 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4d9c8f-dd57-4215-b446-acc20caccba2" returned: 0 in 0.490s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:46 devstack cinder-volume[83106]: DEBUG cinder.utils [None req-349c6d87-3ece-42c8-a31c-63bdec1c8a55 tempest-VolumeDependencyTests-1629780687 None] Path /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-a2c71716-5455-472c-afc3-f5230e47eb3c not found in is_blk_device check {{(pid=83106) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Feb 27 01:31:46 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-349c6d87-3ece-42c8-a31c-63bdec1c8a55 tempest-VolumeDependencyTests-1629780687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4d9c8f-dd57-4215-b446-acc20caccba2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-a2c71716-5455-472c-afc3-f5230e47eb3c {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:46 devstack sudo[90866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4d9c8f-dd57-4215-b446-acc20caccba2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-a2c71716-5455-472c-afc3-f5230e47eb3c
Feb 27 01:31:46 devstack sudo[90866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:46 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-24f7b6c5-0083-4fb3-8937-720d83382beb tempest-CreateVolumesFromSnapshotTest-1650134941 None] Acquiring lock "cinder-21e42b91-4af1-4309-b920-a0e227fdfb62-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:31:46 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-24f7b6c5-0083-4fb3-8937-720d83382beb tempest-CreateVolumesFromSnapshotTest-1650134941 None] Lock "cinder-21e42b91-4af1-4309-b920-a0e227fdfb62-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:31:46 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-24f7b6c5-0083-4fb3-8937-720d83382beb tempest-CreateVolumesFromSnapshotTest-1650134941 None] Acquiring lock "cinder-quobyte-21e42b91-4af1-4309-b920-a0e227fdfb62" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:31:46 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-24f7b6c5-0083-4fb3-8937-720d83382beb tempest-CreateVolumesFromSnapshotTest-1650134941 None] Lock "cinder-quobyte-21e42b91-4af1-4309-b920-a0e227fdfb62" acquired by "delete_volume" :: waited 0.014s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:31:46 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e693bab-3612-4fd7-8fcf-58e051065501]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:31:46 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-24f7b6c5-0083-4fb3-8937-720d83382beb tempest-CreateVolumesFromSnapshotTest-1650134941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-21e42b91-4af1-4309-b920-a0e227fdfb62 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:46 devstack sudo[90868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-21e42b91-4af1-4309-b920-a0e227fdfb62
Feb 27 01:31:46 devstack sudo[90868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:48 devstack sudo[90868]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:48 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-24f7b6c5-0083-4fb3-8937-720d83382beb tempest-CreateVolumesFromSnapshotTest-1650134941 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-21e42b91-4af1-4309-b920-a0e227fdfb62" returned: 0 in 1.580s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:48 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-24f7b6c5-0083-4fb3-8937-720d83382beb tempest-CreateVolumesFromSnapshotTest-1650134941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-21e42b91-4af1-4309-b920-a0e227fdfb62 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:48 devstack sudo[90883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-21e42b91-4af1-4309-b920-a0e227fdfb62
Feb 27 01:31:48 devstack sudo[90883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:48 devstack sudo[90866]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:48 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-349c6d87-3ece-42c8-a31c-63bdec1c8a55 tempest-VolumeDependencyTests-1629780687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4d9c8f-dd57-4215-b446-acc20caccba2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-a2c71716-5455-472c-afc3-f5230e47eb3c" returned: 0 in 2.216s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:48 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd61ab48-9edd-48cf-803c-87590439542f]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:31:48 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-349c6d87-3ece-42c8-a31c-63bdec1c8a55 tempest-VolumeDependencyTests-1629780687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4d9c8f-dd57-4215-b446-acc20caccba2 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:48 devstack sudo[90885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4d9c8f-dd57-4215-b446-acc20caccba2
Feb 27 01:31:48 devstack sudo[90885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:48 devstack sudo[90883]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:48 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-24f7b6c5-0083-4fb3-8937-720d83382beb tempest-CreateVolumesFromSnapshotTest-1650134941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-21e42b91-4af1-4309-b920-a0e227fdfb62" returned: 0 in 0.570s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:48 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-24f7b6c5-0083-4fb3-8937-720d83382beb tempest-CreateVolumesFromSnapshotTest-1650134941 None] Lock "cinder-quobyte-21e42b91-4af1-4309-b920-a0e227fdfb62" released by "delete_volume" :: held 2.180s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:31:48 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-24f7b6c5-0083-4fb3-8937-720d83382beb tempest-CreateVolumesFromSnapshotTest-1650134941 None] Created reservations ['67517b6c-2659-4208-aff3-cfeede4cc1ab', '6e6f799f-6789-4853-a323-bb882414a3b4', 'fabfc0c8-ef36-49b1-b813-8279a2a47316', '7278f4ab-dda4-4e85-a76a-4f88f5d8b260'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:31:48 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-24f7b6c5-0083-4fb3-8937-720d83382beb tempest-CreateVolumesFromSnapshotTest-1650134941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:48 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-24f7b6c5-0083-4fb3-8937-720d83382beb tempest-CreateVolumesFromSnapshotTest-1650134941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:48 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-24f7b6c5-0083-4fb3-8937-720d83382beb tempest-CreateVolumesFromSnapshotTest-1650134941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:31:48 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-24f7b6c5-0083-4fb3-8937-720d83382beb tempest-CreateVolumesFromSnapshotTest-1650134941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:31:48 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-24f7b6c5-0083-4fb3-8937-720d83382beb tempest-CreateVolumesFromSnapshotTest-1650134941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:48 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-24f7b6c5-0083-4fb3-8937-720d83382beb tempest-CreateVolumesFromSnapshotTest-1650134941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:48 devstack sudo[90888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:31:48 devstack sudo[90888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:49 devstack sudo[90885]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-349c6d87-3ece-42c8-a31c-63bdec1c8a55 tempest-VolumeDependencyTests-1629780687 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4d9c8f-dd57-4215-b446-acc20caccba2" returned: 0 in 0.655s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:49 devstack cinder-volume[83106]: DEBUG cinder.image.image_utils [None req-349c6d87-3ece-42c8-a31c-63bdec1c8a55 tempest-VolumeDependencyTests-1629780687 None] Image conversion details: src /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4d9c8f-dd57-4215-b446-acc20caccba2, size 1024.00 MB, duration 2.22 sec, destination /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-a2c71716-5455-472c-afc3-f5230e47eb3c {{(pid=83106) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 27 01:31:49 devstack cinder-volume[83106]: INFO cinder.image.image_utils [None req-349c6d87-3ece-42c8-a31c-63bdec1c8a55 tempest-VolumeDependencyTests-1629780687 None] Converted 1024.00 MB image at 461.67 MB/s
Feb 27 01:31:49 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-349c6d87-3ece-42c8-a31c-63bdec1c8a55 tempest-VolumeDependencyTests-1629780687 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-a2c71716-5455-472c-afc3-f5230e47eb3c is being set with open permissions: ugo+rw
Feb 27 01:31:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-349c6d87-3ece-42c8-a31c-63bdec1c8a55 tempest-VolumeDependencyTests-1629780687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-a2c71716-5455-472c-afc3-f5230e47eb3c {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:49 devstack sudo[90893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-a2c71716-5455-472c-afc3-f5230e47eb3c
Feb 27 01:31:49 devstack sudo[90893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:49 devstack sudo[90888]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-24f7b6c5-0083-4fb3-8937-720d83382beb tempest-CreateVolumesFromSnapshotTest-1650134941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.479s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:49 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-24f7b6c5-0083-4fb3-8937-720d83382beb tempest-CreateVolumesFromSnapshotTest-1650134941 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:31:49 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-24f7b6c5-0083-4fb3-8937-720d83382beb tempest-CreateVolumesFromSnapshotTest-1650134941 None] Deleted volume successfully.
Feb 27 01:31:49 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-24f7b6c5-0083-4fb3-8937-720d83382beb tempest-CreateVolumesFromSnapshotTest-1650134941 None] Lock "cinder-21e42b91-4af1-4309-b920-a0e227fdfb62-delete_volume" released by "delete_volume" :: held 2.833s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:31:49 devstack sudo[90893]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-349c6d87-3ece-42c8-a31c-63bdec1c8a55 tempest-VolumeDependencyTests-1629780687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-a2c71716-5455-472c-afc3-f5230e47eb3c" returned: 0 in 0.459s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:49 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-349c6d87-3ece-42c8-a31c-63bdec1c8a55 tempest-VolumeDependencyTests-1629780687 None] Lock "cinder-quobyte-a2c71716-5455-472c-afc3-f5230e47eb3c" released by "_copy_volume_from_snapshot" :: held 4.407s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:31:49 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-349c6d87-3ece-42c8-a31c-63bdec1c8a55 tempest-VolumeDependencyTests-1629780687 None] Lock "cinder-quobyte-2f0a7b04-507b-402b-a1af-5dd3cf26e9e9-a2c71716-5455-472c-afc3-f5230e47eb3c" released by "_create_volume_from_snapshot" :: held 4.432s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:31:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-349c6d87-3ece-42c8-a31c-63bdec1c8a55 tempest-VolumeDependencyTests-1629780687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.474s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-fc85646c-bdda-478a-b171-b515c8945741 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.223s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:49 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-fc85646c-bdda-478a-b171-b515c8945741 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-85733853',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eef7f087-6b13-4dcc-afc9-6632c83019db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0ef4aee4972409c886107e52dd842a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:31:44Z,use_quota=True,user_id='0c6c9b06e2a940108c8e5dc157cdb4eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:31:49 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-fc85646c-bdda-478a-b171-b515c8945741 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Creating volume eef7f087-6b13-4dcc-afc9-6632c83019db {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:31:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-fc85646c-bdda-478a-b171-b515c8945741 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-fc85646c-bdda-478a-b171-b515c8945741 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:49 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-fc85646c-bdda-478a-b171-b515c8945741 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:31:49 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-fc85646c-bdda-478a-b171-b515c8945741 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:31:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-fc85646c-bdda-478a-b171-b515c8945741 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:49 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-fc85646c-bdda-478a-b171-b515c8945741 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:31:49 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-fc85646c-bdda-478a-b171-b515c8945741 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:31:49 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-fc85646c-bdda-478a-b171-b515c8945741 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-eef7f087-6b13-4dcc-afc9-6632c83019db 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:49 devstack sudo[90897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-eef7f087-6b13-4dcc-afc9-6632c83019db 1073741824
Feb 27 01:31:49 devstack sudo[90897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:49 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-349c6d87-3ece-42c8-a31c-63bdec1c8a55 tempest-VolumeDependencyTests-1629780687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fb6c8bb-6d60-4418-84e3-39f1bae11973) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2c71716-5455-472c-afc3-f5230e47eb3c', 'volume_size': 1, 'snapshot_id': '2f0a7b04-507b-402b-a1af-5dd3cf26e9e9'}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:49 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-349c6d87-3ece-42c8-a31c-63bdec1c8a55 tempest-VolumeDependencyTests-1629780687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1331dd4-5933-4c58-a59b-7263b190ee80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:49 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-349c6d87-3ece-42c8-a31c-63bdec1c8a55 tempest-VolumeDependencyTests-1629780687 None] Volume volume-a2c71716-5455-472c-afc3-f5230e47eb3c (a2c71716-5455-472c-afc3-f5230e47eb3c): created successfully
Feb 27 01:31:49 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-349c6d87-3ece-42c8-a31c-63bdec1c8a55 tempest-VolumeDependencyTests-1629780687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1331dd4-5933-4c58-a59b-7263b190ee80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:49 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-349c6d87-3ece-42c8-a31c-63bdec1c8a55 tempest-VolumeDependencyTests-1629780687 None] Flow 'volume_create_manager' (72c22c31-1d4c-462f-9afd-76c1a2432cb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:31:49 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-349c6d87-3ece-42c8-a31c-63bdec1c8a55 tempest-VolumeDependencyTests-1629780687 None] Created volume successfully.
Feb 27 01:31:49 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-d14f8cb2-a5fe-4ed7-af0e-db546dae7942 tempest-VolumeDependencyTests-1629780687 None] Acquiring lock "cinder-2f0a7b04-507b-402b-a1af-5dd3cf26e9e9-delete_snapshot" by "delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:31:49 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-d14f8cb2-a5fe-4ed7-af0e-db546dae7942 tempest-VolumeDependencyTests-1629780687 None] Lock "cinder-2f0a7b04-507b-402b-a1af-5dd3cf26e9e9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:31:49 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-d14f8cb2-a5fe-4ed7-af0e-db546dae7942 tempest-VolumeDependencyTests-1629780687 None] Acquiring lock "cinder-quobyte-dd4d9c8f-dd57-4215-b446-acc20caccba2" by "delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:31:49 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-b375316d-c3fb-4096-bdc0-8e3ab282ebe6 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Acquiring lock "cinder-0e0c9a06-b384-44de-b251-7579811d20e0-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:31:49 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-d14f8cb2-a5fe-4ed7-af0e-db546dae7942 tempest-VolumeDependencyTests-1629780687 None] Lock "cinder-quobyte-dd4d9c8f-dd57-4215-b446-acc20caccba2" acquired by "delete_snapshot" :: waited 0.025s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:31:49 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-d14f8cb2-a5fe-4ed7-af0e-db546dae7942 tempest-VolumeDependencyTests-1629780687 None] Acquiring lock "cinder-quobyte-2f0a7b04-507b-402b-a1af-5dd3cf26e9e9" by "_delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:31:49 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-b375316d-c3fb-4096-bdc0-8e3ab282ebe6 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Lock "cinder-0e0c9a06-b384-44de-b251-7579811d20e0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:31:49 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-d14f8cb2-a5fe-4ed7-af0e-db546dae7942 tempest-VolumeDependencyTests-1629780687 None] Lock "cinder-quobyte-2f0a7b04-507b-402b-a1af-5dd3cf26e9e9" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:31:49 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-d14f8cb2-a5fe-4ed7-af0e-db546dae7942 tempest-VolumeDependencyTests-1629780687 None] Deleting offline snapshot 2f0a7b04-507b-402b-a1af-5dd3cf26e9e9 of volume dd4d9c8f-dd57-4215-b446-acc20caccba2 {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:31:50 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-d14f8cb2-a5fe-4ed7-af0e-db546dae7942 tempest-VolumeDependencyTests-1629780687 None] snapshot_file for this snap is: volume-dd4d9c8f-dd57-4215-b446-acc20caccba2.2f0a7b04-507b-402b-a1af-5dd3cf26e9e9 {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:31:50 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[643e2ca6-9006-4f92-8e49-8d3ffb01d7c4]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:31:50 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d14f8cb2-a5fe-4ed7-af0e-db546dae7942 tempest-VolumeDependencyTests-1629780687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4d9c8f-dd57-4215-b446-acc20caccba2.2f0a7b04-507b-402b-a1af-5dd3cf26e9e9 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:50 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-b375316d-c3fb-4096-bdc0-8e3ab282ebe6 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Acquiring lock "cinder-quobyte-0e0c9a06-b384-44de-b251-7579811d20e0" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:31:50 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-b375316d-c3fb-4096-bdc0-8e3ab282ebe6 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Lock "cinder-quobyte-0e0c9a06-b384-44de-b251-7579811d20e0" acquired by "delete_volume" :: waited 0.008s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:31:50 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[b16af913-1d7e-42f9-bc9f-f290c7d00b58]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:31:50 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b375316d-c3fb-4096-bdc0-8e3ab282ebe6 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0e0c9a06-b384-44de-b251-7579811d20e0 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:50 devstack sudo[90899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4d9c8f-dd57-4215-b446-acc20caccba2.2f0a7b04-507b-402b-a1af-5dd3cf26e9e9
Feb 27 01:31:50 devstack sudo[90899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:50 devstack sudo[90900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0e0c9a06-b384-44de-b251-7579811d20e0
Feb 27 01:31:50 devstack sudo[90900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:50 devstack sudo[90897]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:50 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-fc85646c-bdda-478a-b171-b515c8945741 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-eef7f087-6b13-4dcc-afc9-6632c83019db 1073741824" returned: 0 in 0.636s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:50 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-fc85646c-bdda-478a-b171-b515c8945741 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-eef7f087-6b13-4dcc-afc9-6632c83019db {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:50 devstack sudo[90906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-eef7f087-6b13-4dcc-afc9-6632c83019db
Feb 27 01:31:50 devstack sudo[90906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:50 devstack sudo[90899]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:50 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d14f8cb2-a5fe-4ed7-af0e-db546dae7942 tempest-VolumeDependencyTests-1629780687 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4d9c8f-dd57-4215-b446-acc20caccba2.2f0a7b04-507b-402b-a1af-5dd3cf26e9e9" returned: 0 in 0.543s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:50 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-d14f8cb2-a5fe-4ed7-af0e-db546dae7942 tempest-VolumeDependencyTests-1629780687 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd4d9c8f-dd57-4215-b446-acc20caccba2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83106) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:31:50 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[be92ee13-454f-4587-8375-1b27aa130d7b]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:31:50 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d14f8cb2-a5fe-4ed7-af0e-db546dae7942 tempest-VolumeDependencyTests-1629780687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4d9c8f-dd57-4215-b446-acc20caccba2 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:50 devstack sudo[90900]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:50 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b375316d-c3fb-4096-bdc0-8e3ab282ebe6 tempest-CreateVolumesFromSnapshotTest-1650134941 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0e0c9a06-b384-44de-b251-7579811d20e0" returned: 0 in 0.564s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:50 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b375316d-c3fb-4096-bdc0-8e3ab282ebe6 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0e0c9a06-b384-44de-b251-7579811d20e0 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:50 devstack sudo[90914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4d9c8f-dd57-4215-b446-acc20caccba2
Feb 27 01:31:50 devstack sudo[90914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:50 devstack sudo[90915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0e0c9a06-b384-44de-b251-7579811d20e0
Feb 27 01:31:50 devstack sudo[90915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:50 devstack sudo[90906]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:50 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-fc85646c-bdda-478a-b171-b515c8945741 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-eef7f087-6b13-4dcc-afc9-6632c83019db" returned: 0 in 0.515s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:50 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-fc85646c-bdda-478a-b171-b515c8945741 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] <== create_volume: return (1182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:31:50 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-fc85646c-bdda-478a-b171-b515c8945741 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:50 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-7b092c09-fd22-4dd0-8500-9eac03e82ac7 tempest-SnapshotDependencyTests-277758335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.240s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:50 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-fc85646c-bdda-478a-b171-b515c8945741 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eff6327e-219e-4109-85b6-335892fa7072) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eef7f087-6b13-4dcc-afc9-6632c83019db', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:50 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-fc85646c-bdda-478a-b171-b515c8945741 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ec07324-4e10-49f7-8d94-3f7a8f855ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:50 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-7b092c09-fd22-4dd0-8500-9eac03e82ac7 tempest-SnapshotDependencyTests-277758335 None] Creating offline snapshot 937a2045-a21a-4104-b2d9-eb09624e1f7b of volume 0170b02c-0d22-4644-98ef-dbbd753a8989 {{(pid=83106) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:31:50 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-fc85646c-bdda-478a-b171-b515c8945741 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Volume volume-eef7f087-6b13-4dcc-afc9-6632c83019db (eef7f087-6b13-4dcc-afc9-6632c83019db): created successfully
Feb 27 01:31:50 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-fc85646c-bdda-478a-b171-b515c8945741 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ec07324-4e10-49f7-8d94-3f7a8f855ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:50 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-fc85646c-bdda-478a-b171-b515c8945741 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Flow 'volume_create_manager' (218639ad-5d51-4755-ac86-a6599c97dac8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:31:50 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e55550-ee10-4763-afd9-8cf15e0d5604]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:31:50 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7b092c09-fd22-4dd0-8500-9eac03e82ac7 tempest-SnapshotDependencyTests-277758335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0170b02c-0d22-4644-98ef-dbbd753a8989 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:50 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-fc85646c-bdda-478a-b171-b515c8945741 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Created volume successfully.
Feb 27 01:31:51 devstack sudo[90919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0170b02c-0d22-4644-98ef-dbbd753a8989
Feb 27 01:31:51 devstack sudo[90919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:51 devstack sudo[90915]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:51 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b375316d-c3fb-4096-bdc0-8e3ab282ebe6 tempest-CreateVolumesFromSnapshotTest-1650134941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0e0c9a06-b384-44de-b251-7579811d20e0" returned: 0 in 0.447s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:51 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-b375316d-c3fb-4096-bdc0-8e3ab282ebe6 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Lock "cinder-quobyte-0e0c9a06-b384-44de-b251-7579811d20e0" released by "delete_volume" :: held 1.031s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:31:51 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-b375316d-c3fb-4096-bdc0-8e3ab282ebe6 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Created reservations ['13d13628-ecb1-42c0-8256-04a8580ae927', '14e40eb7-d781-406a-81f8-f96677434408', '92e05ba3-4de5-4b96-8a77-aa6d9f49d758', '8fcf1714-e501-4834-a923-0bcc5cb76377'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:31:51 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-b375316d-c3fb-4096-bdc0-8e3ab282ebe6 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:51 devstack sudo[90914]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:51 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-b375316d-c3fb-4096-bdc0-8e3ab282ebe6 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:51 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-b375316d-c3fb-4096-bdc0-8e3ab282ebe6 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:31:51 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-b375316d-c3fb-4096-bdc0-8e3ab282ebe6 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:31:51 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-b375316d-c3fb-4096-bdc0-8e3ab282ebe6 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:51 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b375316d-c3fb-4096-bdc0-8e3ab282ebe6 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:51 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d14f8cb2-a5fe-4ed7-af0e-db546dae7942 tempest-VolumeDependencyTests-1629780687 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4d9c8f-dd57-4215-b446-acc20caccba2" returned: 0 in 0.614s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:51 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d14f8cb2-a5fe-4ed7-af0e-db546dae7942 tempest-VolumeDependencyTests-1629780687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4d9c8f-dd57-4215-b446-acc20caccba2.2f0a7b04-507b-402b-a1af-5dd3cf26e9e9 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:51 devstack sudo[90925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:31:51 devstack sudo[90925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:51 devstack sudo[90926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4d9c8f-dd57-4215-b446-acc20caccba2.2f0a7b04-507b-402b-a1af-5dd3cf26e9e9
Feb 27 01:31:51 devstack sudo[90926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:51 devstack sudo[90919]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:51 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7b092c09-fd22-4dd0-8500-9eac03e82ac7 tempest-SnapshotDependencyTests-277758335 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0170b02c-0d22-4644-98ef-dbbd753a8989" returned: 0 in 0.535s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:51 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7b092c09-fd22-4dd0-8500-9eac03e82ac7 tempest-SnapshotDependencyTests-277758335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0170b02c-0d22-4644-98ef-dbbd753a8989,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0170b02c-0d22-4644-98ef-dbbd753a8989.937a2045-a21a-4104-b2d9-eb09624e1f7b 1G {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:51 devstack sudo[90932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0170b02c-0d22-4644-98ef-dbbd753a8989,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0170b02c-0d22-4644-98ef-dbbd753a8989.937a2045-a21a-4104-b2d9-eb09624e1f7b 1G
Feb 27 01:31:51 devstack sudo[90932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:51 devstack sudo[90925]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:51 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b375316d-c3fb-4096-bdc0-8e3ab282ebe6 tempest-CreateVolumesFromSnapshotTest-1650134941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.429s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:51 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-b375316d-c3fb-4096-bdc0-8e3ab282ebe6 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:31:51 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-b375316d-c3fb-4096-bdc0-8e3ab282ebe6 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Deleted volume successfully.
Feb 27 01:31:51 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-b375316d-c3fb-4096-bdc0-8e3ab282ebe6 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Lock "cinder-0e0c9a06-b384-44de-b251-7579811d20e0-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:31:51 devstack sudo[90926]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:51 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d14f8cb2-a5fe-4ed7-af0e-db546dae7942 tempest-VolumeDependencyTests-1629780687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4d9c8f-dd57-4215-b446-acc20caccba2.2f0a7b04-507b-402b-a1af-5dd3cf26e9e9" returned: 0 in 0.474s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:51 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d14f8cb2-a5fe-4ed7-af0e-db546dae7942 tempest-VolumeDependencyTests-1629780687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4d9c8f-dd57-4215-b446-acc20caccba2.2f0a7b04-507b-402b-a1af-5dd3cf26e9e9 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:51 devstack sudo[90938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4d9c8f-dd57-4215-b446-acc20caccba2.2f0a7b04-507b-402b-a1af-5dd3cf26e9e9
Feb 27 01:31:51 devstack sudo[90938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:52 devstack sudo[90932]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:52 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7b092c09-fd22-4dd0-8500-9eac03e82ac7 tempest-SnapshotDependencyTests-277758335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0170b02c-0d22-4644-98ef-dbbd753a8989,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0170b02c-0d22-4644-98ef-dbbd753a8989.937a2045-a21a-4104-b2d9-eb09624e1f7b 1G" returned: 0 in 0.508s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:52 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7b092c09-fd22-4dd0-8500-9eac03e82ac7 tempest-SnapshotDependencyTests-277758335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0170b02c-0d22-4644-98ef-dbbd753a8989 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0170b02c-0d22-4644-98ef-dbbd753a8989.937a2045-a21a-4104-b2d9-eb09624e1f7b {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:52 devstack sudo[90943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0170b02c-0d22-4644-98ef-dbbd753a8989 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0170b02c-0d22-4644-98ef-dbbd753a8989.937a2045-a21a-4104-b2d9-eb09624e1f7b
Feb 27 01:31:52 devstack sudo[90943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:52 devstack sudo[90938]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:52 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d14f8cb2-a5fe-4ed7-af0e-db546dae7942 tempest-VolumeDependencyTests-1629780687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4d9c8f-dd57-4215-b446-acc20caccba2.2f0a7b04-507b-402b-a1af-5dd3cf26e9e9" returned: 0 in 0.464s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:52 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-d14f8cb2-a5fe-4ed7-af0e-db546dae7942 tempest-VolumeDependencyTests-1629780687 None] Lock "cinder-quobyte-2f0a7b04-507b-402b-a1af-5dd3cf26e9e9" released by "_delete_snapshot" :: held 2.167s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:31:52 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-d14f8cb2-a5fe-4ed7-af0e-db546dae7942 tempest-VolumeDependencyTests-1629780687 None] Lock "cinder-quobyte-dd4d9c8f-dd57-4215-b446-acc20caccba2" released by "delete_snapshot" :: held 2.199s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:31:52 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-db41fe5e-3f83-4467-b4e9-b56a7e7874db tempest-CreateVolumesFromSnapshotTest-1650134941 None] Acquiring lock "cinder-8bd003fb-9b49-491f-af9a-bc449a84823e-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:31:52 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-c48f462a-8ac5-4ece-9103-13fe524ae874 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:31:52 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c48f462a-8ac5-4ece-9103-13fe524ae874 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Flow 'volume_create_manager' (d55fa9c5-d185-4523-ba0e-69dff3d84f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:31:52 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c48f462a-8ac5-4ece-9103-13fe524ae874 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a90e8759-5918-422c-b030-9adfedd28c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:52 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-db41fe5e-3f83-4467-b4e9-b56a7e7874db tempest-CreateVolumesFromSnapshotTest-1650134941 None] Lock "cinder-8bd003fb-9b49-491f-af9a-bc449a84823e-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:31:52 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c48f462a-8ac5-4ece-9103-13fe524ae874 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a90e8759-5918-422c-b030-9adfedd28c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:31:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1857336629',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e35ed84c-fa52-4372-914a-b6539abc0ca3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0ef4aee4972409c886107e52dd842a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:31:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:31:52Z,use_quota=True,user_id='0c6c9b06e2a940108c8e5dc157cdb4eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:52 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c48f462a-8ac5-4ece-9103-13fe524ae874 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (475670d6-5b3d-4266-bde4-a54e4f58f795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:52 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c48f462a-8ac5-4ece-9103-13fe524ae874 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (475670d6-5b3d-4266-bde4-a54e4f58f795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:52 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c48f462a-8ac5-4ece-9103-13fe524ae874 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eff5b3b-9616-4bf4-ad03-428733f9a5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:52 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c48f462a-8ac5-4ece-9103-13fe524ae874 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eff5b3b-9616-4bf4-ad03-428733f9a5ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e35ed84c-fa52-4372-914a-b6539abc0ca3', 'volume_name': 'volume-e35ed84c-fa52-4372-914a-b6539abc0ca3', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:52 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c48f462a-8ac5-4ece-9103-13fe524ae874 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a43db5a-3982-44b0-9d37-72d70d24574d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:52 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c48f462a-8ac5-4ece-9103-13fe524ae874 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a43db5a-3982-44b0-9d37-72d70d24574d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:52 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c48f462a-8ac5-4ece-9103-13fe524ae874 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84e2c612-d95e-4dc2-b10a-fdf94fdff59c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:52 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-c48f462a-8ac5-4ece-9103-13fe524ae874 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Volume e35ed84c-fa52-4372-914a-b6539abc0ca3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e35ed84c-fa52-4372-914a-b6539abc0ca3', 'volume_size': 1}
Feb 27 01:31:52 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-c48f462a-8ac5-4ece-9103-13fe524ae874 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:52 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-db41fe5e-3f83-4467-b4e9-b56a7e7874db tempest-CreateVolumesFromSnapshotTest-1650134941 None] Acquiring lock "cinder-quobyte-8bd003fb-9b49-491f-af9a-bc449a84823e" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:31:52 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-d14f8cb2-a5fe-4ed7-af0e-db546dae7942 tempest-VolumeDependencyTests-1629780687 None] Created reservations ['b0580613-252c-4bd2-9698-bf57096444a1', 'c0b336cd-e11e-4184-b1c8-bd55796d1ff8', 'd6265aa2-300b-405f-aed6-3e4f6af8a683', 'e94e4523-a763-4c43-ba1d-e637220b4f96'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:31:52 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-db41fe5e-3f83-4467-b4e9-b56a7e7874db tempest-CreateVolumesFromSnapshotTest-1650134941 None] Lock "cinder-quobyte-8bd003fb-9b49-491f-af9a-bc449a84823e" acquired by "delete_volume" :: waited 0.014s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:31:52 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[771f87a3-a0ec-48df-a7ba-1c986979d428]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:31:52 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-db41fe5e-3f83-4467-b4e9-b56a7e7874db tempest-CreateVolumesFromSnapshotTest-1650134941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8bd003fb-9b49-491f-af9a-bc449a84823e {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:52 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2fa04a4-c553-4301-8c47-90c3cf60d6c7 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:31:52 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-b2fa04a4-c553-4301-8c47-90c3cf60d6c7 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Flow 'volume_create_manager' (cd216a97-ede3-45a6-94dd-a651f1c7e88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:31:52 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-b2fa04a4-c553-4301-8c47-90c3cf60d6c7 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (092c1f3c-9889-44a4-a900-7a7f07dc58f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:52 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-b2fa04a4-c553-4301-8c47-90c3cf60d6c7 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (092c1f3c-9889-44a4-a900-7a7f07dc58f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:31:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-87920731',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8832989-9424-4746-9d3e-7b7ea24c096c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0ef4aee4972409c886107e52dd842a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:31:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:31:52Z,use_quota=True,user_id='0c6c9b06e2a940108c8e5dc157cdb4eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:52 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-b2fa04a4-c553-4301-8c47-90c3cf60d6c7 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d18bba2d-4452-4497-a498-1663556f7d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:52 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-b2fa04a4-c553-4301-8c47-90c3cf60d6c7 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d18bba2d-4452-4497-a498-1663556f7d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:52 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-b2fa04a4-c553-4301-8c47-90c3cf60d6c7 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd25dd49-97de-45c2-8c82-022dcdc3a750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:52 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-b2fa04a4-c553-4301-8c47-90c3cf60d6c7 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd25dd49-97de-45c2-8c82-022dcdc3a750) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8832989-9424-4746-9d3e-7b7ea24c096c', 'volume_name': 'volume-c8832989-9424-4746-9d3e-7b7ea24c096c', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:52 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-b2fa04a4-c553-4301-8c47-90c3cf60d6c7 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (210b26f6-30ca-41c4-9472-ce9b0b26557c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:52 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-b2fa04a4-c553-4301-8c47-90c3cf60d6c7 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (210b26f6-30ca-41c4-9472-ce9b0b26557c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:52 devstack sudo[90948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8bd003fb-9b49-491f-af9a-bc449a84823e
Feb 27 01:31:52 devstack sudo[90948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:52 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-b2fa04a4-c553-4301-8c47-90c3cf60d6c7 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a91e712-ad24-4a7d-93ac-c16809306beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:52 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-b2fa04a4-c553-4301-8c47-90c3cf60d6c7 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Volume c8832989-9424-4746-9d3e-7b7ea24c096c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8832989-9424-4746-9d3e-7b7ea24c096c', 'volume_size': 1}
Feb 27 01:31:52 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-b2fa04a4-c553-4301-8c47-90c3cf60d6c7 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:52 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-d14f8cb2-a5fe-4ed7-af0e-db546dae7942 tempest-VolumeDependencyTests-1629780687 None] Delete snapshot completed successfully.
Feb 27 01:31:52 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-d14f8cb2-a5fe-4ed7-af0e-db546dae7942 tempest-VolumeDependencyTests-1629780687 None] Lock "cinder-2f0a7b04-507b-402b-a1af-5dd3cf26e9e9-delete_snapshot" released by "delete_snapshot" :: held 2.554s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:31:52 devstack sudo[90943]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:52 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7b092c09-fd22-4dd0-8500-9eac03e82ac7 tempest-SnapshotDependencyTests-277758335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0170b02c-0d22-4644-98ef-dbbd753a8989 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0170b02c-0d22-4644-98ef-dbbd753a8989.937a2045-a21a-4104-b2d9-eb09624e1f7b" returned: 0 in 0.501s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:52 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-7b092c09-fd22-4dd0-8500-9eac03e82ac7 tempest-SnapshotDependencyTests-277758335 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0170b02c-0d22-4644-98ef-dbbd753a8989.937a2045-a21a-4104-b2d9-eb09624e1f7b is being set with open permissions: ugo+rw
Feb 27 01:31:52 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7b092c09-fd22-4dd0-8500-9eac03e82ac7 tempest-SnapshotDependencyTests-277758335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0170b02c-0d22-4644-98ef-dbbd753a8989.937a2045-a21a-4104-b2d9-eb09624e1f7b {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:52 devstack sudo[90951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0170b02c-0d22-4644-98ef-dbbd753a8989.937a2045-a21a-4104-b2d9-eb09624e1f7b
Feb 27 01:31:52 devstack sudo[90951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:52 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf55ff6f-fce7-4dca-a054-0115e66a0cbe tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:31:52 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-bf55ff6f-fce7-4dca-a054-0115e66a0cbe tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Flow 'volume_create_manager' (7d2a74d4-64c2-45c1-ae81-89f6320abccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:31:52 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-bf55ff6f-fce7-4dca-a054-0115e66a0cbe tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db454fa8-c392-439b-b424-9d1982fb3206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:52 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-bf55ff6f-fce7-4dca-a054-0115e66a0cbe tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db454fa8-c392-439b-b424-9d1982fb3206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:31:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-918138071',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f3bbf25-0f9b-4025-b2c1-7b6e220145a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0ef4aee4972409c886107e52dd842a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:31:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:31:53Z,use_quota=True,user_id='0c6c9b06e2a940108c8e5dc157cdb4eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:52 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-bf55ff6f-fce7-4dca-a054-0115e66a0cbe tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de056267-4575-44c8-b58d-771dd607a172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:52 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-bf55ff6f-fce7-4dca-a054-0115e66a0cbe tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de056267-4575-44c8-b58d-771dd607a172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:52 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-bf55ff6f-fce7-4dca-a054-0115e66a0cbe tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0908af27-9c00-4204-9359-0a9cd2eb3cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:52 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-bf55ff6f-fce7-4dca-a054-0115e66a0cbe tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0908af27-9c00-4204-9359-0a9cd2eb3cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f3bbf25-0f9b-4025-b2c1-7b6e220145a5', 'volume_name': 'volume-1f3bbf25-0f9b-4025-b2c1-7b6e220145a5', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:52 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-bf55ff6f-fce7-4dca-a054-0115e66a0cbe tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (758651a4-5550-49f2-9ccf-0619edd78390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:52 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-bf55ff6f-fce7-4dca-a054-0115e66a0cbe tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (758651a4-5550-49f2-9ccf-0619edd78390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:52 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-bf55ff6f-fce7-4dca-a054-0115e66a0cbe tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24bd121b-75ad-4095-8c2b-3d538f6effc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:52 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-bf55ff6f-fce7-4dca-a054-0115e66a0cbe tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Volume 1f3bbf25-0f9b-4025-b2c1-7b6e220145a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f3bbf25-0f9b-4025-b2c1-7b6e220145a5', 'volume_size': 1}
Feb 27 01:31:52 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-bf55ff6f-fce7-4dca-a054-0115e66a0cbe tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:52 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-95da6b78-6b7e-4c24-afae-b22bf3405d0e tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:31:52 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-95da6b78-6b7e-4c24-afae-b22bf3405d0e tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Flow 'volume_create_manager' (e283234d-2b13-4d7c-8fbd-2780de1257b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:31:52 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-95da6b78-6b7e-4c24-afae-b22bf3405d0e tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78aaaa63-cc72-480f-8b6b-0f207216a368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:52 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-95da6b78-6b7e-4c24-afae-b22bf3405d0e tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78aaaa63-cc72-480f-8b6b-0f207216a368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:31:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1657004802',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dfd305d-2ba1-4906-83d9-9cc4f1de18ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0ef4aee4972409c886107e52dd842a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:31:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:31:53Z,use_quota=True,user_id='0c6c9b06e2a940108c8e5dc157cdb4eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:52 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-95da6b78-6b7e-4c24-afae-b22bf3405d0e tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8ee5a61-be7c-4b05-9b30-5b042b93d9da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:52 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-95da6b78-6b7e-4c24-afae-b22bf3405d0e tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8ee5a61-be7c-4b05-9b30-5b042b93d9da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:52 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-95da6b78-6b7e-4c24-afae-b22bf3405d0e tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d190f09-68f1-4543-a01e-35ae08d5c246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:52 devstack sudo[90948]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:52 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-95da6b78-6b7e-4c24-afae-b22bf3405d0e tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d190f09-68f1-4543-a01e-35ae08d5c246) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7dfd305d-2ba1-4906-83d9-9cc4f1de18ce', 'volume_name': 'volume-7dfd305d-2ba1-4906-83d9-9cc4f1de18ce', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:52 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-95da6b78-6b7e-4c24-afae-b22bf3405d0e tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01e7a460-1a88-4443-a65e-272afe7b2232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:52 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-95da6b78-6b7e-4c24-afae-b22bf3405d0e tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01e7a460-1a88-4443-a65e-272afe7b2232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:52 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-95da6b78-6b7e-4c24-afae-b22bf3405d0e tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba11008b-aa89-4c33-92f4-d826c27b21f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:52 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-95da6b78-6b7e-4c24-afae-b22bf3405d0e tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Volume 7dfd305d-2ba1-4906-83d9-9cc4f1de18ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7dfd305d-2ba1-4906-83d9-9cc4f1de18ce', 'volume_size': 1}
Feb 27 01:31:52 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-95da6b78-6b7e-4c24-afae-b22bf3405d0e tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:52 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-db41fe5e-3f83-4467-b4e9-b56a7e7874db tempest-CreateVolumesFromSnapshotTest-1650134941 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8bd003fb-9b49-491f-af9a-bc449a84823e" returned: 0 in 0.579s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:52 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-db41fe5e-3f83-4467-b4e9-b56a7e7874db tempest-CreateVolumesFromSnapshotTest-1650134941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8bd003fb-9b49-491f-af9a-bc449a84823e {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:52 devstack sudo[90958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8bd003fb-9b49-491f-af9a-bc449a84823e
Feb 27 01:31:52 devstack sudo[90958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:53 devstack sudo[90951]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:53 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7b092c09-fd22-4dd0-8500-9eac03e82ac7 tempest-SnapshotDependencyTests-277758335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0170b02c-0d22-4644-98ef-dbbd753a8989.937a2045-a21a-4104-b2d9-eb09624e1f7b" returned: 0 in 0.542s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:53 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7b092c09-fd22-4dd0-8500-9eac03e82ac7 tempest-SnapshotDependencyTests-277758335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0170b02c-0d22-4644-98ef-dbbd753a8989.info {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:53 devstack sudo[90960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0170b02c-0d22-4644-98ef-dbbd753a8989.info
Feb 27 01:31:53 devstack sudo[90960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:53 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5a22f897-ed39-435a-921a-683403a62dd6 tempest-VolumeDependencyTests-1629780687 None] Acquiring lock "cinder-dd4d9c8f-dd57-4215-b446-acc20caccba2-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:31:53 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5a22f897-ed39-435a-921a-683403a62dd6 tempest-VolumeDependencyTests-1629780687 None] Lock "cinder-dd4d9c8f-dd57-4215-b446-acc20caccba2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:31:53 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9c23cc6-0ad6-4891-aadf-ed5aba5a92fa tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:31:53 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-b9c23cc6-0ad6-4891-aadf-ed5aba5a92fa tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Flow 'volume_create_manager' (a76154ad-9b63-4411-9ccf-b6b8c2a463bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:31:53 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-b9c23cc6-0ad6-4891-aadf-ed5aba5a92fa tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (accf0991-be54-4d98-b39e-e4203da71ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:53 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-b9c23cc6-0ad6-4891-aadf-ed5aba5a92fa tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (accf0991-be54-4d98-b39e-e4203da71ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:31:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-13388392',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37453818-2ede-4906-b783-ec1f849833d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0ef4aee4972409c886107e52dd842a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:31:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:31:53Z,use_quota=True,user_id='0c6c9b06e2a940108c8e5dc157cdb4eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:53 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-b9c23cc6-0ad6-4891-aadf-ed5aba5a92fa tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (656b5664-ad6e-4cf9-8726-0c883bc26179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:53 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-b9c23cc6-0ad6-4891-aadf-ed5aba5a92fa tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (656b5664-ad6e-4cf9-8726-0c883bc26179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:53 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-b9c23cc6-0ad6-4891-aadf-ed5aba5a92fa tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64233e29-a6d0-4089-bb09-d6f449d608e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:53 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-b9c23cc6-0ad6-4891-aadf-ed5aba5a92fa tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64233e29-a6d0-4089-bb09-d6f449d608e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37453818-2ede-4906-b783-ec1f849833d3', 'volume_name': 'volume-37453818-2ede-4906-b783-ec1f849833d3', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:53 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-b9c23cc6-0ad6-4891-aadf-ed5aba5a92fa tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b4b921b-9444-4f4d-aa38-e3588f09bffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:53 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-b9c23cc6-0ad6-4891-aadf-ed5aba5a92fa tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b4b921b-9444-4f4d-aa38-e3588f09bffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:53 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-b9c23cc6-0ad6-4891-aadf-ed5aba5a92fa tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03f19e26-caf3-4658-ab28-4dd0ece5dce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:53 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-b9c23cc6-0ad6-4891-aadf-ed5aba5a92fa tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Volume 37453818-2ede-4906-b783-ec1f849833d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37453818-2ede-4906-b783-ec1f849833d3', 'volume_size': 1}
Feb 27 01:31:53 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-b9c23cc6-0ad6-4891-aadf-ed5aba5a92fa tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:53 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5a22f897-ed39-435a-921a-683403a62dd6 tempest-VolumeDependencyTests-1629780687 None] Acquiring lock "cinder-quobyte-dd4d9c8f-dd57-4215-b446-acc20caccba2" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:31:53 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5a22f897-ed39-435a-921a-683403a62dd6 tempest-VolumeDependencyTests-1629780687 None] Lock "cinder-quobyte-dd4d9c8f-dd57-4215-b446-acc20caccba2" acquired by "delete_volume" :: waited 0.007s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:31:53 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df13b93-1714-403b-9590-c1dc68a4faa4]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:31:53 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5a22f897-ed39-435a-921a-683403a62dd6 tempest-VolumeDependencyTests-1629780687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4d9c8f-dd57-4215-b446-acc20caccba2 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:53 devstack sudo[90962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4d9c8f-dd57-4215-b446-acc20caccba2
Feb 27 01:31:53 devstack sudo[90962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:53 devstack sudo[90958]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:53 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-db41fe5e-3f83-4467-b4e9-b56a7e7874db tempest-CreateVolumesFromSnapshotTest-1650134941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-8bd003fb-9b49-491f-af9a-bc449a84823e" returned: 0 in 0.505s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:53 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-db41fe5e-3f83-4467-b4e9-b56a7e7874db tempest-CreateVolumesFromSnapshotTest-1650134941 None] Lock "cinder-quobyte-8bd003fb-9b49-491f-af9a-bc449a84823e" released by "delete_volume" :: held 1.116s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:31:53 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-db41fe5e-3f83-4467-b4e9-b56a7e7874db tempest-CreateVolumesFromSnapshotTest-1650134941 None] Created reservations ['3e49644a-4be3-428a-8245-fc29e6c92457', '994999b5-f876-4793-a382-70976bb21937', '624c2a55-16fa-4ddc-bba5-5ca3d0c63030', 'be040e93-a5fd-4e54-9a36-a4114e54fe50'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:31:53 devstack sudo[90960]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:53 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7b092c09-fd22-4dd0-8500-9eac03e82ac7 tempest-SnapshotDependencyTests-277758335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0170b02c-0d22-4644-98ef-dbbd753a8989.info" returned: 0 in 0.458s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:53 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-7b092c09-fd22-4dd0-8500-9eac03e82ac7 tempest-SnapshotDependencyTests-277758335 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0170b02c-0d22-4644-98ef-dbbd753a8989.info is being set with open permissions: ugo+rw
Feb 27 01:31:53 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7b092c09-fd22-4dd0-8500-9eac03e82ac7 tempest-SnapshotDependencyTests-277758335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0170b02c-0d22-4644-98ef-dbbd753a8989.info {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:53 devstack sudo[90966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0170b02c-0d22-4644-98ef-dbbd753a8989.info
Feb 27 01:31:53 devstack sudo[90966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:53 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-db41fe5e-3f83-4467-b4e9-b56a7e7874db tempest-CreateVolumesFromSnapshotTest-1650134941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:53 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-db41fe5e-3f83-4467-b4e9-b56a7e7874db tempest-CreateVolumesFromSnapshotTest-1650134941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:53 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-db41fe5e-3f83-4467-b4e9-b56a7e7874db tempest-CreateVolumesFromSnapshotTest-1650134941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:31:53 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-db41fe5e-3f83-4467-b4e9-b56a7e7874db tempest-CreateVolumesFromSnapshotTest-1650134941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:31:53 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-db41fe5e-3f83-4467-b4e9-b56a7e7874db tempest-CreateVolumesFromSnapshotTest-1650134941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:53 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-db41fe5e-3f83-4467-b4e9-b56a7e7874db tempest-CreateVolumesFromSnapshotTest-1650134941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:53 devstack sudo[90968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:31:53 devstack sudo[90968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:53 devstack sudo[90962]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:53 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5a22f897-ed39-435a-921a-683403a62dd6 tempest-VolumeDependencyTests-1629780687 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4d9c8f-dd57-4215-b446-acc20caccba2" returned: 0 in 0.540s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:53 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5a22f897-ed39-435a-921a-683403a62dd6 tempest-VolumeDependencyTests-1629780687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4d9c8f-dd57-4215-b446-acc20caccba2 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:53 devstack sudo[90973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4d9c8f-dd57-4215-b446-acc20caccba2
Feb 27 01:31:53 devstack sudo[90973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:53 devstack sudo[90966]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:53 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7b092c09-fd22-4dd0-8500-9eac03e82ac7 tempest-SnapshotDependencyTests-277758335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0170b02c-0d22-4644-98ef-dbbd753a8989.info" returned: 0 in 0.435s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:53 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-7b092c09-fd22-4dd0-8500-9eac03e82ac7 tempest-SnapshotDependencyTests-277758335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.074s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:54 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-c48f462a-8ac5-4ece-9103-13fe524ae874 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.665s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:54 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-c48f462a-8ac5-4ece-9103-13fe524ae874 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:31:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1857336629',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e35ed84c-fa52-4372-914a-b6539abc0ca3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0ef4aee4972409c886107e52dd842a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:31:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:31:52Z,use_quota=True,user_id='0c6c9b06e2a940108c8e5dc157cdb4eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:31:54 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-c48f462a-8ac5-4ece-9103-13fe524ae874 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Creating volume e35ed84c-fa52-4372-914a-b6539abc0ca3 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:31:54 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-c48f462a-8ac5-4ece-9103-13fe524ae874 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:54 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-c48f462a-8ac5-4ece-9103-13fe524ae874 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:54 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-c48f462a-8ac5-4ece-9103-13fe524ae874 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:31:54 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-c48f462a-8ac5-4ece-9103-13fe524ae874 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:31:54 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-c48f462a-8ac5-4ece-9103-13fe524ae874 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:54 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-c48f462a-8ac5-4ece-9103-13fe524ae874 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:31:54 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-c48f462a-8ac5-4ece-9103-13fe524ae874 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:31:54 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c48f462a-8ac5-4ece-9103-13fe524ae874 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e35ed84c-fa52-4372-914a-b6539abc0ca3 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:54 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-7b092c09-fd22-4dd0-8500-9eac03e82ac7 tempest-SnapshotDependencyTests-277758335 None] Create snapshot completed successfully
Feb 27 01:31:54 devstack sudo[90977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e35ed84c-fa52-4372-914a-b6539abc0ca3 1073741824
Feb 27 01:31:54 devstack sudo[90977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:54 devstack sudo[90968]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:54 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-db41fe5e-3f83-4467-b4e9-b56a7e7874db tempest-CreateVolumesFromSnapshotTest-1650134941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.479s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:54 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-db41fe5e-3f83-4467-b4e9-b56a7e7874db tempest-CreateVolumesFromSnapshotTest-1650134941 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:31:54 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-db41fe5e-3f83-4467-b4e9-b56a7e7874db tempest-CreateVolumesFromSnapshotTest-1650134941 None] Deleted volume successfully.
Feb 27 01:31:54 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-db41fe5e-3f83-4467-b4e9-b56a7e7874db tempest-CreateVolumesFromSnapshotTest-1650134941 None] Lock "cinder-8bd003fb-9b49-491f-af9a-bc449a84823e-delete_volume" released by "delete_volume" :: held 1.848s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:31:54 devstack sudo[90973]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:54 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5a22f897-ed39-435a-921a-683403a62dd6 tempest-VolumeDependencyTests-1629780687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-dd4d9c8f-dd57-4215-b446-acc20caccba2" returned: 0 in 0.486s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:54 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5a22f897-ed39-435a-921a-683403a62dd6 tempest-VolumeDependencyTests-1629780687 None] Lock "cinder-quobyte-dd4d9c8f-dd57-4215-b446-acc20caccba2" released by "delete_volume" :: held 1.057s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:31:54 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-5a22f897-ed39-435a-921a-683403a62dd6 tempest-VolumeDependencyTests-1629780687 None] Created reservations ['d9921c15-7f29-4d18-91a8-e2e44d1f6b78', '7964ec62-4b44-4e78-ba02-a2223f5c7c3b', '51634834-b904-4b24-8425-58eb52f4aa9c', 'b65b27a2-1ea2-4096-b7df-2fe88ef7fa44'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:31:54 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-5a22f897-ed39-435a-921a-683403a62dd6 tempest-VolumeDependencyTests-1629780687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:54 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-5a22f897-ed39-435a-921a-683403a62dd6 tempest-VolumeDependencyTests-1629780687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:54 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-5a22f897-ed39-435a-921a-683403a62dd6 tempest-VolumeDependencyTests-1629780687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:31:54 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-5a22f897-ed39-435a-921a-683403a62dd6 tempest-VolumeDependencyTests-1629780687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:31:54 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-5a22f897-ed39-435a-921a-683403a62dd6 tempest-VolumeDependencyTests-1629780687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:54 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5a22f897-ed39-435a-921a-683403a62dd6 tempest-VolumeDependencyTests-1629780687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:54 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-d9de0b3b-0e6c-44a9-9f9e-c7c9031703ad tempest-CreateVolumesFromSnapshotTest-1650134941 None] Acquiring lock "cinder-c9b3bb4c-7235-406f-9359-225fd1a282d1-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:31:54 devstack sudo[90982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:31:54 devstack sudo[90982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:54 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-d9de0b3b-0e6c-44a9-9f9e-c7c9031703ad tempest-CreateVolumesFromSnapshotTest-1650134941 None] Lock "cinder-c9b3bb4c-7235-406f-9359-225fd1a282d1-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:31:54 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-d9de0b3b-0e6c-44a9-9f9e-c7c9031703ad tempest-CreateVolumesFromSnapshotTest-1650134941 None] Acquiring lock "cinder-quobyte-c9b3bb4c-7235-406f-9359-225fd1a282d1" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:31:54 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-d9de0b3b-0e6c-44a9-9f9e-c7c9031703ad tempest-CreateVolumesFromSnapshotTest-1650134941 None] Lock "cinder-quobyte-c9b3bb4c-7235-406f-9359-225fd1a282d1" acquired by "delete_volume" :: waited 0.008s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:31:54 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[f051bfba-b6a0-42d5-89d8-fe98b4b13cbd]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:31:54 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d9de0b3b-0e6c-44a9-9f9e-c7c9031703ad tempest-CreateVolumesFromSnapshotTest-1650134941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c9b3bb4c-7235-406f-9359-225fd1a282d1 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:54 devstack sudo[90985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c9b3bb4c-7235-406f-9359-225fd1a282d1
Feb 27 01:31:54 devstack sudo[90985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:54 devstack sudo[90977]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:54 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c48f462a-8ac5-4ece-9103-13fe524ae874 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e35ed84c-fa52-4372-914a-b6539abc0ca3 1073741824" returned: 0 in 0.578s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:54 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c48f462a-8ac5-4ece-9103-13fe524ae874 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e35ed84c-fa52-4372-914a-b6539abc0ca3 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:54 devstack sudo[90987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e35ed84c-fa52-4372-914a-b6539abc0ca3
Feb 27 01:31:54 devstack sudo[90987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:54 devstack sudo[90982]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:54 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5a22f897-ed39-435a-921a-683403a62dd6 tempest-VolumeDependencyTests-1629780687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.427s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:54 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-5a22f897-ed39-435a-921a-683403a62dd6 tempest-VolumeDependencyTests-1629780687 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:31:54 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-5a22f897-ed39-435a-921a-683403a62dd6 tempest-VolumeDependencyTests-1629780687 None] Deleted volume successfully.
Feb 27 01:31:54 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5a22f897-ed39-435a-921a-683403a62dd6 tempest-VolumeDependencyTests-1629780687 None] Lock "cinder-dd4d9c8f-dd57-4215-b446-acc20caccba2-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:31:54 devstack sudo[90985]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:54 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d9de0b3b-0e6c-44a9-9f9e-c7c9031703ad tempest-CreateVolumesFromSnapshotTest-1650134941 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c9b3bb4c-7235-406f-9359-225fd1a282d1" returned: 0 in 0.480s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:54 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d9de0b3b-0e6c-44a9-9f9e-c7c9031703ad tempest-CreateVolumesFromSnapshotTest-1650134941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c9b3bb4c-7235-406f-9359-225fd1a282d1 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:54 devstack sudo[90994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c9b3bb4c-7235-406f-9359-225fd1a282d1
Feb 27 01:31:54 devstack sudo[90994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:55 devstack sudo[90987]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-c48f462a-8ac5-4ece-9103-13fe524ae874 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e35ed84c-fa52-4372-914a-b6539abc0ca3" returned: 0 in 0.437s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:55 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-c48f462a-8ac5-4ece-9103-13fe524ae874 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:31:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-c48f462a-8ac5-4ece-9103-13fe524ae874 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-b2fa04a4-c553-4301-8c47-90c3cf60d6c7 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.568s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:55 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-b2fa04a4-c553-4301-8c47-90c3cf60d6c7 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:31:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-87920731',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8832989-9424-4746-9d3e-7b7ea24c096c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0ef4aee4972409c886107e52dd842a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:31:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:31:52Z,use_quota=True,user_id='0c6c9b06e2a940108c8e5dc157cdb4eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:31:55 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-b2fa04a4-c553-4301-8c47-90c3cf60d6c7 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Creating volume c8832989-9424-4746-9d3e-7b7ea24c096c {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:31:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-b2fa04a4-c553-4301-8c47-90c3cf60d6c7 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-b2fa04a4-c553-4301-8c47-90c3cf60d6c7 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:55 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-b2fa04a4-c553-4301-8c47-90c3cf60d6c7 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:31:55 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-b2fa04a4-c553-4301-8c47-90c3cf60d6c7 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:31:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-b2fa04a4-c553-4301-8c47-90c3cf60d6c7 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:55 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-b2fa04a4-c553-4301-8c47-90c3cf60d6c7 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:31:55 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-b2fa04a4-c553-4301-8c47-90c3cf60d6c7 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:31:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b2fa04a4-c553-4301-8c47-90c3cf60d6c7 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c8832989-9424-4746-9d3e-7b7ea24c096c 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:55 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c48f462a-8ac5-4ece-9103-13fe524ae874 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84e2c612-d95e-4dc2-b10a-fdf94fdff59c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e35ed84c-fa52-4372-914a-b6539abc0ca3', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:55 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c48f462a-8ac5-4ece-9103-13fe524ae874 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23b60b54-5c57-4096-9011-d29c3a23ca11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:55 devstack sudo[90996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c8832989-9424-4746-9d3e-7b7ea24c096c 1073741824
Feb 27 01:31:55 devstack sudo[90996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:55 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-c48f462a-8ac5-4ece-9103-13fe524ae874 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Volume volume-e35ed84c-fa52-4372-914a-b6539abc0ca3 (e35ed84c-fa52-4372-914a-b6539abc0ca3): created successfully
Feb 27 01:31:55 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c48f462a-8ac5-4ece-9103-13fe524ae874 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23b60b54-5c57-4096-9011-d29c3a23ca11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:55 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-c48f462a-8ac5-4ece-9103-13fe524ae874 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Flow 'volume_create_manager' (d55fa9c5-d185-4523-ba0e-69dff3d84f86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:31:55 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-c48f462a-8ac5-4ece-9103-13fe524ae874 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Created volume successfully.
Feb 27 01:31:55 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-b298635b-e3e3-4d2e-bd43-aea724483c5e tempest-SnapshotDependencyTests-277758335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:31:55 devstack sudo[90994]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:55 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-b298635b-e3e3-4d2e-bd43-aea724483c5e tempest-SnapshotDependencyTests-277758335 None] Flow 'volume_create_manager' (2df21e07-5766-4460-93c7-88d8e515eba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:31:55 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-b298635b-e3e3-4d2e-bd43-aea724483c5e tempest-SnapshotDependencyTests-277758335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46e49e7c-694c-4b2c-80da-2201ae852a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d9de0b3b-0e6c-44a9-9f9e-c7c9031703ad tempest-CreateVolumesFromSnapshotTest-1650134941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c9b3bb4c-7235-406f-9359-225fd1a282d1" returned: 0 in 0.544s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:55 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-d9de0b3b-0e6c-44a9-9f9e-c7c9031703ad tempest-CreateVolumesFromSnapshotTest-1650134941 None] Lock "cinder-quobyte-c9b3bb4c-7235-406f-9359-225fd1a282d1" released by "delete_volume" :: held 1.085s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:31:55 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-b298635b-e3e3-4d2e-bd43-aea724483c5e tempest-SnapshotDependencyTests-277758335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46e49e7c-694c-4b2c-80da-2201ae852a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:31:55Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5601f33-acb7-4f3f-8767-1ecd3de37ae0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43e5a9252e0244bc8ff1b7e9f20ca60b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:31:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=937a2045-a21a-4104-b2d9-eb09624e1f7b,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:31:55Z,use_quota=True,user_id='fede7c59fa3c416297fcece65bdb9b73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:55 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-b298635b-e3e3-4d2e-bd43-aea724483c5e tempest-SnapshotDependencyTests-277758335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f0bf8e1-844a-47ac-aceb-7d766a45f042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:55 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-b298635b-e3e3-4d2e-bd43-aea724483c5e tempest-SnapshotDependencyTests-277758335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f0bf8e1-844a-47ac-aceb-7d766a45f042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:55 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-b298635b-e3e3-4d2e-bd43-aea724483c5e tempest-SnapshotDependencyTests-277758335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77513795-b511-4f24-af01-18615c849954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:55 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-b298635b-e3e3-4d2e-bd43-aea724483c5e tempest-SnapshotDependencyTests-277758335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77513795-b511-4f24-af01-18615c849954) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd5601f33-acb7-4f3f-8767-1ecd3de37ae0', 'volume_name': 'volume-d5601f33-acb7-4f3f-8767-1ecd3de37ae0', 'volume_size': 1, 'snapshot_id': '937a2045-a21a-4104-b2d9-eb09624e1f7b'}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:55 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-b298635b-e3e3-4d2e-bd43-aea724483c5e tempest-SnapshotDependencyTests-277758335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (458e8890-b22b-41b8-a243-af2e9fc1f0c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:55 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-b298635b-e3e3-4d2e-bd43-aea724483c5e tempest-SnapshotDependencyTests-277758335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (458e8890-b22b-41b8-a243-af2e9fc1f0c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:55 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-b298635b-e3e3-4d2e-bd43-aea724483c5e tempest-SnapshotDependencyTests-277758335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f5bbc4f-35d0-4de7-bdd9-7785311943a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:55 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-b298635b-e3e3-4d2e-bd43-aea724483c5e tempest-SnapshotDependencyTests-277758335 None] Volume d5601f33-acb7-4f3f-8767-1ecd3de37ae0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d5601f33-acb7-4f3f-8767-1ecd3de37ae0', 'volume_size': 1, 'snapshot_id': '937a2045-a21a-4104-b2d9-eb09624e1f7b'}
Feb 27 01:31:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-b298635b-e3e3-4d2e-bd43-aea724483c5e tempest-SnapshotDependencyTests-277758335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:55 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a313f99-0660-4f29-9ea0-a530fec3ef1c tempest-VolumeDependencyTests-1629780687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:31:55 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-0a313f99-0660-4f29-9ea0-a530fec3ef1c tempest-VolumeDependencyTests-1629780687 None] Flow 'volume_create_manager' (4f8f917e-1c4b-4b91-ba7e-28bd80836240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:31:55 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-0a313f99-0660-4f29-9ea0-a530fec3ef1c tempest-VolumeDependencyTests-1629780687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6ab0226-d0b0-40eb-b88d-56d876cc6e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:55 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-d9de0b3b-0e6c-44a9-9f9e-c7c9031703ad tempest-CreateVolumesFromSnapshotTest-1650134941 None] Created reservations ['d7a94bc6-8318-441d-9b66-5fd14b499a52', '2b322852-bd6e-42c1-895f-5368f4537f0b', '7f0bdc47-9349-476e-817b-a88496329337', 'e52e7ebf-f828-406d-ad27-2f9fa2b95588'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:31:55 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-0a313f99-0660-4f29-9ea0-a530fec3ef1c tempest-VolumeDependencyTests-1629780687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6ab0226-d0b0-40eb-b88d-56d876cc6e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:31:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-77463479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ade9918f-1f8a-4b6e-b3aa-fef154760cfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae46202a7c8e473eb29eb42c73fcbd9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:31:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:31:56Z,use_quota=True,user_id='b3008ba5718f4609b1c16d3b5395869c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:55 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-0a313f99-0660-4f29-9ea0-a530fec3ef1c tempest-VolumeDependencyTests-1629780687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (384e1b93-fe8d-4564-951a-7fff8ba8420f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:55 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-0a313f99-0660-4f29-9ea0-a530fec3ef1c tempest-VolumeDependencyTests-1629780687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (384e1b93-fe8d-4564-951a-7fff8ba8420f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:55 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-0a313f99-0660-4f29-9ea0-a530fec3ef1c tempest-VolumeDependencyTests-1629780687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b97c364-3460-4939-8ebc-4e9fa4f30a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:55 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-0a313f99-0660-4f29-9ea0-a530fec3ef1c tempest-VolumeDependencyTests-1629780687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b97c364-3460-4939-8ebc-4e9fa4f30a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ade9918f-1f8a-4b6e-b3aa-fef154760cfd', 'volume_name': 'volume-ade9918f-1f8a-4b6e-b3aa-fef154760cfd', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:55 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-0a313f99-0660-4f29-9ea0-a530fec3ef1c tempest-VolumeDependencyTests-1629780687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf53475d-9f17-4840-b04a-2262ab2dd8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:55 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-0a313f99-0660-4f29-9ea0-a530fec3ef1c tempest-VolumeDependencyTests-1629780687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf53475d-9f17-4840-b04a-2262ab2dd8da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:55 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-0a313f99-0660-4f29-9ea0-a530fec3ef1c tempest-VolumeDependencyTests-1629780687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60835b6f-220b-4ab4-84c7-83ceda0fc124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:55 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-0a313f99-0660-4f29-9ea0-a530fec3ef1c tempest-VolumeDependencyTests-1629780687 None] Volume ade9918f-1f8a-4b6e-b3aa-fef154760cfd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ade9918f-1f8a-4b6e-b3aa-fef154760cfd', 'volume_size': 1}
Feb 27 01:31:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-0a313f99-0660-4f29-9ea0-a530fec3ef1c tempest-VolumeDependencyTests-1629780687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:55 devstack sudo[90996]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b2fa04a4-c553-4301-8c47-90c3cf60d6c7 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c8832989-9424-4746-9d3e-7b7ea24c096c 1073741824" returned: 0 in 0.687s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-d9de0b3b-0e6c-44a9-9f9e-c7c9031703ad tempest-CreateVolumesFromSnapshotTest-1650134941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-d9de0b3b-0e6c-44a9-9f9e-c7c9031703ad tempest-CreateVolumesFromSnapshotTest-1650134941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:55 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-d9de0b3b-0e6c-44a9-9f9e-c7c9031703ad tempest-CreateVolumesFromSnapshotTest-1650134941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:31:55 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-d9de0b3b-0e6c-44a9-9f9e-c7c9031703ad tempest-CreateVolumesFromSnapshotTest-1650134941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:31:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-d9de0b3b-0e6c-44a9-9f9e-c7c9031703ad tempest-CreateVolumesFromSnapshotTest-1650134941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d9de0b3b-0e6c-44a9-9f9e-c7c9031703ad tempest-CreateVolumesFromSnapshotTest-1650134941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:55 devstack sudo[91002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:31:55 devstack sudo[91002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:55 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b2fa04a4-c553-4301-8c47-90c3cf60d6c7 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c8832989-9424-4746-9d3e-7b7ea24c096c {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:55 devstack sudo[91004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c8832989-9424-4746-9d3e-7b7ea24c096c
Feb 27 01:31:55 devstack sudo[91004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:56 devstack sudo[91002]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d9de0b3b-0e6c-44a9-9f9e-c7c9031703ad tempest-CreateVolumesFromSnapshotTest-1650134941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.410s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:56 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-d9de0b3b-0e6c-44a9-9f9e-c7c9031703ad tempest-CreateVolumesFromSnapshotTest-1650134941 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:31:56 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-d9de0b3b-0e6c-44a9-9f9e-c7c9031703ad tempest-CreateVolumesFromSnapshotTest-1650134941 None] Deleted volume successfully.
Feb 27 01:31:56 devstack sudo[91004]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b2fa04a4-c553-4301-8c47-90c3cf60d6c7 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c8832989-9424-4746-9d3e-7b7ea24c096c" returned: 0 in 0.397s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:56 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-b2fa04a4-c553-4301-8c47-90c3cf60d6c7 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:31:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-b2fa04a4-c553-4301-8c47-90c3cf60d6c7 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-bf55ff6f-fce7-4dca-a054-0115e66a0cbe tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.457s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:56 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-bf55ff6f-fce7-4dca-a054-0115e66a0cbe tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:31:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-918138071',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f3bbf25-0f9b-4025-b2c1-7b6e220145a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0ef4aee4972409c886107e52dd842a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:31:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:31:53Z,use_quota=True,user_id='0c6c9b06e2a940108c8e5dc157cdb4eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:31:56 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-bf55ff6f-fce7-4dca-a054-0115e66a0cbe tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Creating volume 1f3bbf25-0f9b-4025-b2c1-7b6e220145a5 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:31:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-bf55ff6f-fce7-4dca-a054-0115e66a0cbe tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-bf55ff6f-fce7-4dca-a054-0115e66a0cbe tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:56 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-bf55ff6f-fce7-4dca-a054-0115e66a0cbe tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:31:56 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-bf55ff6f-fce7-4dca-a054-0115e66a0cbe tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:31:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-bf55ff6f-fce7-4dca-a054-0115e66a0cbe tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:56 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-bf55ff6f-fce7-4dca-a054-0115e66a0cbe tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:31:56 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-bf55ff6f-fce7-4dca-a054-0115e66a0cbe tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:31:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-bf55ff6f-fce7-4dca-a054-0115e66a0cbe tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-1f3bbf25-0f9b-4025-b2c1-7b6e220145a5 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:56 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-b2fa04a4-c553-4301-8c47-90c3cf60d6c7 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a91e712-ad24-4a7d-93ac-c16809306beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8832989-9424-4746-9d3e-7b7ea24c096c', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:56 devstack sudo[91008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-1f3bbf25-0f9b-4025-b2c1-7b6e220145a5 1073741824
Feb 27 01:31:56 devstack sudo[91008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:56 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-b2fa04a4-c553-4301-8c47-90c3cf60d6c7 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93da3cb0-689b-44fa-8c82-cef174c3f076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:56 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-d9de0b3b-0e6c-44a9-9f9e-c7c9031703ad tempest-CreateVolumesFromSnapshotTest-1650134941 None] Lock "cinder-c9b3bb4c-7235-406f-9359-225fd1a282d1-delete_volume" released by "delete_volume" :: held 1.802s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:31:56 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-b2fa04a4-c553-4301-8c47-90c3cf60d6c7 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Volume volume-c8832989-9424-4746-9d3e-7b7ea24c096c (c8832989-9424-4746-9d3e-7b7ea24c096c): created successfully
Feb 27 01:31:56 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-b2fa04a4-c553-4301-8c47-90c3cf60d6c7 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93da3cb0-689b-44fa-8c82-cef174c3f076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:56 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-b2fa04a4-c553-4301-8c47-90c3cf60d6c7 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Flow 'volume_create_manager' (cd216a97-ede3-45a6-94dd-a651f1c7e88b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:31:56 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-b2fa04a4-c553-4301-8c47-90c3cf60d6c7 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Created volume successfully.
Feb 27 01:31:56 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-d1a6cd14-4759-4607-b9f7-2c514ebb0325 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Acquiring lock "cinder-73ab7430-84e2-400c-adc7-ea3648c62814-delete_snapshot" by "delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:31:56 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-d1a6cd14-4759-4607-b9f7-2c514ebb0325 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Lock "cinder-73ab7430-84e2-400c-adc7-ea3648c62814-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:31:56 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-d1a6cd14-4759-4607-b9f7-2c514ebb0325 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Acquiring lock "cinder-quobyte-5815fcc3-2905-43da-8853-be45cfc92d87" by "delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:31:56 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-d1a6cd14-4759-4607-b9f7-2c514ebb0325 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Lock "cinder-quobyte-5815fcc3-2905-43da-8853-be45cfc92d87" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:31:56 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-d1a6cd14-4759-4607-b9f7-2c514ebb0325 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Acquiring lock "cinder-quobyte-73ab7430-84e2-400c-adc7-ea3648c62814" by "_delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:31:56 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-d1a6cd14-4759-4607-b9f7-2c514ebb0325 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Lock "cinder-quobyte-73ab7430-84e2-400c-adc7-ea3648c62814" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:31:56 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-d1a6cd14-4759-4607-b9f7-2c514ebb0325 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Deleting offline snapshot 73ab7430-84e2-400c-adc7-ea3648c62814 of volume 5815fcc3-2905-43da-8853-be45cfc92d87 {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:31:56 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-d1a6cd14-4759-4607-b9f7-2c514ebb0325 tempest-CreateVolumesFromSnapshotTest-1650134941 None] snapshot_file for this snap is: volume-5815fcc3-2905-43da-8853-be45cfc92d87.73ab7430-84e2-400c-adc7-ea3648c62814 {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:31:56 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[fddfcbaf-5c6f-4289-8d10-e49f1adfdaf7]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:31:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d1a6cd14-4759-4607-b9f7-2c514ebb0325 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5815fcc3-2905-43da-8853-be45cfc92d87.73ab7430-84e2-400c-adc7-ea3648c62814 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:56 devstack sudo[91013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5815fcc3-2905-43da-8853-be45cfc92d87.73ab7430-84e2-400c-adc7-ea3648c62814
Feb 27 01:31:56 devstack sudo[91013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:56 devstack sudo[91008]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-bf55ff6f-fce7-4dca-a054-0115e66a0cbe tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-1f3bbf25-0f9b-4025-b2c1-7b6e220145a5 1073741824" returned: 0 in 0.556s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-bf55ff6f-fce7-4dca-a054-0115e66a0cbe tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-1f3bbf25-0f9b-4025-b2c1-7b6e220145a5 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:56 devstack sudo[91015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-1f3bbf25-0f9b-4025-b2c1-7b6e220145a5
Feb 27 01:31:56 devstack sudo[91015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:56 devstack cinder-volume[83106]: DEBUG oslo_service.periodic_task [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83106) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Feb 27 01:31:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:56 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:31:56 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:31:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:56 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:56 devstack sudo[91017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:31:56 devstack sudo[91017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:57 devstack sudo[91013]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d1a6cd14-4759-4607-b9f7-2c514ebb0325 tempest-CreateVolumesFromSnapshotTest-1650134941 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5815fcc3-2905-43da-8853-be45cfc92d87.73ab7430-84e2-400c-adc7-ea3648c62814" returned: 0 in 0.497s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:57 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-d1a6cd14-4759-4607-b9f7-2c514ebb0325 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5815fcc3-2905-43da-8853-be45cfc92d87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83106) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:31:57 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[d39f0db2-62a9-4f28-bfec-bd9a05d51983]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:31:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d1a6cd14-4759-4607-b9f7-2c514ebb0325 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5815fcc3-2905-43da-8853-be45cfc92d87 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:57 devstack sudo[91015]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-bf55ff6f-fce7-4dca-a054-0115e66a0cbe tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-1f3bbf25-0f9b-4025-b2c1-7b6e220145a5" returned: 0 in 0.444s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:57 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-bf55ff6f-fce7-4dca-a054-0115e66a0cbe tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:31:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-bf55ff6f-fce7-4dca-a054-0115e66a0cbe tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-95da6b78-6b7e-4c24-afae-b22bf3405d0e tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.260s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:57 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-95da6b78-6b7e-4c24-afae-b22bf3405d0e tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:31:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1657004802',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dfd305d-2ba1-4906-83d9-9cc4f1de18ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0ef4aee4972409c886107e52dd842a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:31:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:31:53Z,use_quota=True,user_id='0c6c9b06e2a940108c8e5dc157cdb4eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:31:57 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-95da6b78-6b7e-4c24-afae-b22bf3405d0e tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Creating volume 7dfd305d-2ba1-4906-83d9-9cc4f1de18ce {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:31:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-95da6b78-6b7e-4c24-afae-b22bf3405d0e tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-95da6b78-6b7e-4c24-afae-b22bf3405d0e tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:57 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-95da6b78-6b7e-4c24-afae-b22bf3405d0e tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:31:57 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-95da6b78-6b7e-4c24-afae-b22bf3405d0e tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:31:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-95da6b78-6b7e-4c24-afae-b22bf3405d0e tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:57 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-95da6b78-6b7e-4c24-afae-b22bf3405d0e tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:31:57 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-95da6b78-6b7e-4c24-afae-b22bf3405d0e tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:31:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-95da6b78-6b7e-4c24-afae-b22bf3405d0e tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-7dfd305d-2ba1-4906-83d9-9cc4f1de18ce 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:57 devstack sudo[91023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5815fcc3-2905-43da-8853-be45cfc92d87
Feb 27 01:31:57 devstack sudo[91023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:57 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-bf55ff6f-fce7-4dca-a054-0115e66a0cbe tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24bd121b-75ad-4095-8c2b-3d538f6effc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f3bbf25-0f9b-4025-b2c1-7b6e220145a5', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:57 devstack sudo[91017]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:57 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-bf55ff6f-fce7-4dca-a054-0115e66a0cbe tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5315a768-2937-4a4e-a692-6272d3dd38ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:57 devstack sudo[91025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-7dfd305d-2ba1-4906-83d9-9cc4f1de18ce 1073741824
Feb 27 01:31:57 devstack sudo[91025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.412s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:57 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-66201503-0e37-48fc-bd48-47e5597c6176 None None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:31:57 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-bf55ff6f-fce7-4dca-a054-0115e66a0cbe tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Volume volume-1f3bbf25-0f9b-4025-b2c1-7b6e220145a5 (1f3bbf25-0f9b-4025-b2c1-7b6e220145a5): created successfully
Feb 27 01:31:57 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-bf55ff6f-fce7-4dca-a054-0115e66a0cbe tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5315a768-2937-4a4e-a692-6272d3dd38ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:57 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-bf55ff6f-fce7-4dca-a054-0115e66a0cbe tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Flow 'volume_create_manager' (7d2a74d4-64c2-45c1-ae81-89f6320abccd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:31:57 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-bf55ff6f-fce7-4dca-a054-0115e66a0cbe tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Created volume successfully.
Feb 27 01:31:57 devstack sudo[91023]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d1a6cd14-4759-4607-b9f7-2c514ebb0325 tempest-CreateVolumesFromSnapshotTest-1650134941 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5815fcc3-2905-43da-8853-be45cfc92d87" returned: 0 in 0.579s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d1a6cd14-4759-4607-b9f7-2c514ebb0325 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5815fcc3-2905-43da-8853-be45cfc92d87.73ab7430-84e2-400c-adc7-ea3648c62814 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:57 devstack sudo[91034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5815fcc3-2905-43da-8853-be45cfc92d87.73ab7430-84e2-400c-adc7-ea3648c62814
Feb 27 01:31:57 devstack sudo[91034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:57 devstack sudo[91025]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-95da6b78-6b7e-4c24-afae-b22bf3405d0e tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-7dfd305d-2ba1-4906-83d9-9cc4f1de18ce 1073741824" returned: 0 in 0.612s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:57 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-95da6b78-6b7e-4c24-afae-b22bf3405d0e tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-7dfd305d-2ba1-4906-83d9-9cc4f1de18ce {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:57 devstack sudo[91036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-7dfd305d-2ba1-4906-83d9-9cc4f1de18ce
Feb 27 01:31:57 devstack sudo[91036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:58 devstack sudo[91034]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:58 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d1a6cd14-4759-4607-b9f7-2c514ebb0325 tempest-CreateVolumesFromSnapshotTest-1650134941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5815fcc3-2905-43da-8853-be45cfc92d87.73ab7430-84e2-400c-adc7-ea3648c62814" returned: 0 in 0.486s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:58 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d1a6cd14-4759-4607-b9f7-2c514ebb0325 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5815fcc3-2905-43da-8853-be45cfc92d87.73ab7430-84e2-400c-adc7-ea3648c62814 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:58 devstack sudo[91042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5815fcc3-2905-43da-8853-be45cfc92d87.73ab7430-84e2-400c-adc7-ea3648c62814
Feb 27 01:31:58 devstack sudo[91042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:58 devstack sudo[91036]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:58 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-95da6b78-6b7e-4c24-afae-b22bf3405d0e tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-7dfd305d-2ba1-4906-83d9-9cc4f1de18ce" returned: 0 in 0.456s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:58 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-95da6b78-6b7e-4c24-afae-b22bf3405d0e tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:31:58 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-95da6b78-6b7e-4c24-afae-b22bf3405d0e tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:58 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-b9c23cc6-0ad6-4891-aadf-ed5aba5a92fa tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.103s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:58 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-b9c23cc6-0ad6-4891-aadf-ed5aba5a92fa tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:31:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-13388392',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37453818-2ede-4906-b783-ec1f849833d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0ef4aee4972409c886107e52dd842a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:31:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:31:53Z,use_quota=True,user_id='0c6c9b06e2a940108c8e5dc157cdb4eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:31:58 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-b9c23cc6-0ad6-4891-aadf-ed5aba5a92fa tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Creating volume 37453818-2ede-4906-b783-ec1f849833d3 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:31:58 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-b9c23cc6-0ad6-4891-aadf-ed5aba5a92fa tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:58 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-b9c23cc6-0ad6-4891-aadf-ed5aba5a92fa tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:58 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-b9c23cc6-0ad6-4891-aadf-ed5aba5a92fa tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:31:58 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-b9c23cc6-0ad6-4891-aadf-ed5aba5a92fa tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:31:58 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-b9c23cc6-0ad6-4891-aadf-ed5aba5a92fa tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:58 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-b9c23cc6-0ad6-4891-aadf-ed5aba5a92fa tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:31:58 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-b9c23cc6-0ad6-4891-aadf-ed5aba5a92fa tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:31:58 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b9c23cc6-0ad6-4891-aadf-ed5aba5a92fa tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-37453818-2ede-4906-b783-ec1f849833d3 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:58 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-95da6b78-6b7e-4c24-afae-b22bf3405d0e tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba11008b-aa89-4c33-92f4-d826c27b21f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dfd305d-2ba1-4906-83d9-9cc4f1de18ce', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:58 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-95da6b78-6b7e-4c24-afae-b22bf3405d0e tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (699369e8-1556-4ed8-a406-0ee41510a6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:58 devstack sudo[91044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-37453818-2ede-4906-b783-ec1f849833d3 1073741824
Feb 27 01:31:58 devstack sudo[91044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:58 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-95da6b78-6b7e-4c24-afae-b22bf3405d0e tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Volume volume-7dfd305d-2ba1-4906-83d9-9cc4f1de18ce (7dfd305d-2ba1-4906-83d9-9cc4f1de18ce): created successfully
Feb 27 01:31:58 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-95da6b78-6b7e-4c24-afae-b22bf3405d0e tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (699369e8-1556-4ed8-a406-0ee41510a6a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:58 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-95da6b78-6b7e-4c24-afae-b22bf3405d0e tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Flow 'volume_create_manager' (e283234d-2b13-4d7c-8fbd-2780de1257b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:31:58 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-95da6b78-6b7e-4c24-afae-b22bf3405d0e tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Created volume successfully.
Feb 27 01:31:58 devstack sudo[91042]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:58 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d1a6cd14-4759-4607-b9f7-2c514ebb0325 tempest-CreateVolumesFromSnapshotTest-1650134941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5815fcc3-2905-43da-8853-be45cfc92d87.73ab7430-84e2-400c-adc7-ea3648c62814" returned: 0 in 0.535s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:58 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-d1a6cd14-4759-4607-b9f7-2c514ebb0325 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Lock "cinder-quobyte-73ab7430-84e2-400c-adc7-ea3648c62814" released by "_delete_snapshot" :: held 2.169s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:31:58 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-d1a6cd14-4759-4607-b9f7-2c514ebb0325 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Lock "cinder-quobyte-5815fcc3-2905-43da-8853-be45cfc92d87" released by "delete_snapshot" :: held 2.186s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:31:58 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-d1a6cd14-4759-4607-b9f7-2c514ebb0325 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Created reservations ['373b094c-242d-4823-b88e-11f8faeaffef', '32105b79-76fa-4176-963f-28586d0afed8', '455b5449-90f0-4d33-87f2-d38cd8f153da', '79432c92-0dc3-4d0b-980f-9aca1bfe437f'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:31:58 devstack cinder-volume[83106]: DEBUG dbcounter [-] [83106] Writing DB stats cinder:SELECT=139,cinder:UPDATE=180,cinder:INSERT=49,cinder:DELETE=22 {{(pid=83106) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 01:31:58 devstack cinder-volume[83106]: DEBUG dbcounter [-] [83106] Writing DB stats cinder:SELECT=137,cinder:INSERT=39,cinder:UPDATE=191,cinder:DELETE=15 {{(pid=83106) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 01:31:58 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-d1a6cd14-4759-4607-b9f7-2c514ebb0325 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Delete snapshot completed successfully.
Feb 27 01:31:58 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-d1a6cd14-4759-4607-b9f7-2c514ebb0325 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Lock "cinder-73ab7430-84e2-400c-adc7-ea3648c62814-delete_snapshot" released by "delete_snapshot" :: held 2.313s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:31:58 devstack sudo[91044]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:58 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b9c23cc6-0ad6-4891-aadf-ed5aba5a92fa tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-37453818-2ede-4906-b783-ec1f849833d3 1073741824" returned: 0 in 0.606s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:58 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b9c23cc6-0ad6-4891-aadf-ed5aba5a92fa tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-37453818-2ede-4906-b783-ec1f849833d3 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:59 devstack sudo[91050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-37453818-2ede-4906-b783-ec1f849833d3
Feb 27 01:31:59 devstack sudo[91050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:59 devstack sudo[91050]: pam_unix(sudo:session): session closed for user root
Feb 27 01:31:59 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b9c23cc6-0ad6-4891-aadf-ed5aba5a92fa tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-37453818-2ede-4906-b783-ec1f849833d3" returned: 0 in 0.548s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:31:59 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-b9c23cc6-0ad6-4891-aadf-ed5aba5a92fa tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] <== create_volume: return (1188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:31:59 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-b9c23cc6-0ad6-4891-aadf-ed5aba5a92fa tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.192s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:59 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-b298635b-e3e3-4d2e-bd43-aea724483c5e tempest-SnapshotDependencyTests-277758335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.920s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:59 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-b298635b-e3e3-4d2e-bd43-aea724483c5e tempest-SnapshotDependencyTests-277758335 None] Acquiring lock "cinder-quobyte-937a2045-a21a-4104-b2d9-eb09624e1f7b-d5601f33-acb7-4f3f-8767-1ecd3de37ae0" by "_create_volume_from_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:31:59 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-b9c23cc6-0ad6-4891-aadf-ed5aba5a92fa tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03f19e26-caf3-4658-ab28-4dd0ece5dce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37453818-2ede-4906-b783-ec1f849833d3', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:59 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-b9c23cc6-0ad6-4891-aadf-ed5aba5a92fa tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df87e441-c233-45e6-ab33-1b0f5b0439e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:31:59 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-b298635b-e3e3-4d2e-bd43-aea724483c5e tempest-SnapshotDependencyTests-277758335 None] Lock "cinder-quobyte-937a2045-a21a-4104-b2d9-eb09624e1f7b-d5601f33-acb7-4f3f-8767-1ecd3de37ae0" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:31:59 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-b298635b-e3e3-4d2e-bd43-aea724483c5e tempest-SnapshotDependencyTests-277758335 None] Creating volume d5601f33-acb7-4f3f-8767-1ecd3de37ae0 from snapshot 937a2045-a21a-4104-b2d9-eb09624e1f7b {{(pid=83106) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Feb 27 01:31:59 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-b298635b-e3e3-4d2e-bd43-aea724483c5e tempest-SnapshotDependencyTests-277758335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:59 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-b298635b-e3e3-4d2e-bd43-aea724483c5e tempest-SnapshotDependencyTests-277758335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:59 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-b298635b-e3e3-4d2e-bd43-aea724483c5e tempest-SnapshotDependencyTests-277758335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:31:59 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-b298635b-e3e3-4d2e-bd43-aea724483c5e tempest-SnapshotDependencyTests-277758335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:31:59 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-b298635b-e3e3-4d2e-bd43-aea724483c5e tempest-SnapshotDependencyTests-277758335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:59 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-b298635b-e3e3-4d2e-bd43-aea724483c5e tempest-SnapshotDependencyTests-277758335 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:31:59 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-b298635b-e3e3-4d2e-bd43-aea724483c5e tempest-SnapshotDependencyTests-277758335 None] Acquiring lock "cinder-quobyte-d5601f33-acb7-4f3f-8767-1ecd3de37ae0" by "_copy_volume_from_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:31:59 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-b9c23cc6-0ad6-4891-aadf-ed5aba5a92fa tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Volume volume-37453818-2ede-4906-b783-ec1f849833d3 (37453818-2ede-4906-b783-ec1f849833d3): created successfully
Feb 27 01:31:59 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-b9c23cc6-0ad6-4891-aadf-ed5aba5a92fa tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df87e441-c233-45e6-ab33-1b0f5b0439e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:31:59 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-b9c23cc6-0ad6-4891-aadf-ed5aba5a92fa tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Flow 'volume_create_manager' (a76154ad-9b63-4411-9ccf-b6b8c2a463bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:31:59 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-b298635b-e3e3-4d2e-bd43-aea724483c5e tempest-SnapshotDependencyTests-277758335 None] Lock "cinder-quobyte-d5601f33-acb7-4f3f-8767-1ecd3de37ae0" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:31:59 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-b298635b-e3e3-4d2e-bd43-aea724483c5e tempest-SnapshotDependencyTests-277758335 None] snapshot: 937a2045-a21a-4104-b2d9-eb09624e1f7b, volume: d5601f33-acb7-4f3f-8767-1ecd3de37ae0,  {{(pid=83106) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Feb 27 01:31:59 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-b9c23cc6-0ad6-4891-aadf-ed5aba5a92fa tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Created volume successfully.
Feb 27 01:31:59 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-b298635b-e3e3-4d2e-bd43-aea724483c5e tempest-SnapshotDependencyTests-277758335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:31:59 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-b298635b-e3e3-4d2e-bd43-aea724483c5e tempest-SnapshotDependencyTests-277758335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:31:59 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-b298635b-e3e3-4d2e-bd43-aea724483c5e tempest-SnapshotDependencyTests-277758335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:31:59 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-b298635b-e3e3-4d2e-bd43-aea724483c5e tempest-SnapshotDependencyTests-277758335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:31:59 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-b298635b-e3e3-4d2e-bd43-aea724483c5e tempest-SnapshotDependencyTests-277758335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:31:59 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc0c2c1-b4ed-4e17-abb4-26e7f1811465]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:31:59 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b298635b-e3e3-4d2e-bd43-aea724483c5e tempest-SnapshotDependencyTests-277758335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0170b02c-0d22-4644-98ef-dbbd753a8989.937a2045-a21a-4104-b2d9-eb09624e1f7b {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:59 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-58deb825-6ee4-4b2d-b773-7ecdc8624e6e tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Acquiring lock "cinder-37453818-2ede-4906-b783-ec1f849833d3-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:31:59 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-58deb825-6ee4-4b2d-b773-7ecdc8624e6e tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Lock "cinder-37453818-2ede-4906-b783-ec1f849833d3-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:31:59 devstack sudo[91053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0170b02c-0d22-4644-98ef-dbbd753a8989.937a2045-a21a-4104-b2d9-eb09624e1f7b
Feb 27 01:31:59 devstack sudo[91053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:59 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-58deb825-6ee4-4b2d-b773-7ecdc8624e6e tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Acquiring lock "cinder-quobyte-37453818-2ede-4906-b783-ec1f849833d3" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:31:59 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-58deb825-6ee4-4b2d-b773-7ecdc8624e6e tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Lock "cinder-quobyte-37453818-2ede-4906-b783-ec1f849833d3" acquired by "delete_volume" :: waited 0.012s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:31:59 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-2feb143d-dd69-448f-9e2d-2cd13c107d08 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Acquiring lock "cinder-5815fcc3-2905-43da-8853-be45cfc92d87-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:31:59 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f35be1-b63e-48d7-be7e-2949e9b4e580]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:31:59 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-58deb825-6ee4-4b2d-b773-7ecdc8624e6e tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-37453818-2ede-4906-b783-ec1f849833d3 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:59 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-2feb143d-dd69-448f-9e2d-2cd13c107d08 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Lock "cinder-5815fcc3-2905-43da-8853-be45cfc92d87-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:31:59 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-2feb143d-dd69-448f-9e2d-2cd13c107d08 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Acquiring lock "cinder-quobyte-5815fcc3-2905-43da-8853-be45cfc92d87" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:31:59 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-2feb143d-dd69-448f-9e2d-2cd13c107d08 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Lock "cinder-quobyte-5815fcc3-2905-43da-8853-be45cfc92d87" acquired by "delete_volume" :: waited 0.008s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:31:59 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[34635e3f-1121-4799-91fc-2b5194f6dae1]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:31:59 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-2feb143d-dd69-448f-9e2d-2cd13c107d08 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5815fcc3-2905-43da-8853-be45cfc92d87 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:31:59 devstack sudo[91055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-37453818-2ede-4906-b783-ec1f849833d3
Feb 27 01:31:59 devstack sudo[91055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:31:59 devstack sudo[91056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5815fcc3-2905-43da-8853-be45cfc92d87
Feb 27 01:31:59 devstack sudo[91056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:00 devstack sudo[91053]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:00 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b298635b-e3e3-4d2e-bd43-aea724483c5e tempest-SnapshotDependencyTests-277758335 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0170b02c-0d22-4644-98ef-dbbd753a8989.937a2045-a21a-4104-b2d9-eb09624e1f7b" returned: 0 in 0.537s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:00 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-b298635b-e3e3-4d2e-bd43-aea724483c5e tempest-SnapshotDependencyTests-277758335 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0170b02c-0d22-4644-98ef-dbbd753a8989(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83106) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:32:00 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-b298635b-e3e3-4d2e-bd43-aea724483c5e tempest-SnapshotDependencyTests-277758335 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0170b02c-0d22-4644-98ef-dbbd753a8989 {{(pid=83106) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Feb 27 01:32:00 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-b298635b-e3e3-4d2e-bd43-aea724483c5e tempest-SnapshotDependencyTests-277758335 None] Creating direct copy from snapshot {{(pid=83106) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Feb 27 01:32:00 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[7576ccbc-6541-400a-a8fc-3a5bd9683031]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:32:00 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b298635b-e3e3-4d2e-bd43-aea724483c5e tempest-SnapshotDependencyTests-277758335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0170b02c-0d22-4644-98ef-dbbd753a8989 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:00 devstack sudo[91062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0170b02c-0d22-4644-98ef-dbbd753a8989
Feb 27 01:32:00 devstack sudo[91062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:00 devstack sudo[91055]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:00 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-58deb825-6ee4-4b2d-b773-7ecdc8624e6e tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-37453818-2ede-4906-b783-ec1f849833d3" returned: 0 in 0.537s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:00 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-58deb825-6ee4-4b2d-b773-7ecdc8624e6e tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-37453818-2ede-4906-b783-ec1f849833d3 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:00 devstack sudo[91067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-37453818-2ede-4906-b783-ec1f849833d3
Feb 27 01:32:00 devstack sudo[91067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:00 devstack sudo[91056]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:00 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-2feb143d-dd69-448f-9e2d-2cd13c107d08 tempest-CreateVolumesFromSnapshotTest-1650134941 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5815fcc3-2905-43da-8853-be45cfc92d87" returned: 0 in 0.555s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:00 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-2feb143d-dd69-448f-9e2d-2cd13c107d08 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5815fcc3-2905-43da-8853-be45cfc92d87 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:00 devstack sudo[91072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5815fcc3-2905-43da-8853-be45cfc92d87
Feb 27 01:32:00 devstack sudo[91072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:00 devstack sudo[91067]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:00 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-58deb825-6ee4-4b2d-b773-7ecdc8624e6e tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-37453818-2ede-4906-b783-ec1f849833d3" returned: 0 in 0.411s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:00 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-58deb825-6ee4-4b2d-b773-7ecdc8624e6e tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Lock "cinder-quobyte-37453818-2ede-4906-b783-ec1f849833d3" released by "delete_volume" :: held 0.984s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:32:00 devstack sudo[91062]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:00 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b298635b-e3e3-4d2e-bd43-aea724483c5e tempest-SnapshotDependencyTests-277758335 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0170b02c-0d22-4644-98ef-dbbd753a8989" returned: 0 in 0.572s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:00 devstack cinder-volume[83106]: DEBUG cinder.utils [None req-b298635b-e3e3-4d2e-bd43-aea724483c5e tempest-SnapshotDependencyTests-277758335 None] Path /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-d5601f33-acb7-4f3f-8767-1ecd3de37ae0 not found in is_blk_device check {{(pid=83106) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Feb 27 01:32:00 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b298635b-e3e3-4d2e-bd43-aea724483c5e tempest-SnapshotDependencyTests-277758335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0170b02c-0d22-4644-98ef-dbbd753a8989 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-d5601f33-acb7-4f3f-8767-1ecd3de37ae0 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:00 devstack sudo[91084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0170b02c-0d22-4644-98ef-dbbd753a8989 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-d5601f33-acb7-4f3f-8767-1ecd3de37ae0
Feb 27 01:32:00 devstack sudo[91084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:00 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-58deb825-6ee4-4b2d-b773-7ecdc8624e6e tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Created reservations ['756dfd49-4249-4210-8186-4232c30f0674', '55dfc1af-1b35-4b23-9320-01ec01af20ef', '632efb41-47da-41a7-9728-d7ad8ed9aae0', '15b7e14a-ef63-49ce-a698-beed46602458'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:32:00 devstack sudo[91072]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:00 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-2feb143d-dd69-448f-9e2d-2cd13c107d08 tempest-CreateVolumesFromSnapshotTest-1650134941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-5815fcc3-2905-43da-8853-be45cfc92d87" returned: 0 in 0.439s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:00 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-2feb143d-dd69-448f-9e2d-2cd13c107d08 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Lock "cinder-quobyte-5815fcc3-2905-43da-8853-be45cfc92d87" released by "delete_volume" :: held 1.027s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:32:00 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-58deb825-6ee4-4b2d-b773-7ecdc8624e6e tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:32:00 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-58deb825-6ee4-4b2d-b773-7ecdc8624e6e tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:32:00 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-58deb825-6ee4-4b2d-b773-7ecdc8624e6e tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:32:00 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-58deb825-6ee4-4b2d-b773-7ecdc8624e6e tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:32:00 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-58deb825-6ee4-4b2d-b773-7ecdc8624e6e tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:32:00 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-58deb825-6ee4-4b2d-b773-7ecdc8624e6e tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:00 devstack sudo[91087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:32:00 devstack sudo[91087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:00 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-2feb143d-dd69-448f-9e2d-2cd13c107d08 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Created reservations ['5fb042f4-5f88-4500-bd61-27e6a86e08ac', 'd5454025-04e9-49b8-a263-a032b1430c2d', 'e3c68d59-fcfc-4131-8f9d-cb0986d43ab2', '666fedec-0d54-4b56-872f-666688447727'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:32:01 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-2feb143d-dd69-448f-9e2d-2cd13c107d08 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:32:01 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-2feb143d-dd69-448f-9e2d-2cd13c107d08 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:32:01 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-2feb143d-dd69-448f-9e2d-2cd13c107d08 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:32:01 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-2feb143d-dd69-448f-9e2d-2cd13c107d08 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:32:01 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-2feb143d-dd69-448f-9e2d-2cd13c107d08 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:32:01 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-2feb143d-dd69-448f-9e2d-2cd13c107d08 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:01 devstack sudo[91089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:32:01 devstack sudo[91089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:02 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-baf0c424-36bf-4d4c-bed4-669d36d605b1 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Acquiring lock "cinder-7dfd305d-2ba1-4906-83d9-9cc4f1de18ce-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:32:02 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-baf0c424-36bf-4d4c-bed4-669d36d605b1 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Lock "cinder-7dfd305d-2ba1-4906-83d9-9cc4f1de18ce-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:32:02 devstack sudo[91087]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:02 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-58deb825-6ee4-4b2d-b773-7ecdc8624e6e tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 1.380s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:02 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-58deb825-6ee4-4b2d-b773-7ecdc8624e6e tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:32:02 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-baf0c424-36bf-4d4c-bed4-669d36d605b1 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Acquiring lock "cinder-quobyte-7dfd305d-2ba1-4906-83d9-9cc4f1de18ce" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:32:02 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-58deb825-6ee4-4b2d-b773-7ecdc8624e6e tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Deleted volume successfully.
Feb 27 01:32:02 devstack sudo[91089]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:02 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-baf0c424-36bf-4d4c-bed4-669d36d605b1 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Lock "cinder-quobyte-7dfd305d-2ba1-4906-83d9-9cc4f1de18ce" acquired by "delete_volume" :: waited 0.046s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:32:02 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d61bc0-4461-46d3-94d6-a070df890f2c]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:32:02 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-baf0c424-36bf-4d4c-bed4-669d36d605b1 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-7dfd305d-2ba1-4906-83d9-9cc4f1de18ce {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:02 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-2feb143d-dd69-448f-9e2d-2cd13c107d08 tempest-CreateVolumesFromSnapshotTest-1650134941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 1.438s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:02 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-2feb143d-dd69-448f-9e2d-2cd13c107d08 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:32:02 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-58deb825-6ee4-4b2d-b773-7ecdc8624e6e tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Lock "cinder-37453818-2ede-4906-b783-ec1f849833d3-delete_volume" released by "delete_volume" :: held 2.748s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:32:02 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-2feb143d-dd69-448f-9e2d-2cd13c107d08 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Deleted volume successfully.
Feb 27 01:32:02 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-2feb143d-dd69-448f-9e2d-2cd13c107d08 tempest-CreateVolumesFromSnapshotTest-1650134941 None] Lock "cinder-5815fcc3-2905-43da-8853-be45cfc92d87-delete_volume" released by "delete_volume" :: held 2.695s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:32:02 devstack sudo[91137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-7dfd305d-2ba1-4906-83d9-9cc4f1de18ce
Feb 27 01:32:02 devstack sudo[91137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:03 devstack sudo[91084]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:03 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b298635b-e3e3-4d2e-bd43-aea724483c5e tempest-SnapshotDependencyTests-277758335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0170b02c-0d22-4644-98ef-dbbd753a8989 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-d5601f33-acb7-4f3f-8767-1ecd3de37ae0" returned: 0 in 2.633s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:03 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf0c902-7f38-4bbf-94bc-97e488c9a79a]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:32:03 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b298635b-e3e3-4d2e-bd43-aea724483c5e tempest-SnapshotDependencyTests-277758335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0170b02c-0d22-4644-98ef-dbbd753a8989 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:03 devstack sudo[91137]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:03 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-baf0c424-36bf-4d4c-bed4-669d36d605b1 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-7dfd305d-2ba1-4906-83d9-9cc4f1de18ce" returned: 0 in 1.075s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:03 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-baf0c424-36bf-4d4c-bed4-669d36d605b1 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-7dfd305d-2ba1-4906-83d9-9cc4f1de18ce {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:03 devstack sudo[91143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0170b02c-0d22-4644-98ef-dbbd753a8989
Feb 27 01:32:03 devstack sudo[91143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:03 devstack sudo[91145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-7dfd305d-2ba1-4906-83d9-9cc4f1de18ce
Feb 27 01:32:03 devstack sudo[91145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:04 devstack sudo[91145]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:04 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-baf0c424-36bf-4d4c-bed4-669d36d605b1 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-7dfd305d-2ba1-4906-83d9-9cc4f1de18ce" returned: 0 in 0.611s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:04 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-baf0c424-36bf-4d4c-bed4-669d36d605b1 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Lock "cinder-quobyte-7dfd305d-2ba1-4906-83d9-9cc4f1de18ce" released by "delete_volume" :: held 1.741s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:32:04 devstack sudo[91143]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:04 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b298635b-e3e3-4d2e-bd43-aea724483c5e tempest-SnapshotDependencyTests-277758335 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0170b02c-0d22-4644-98ef-dbbd753a8989" returned: 0 in 0.741s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:04 devstack cinder-volume[83106]: DEBUG cinder.image.image_utils [None req-b298635b-e3e3-4d2e-bd43-aea724483c5e tempest-SnapshotDependencyTests-277758335 None] Image conversion details: src /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0170b02c-0d22-4644-98ef-dbbd753a8989, size 1024.00 MB, duration 2.63 sec, destination /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-d5601f33-acb7-4f3f-8767-1ecd3de37ae0 {{(pid=83106) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 27 01:32:04 devstack cinder-volume[83106]: INFO cinder.image.image_utils [None req-b298635b-e3e3-4d2e-bd43-aea724483c5e tempest-SnapshotDependencyTests-277758335 None] Converted 1024.00 MB image at 388.85 MB/s
Feb 27 01:32:04 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-b298635b-e3e3-4d2e-bd43-aea724483c5e tempest-SnapshotDependencyTests-277758335 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-d5601f33-acb7-4f3f-8767-1ecd3de37ae0 is being set with open permissions: ugo+rw
Feb 27 01:32:04 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b298635b-e3e3-4d2e-bd43-aea724483c5e tempest-SnapshotDependencyTests-277758335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-d5601f33-acb7-4f3f-8767-1ecd3de37ae0 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:04 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-baf0c424-36bf-4d4c-bed4-669d36d605b1 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Created reservations ['56b23ec4-9d94-422d-a0ec-60d144bc5378', '79ab4ac0-6cde-486f-b567-883354ca4371', '7c474b96-d4c7-4fb4-be83-25ea296a3edb', 'a9f98c94-8a5f-4b24-a2bc-5ef09160a208'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:32:04 devstack sudo[91152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-d5601f33-acb7-4f3f-8767-1ecd3de37ae0
Feb 27 01:32:04 devstack sudo[91152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:04 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-baf0c424-36bf-4d4c-bed4-669d36d605b1 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:32:04 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-baf0c424-36bf-4d4c-bed4-669d36d605b1 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:32:04 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-baf0c424-36bf-4d4c-bed4-669d36d605b1 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:32:04 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-baf0c424-36bf-4d4c-bed4-669d36d605b1 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:32:04 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-baf0c424-36bf-4d4c-bed4-669d36d605b1 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:32:04 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-baf0c424-36bf-4d4c-bed4-669d36d605b1 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:04 devstack sudo[91154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:32:04 devstack sudo[91154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:04 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-bb3e60f8-aeae-4bbe-930c-b6eef9f8ece9 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Acquiring lock "cinder-1f3bbf25-0f9b-4025-b2c1-7b6e220145a5-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:32:04 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-bb3e60f8-aeae-4bbe-930c-b6eef9f8ece9 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Lock "cinder-1f3bbf25-0f9b-4025-b2c1-7b6e220145a5-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:32:04 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-bb3e60f8-aeae-4bbe-930c-b6eef9f8ece9 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Acquiring lock "cinder-quobyte-1f3bbf25-0f9b-4025-b2c1-7b6e220145a5" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:32:04 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-bb3e60f8-aeae-4bbe-930c-b6eef9f8ece9 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Lock "cinder-quobyte-1f3bbf25-0f9b-4025-b2c1-7b6e220145a5" acquired by "delete_volume" :: waited 0.009s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:32:04 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[01fc0233-abd0-4fe5-9270-f01469e10be0]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:32:04 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-bb3e60f8-aeae-4bbe-930c-b6eef9f8ece9 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-1f3bbf25-0f9b-4025-b2c1-7b6e220145a5 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:04 devstack sudo[91157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-1f3bbf25-0f9b-4025-b2c1-7b6e220145a5
Feb 27 01:32:04 devstack sudo[91157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:04 devstack sudo[91152]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:04 devstack sudo[91154]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:04 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-b298635b-e3e3-4d2e-bd43-aea724483c5e tempest-SnapshotDependencyTests-277758335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-d5601f33-acb7-4f3f-8767-1ecd3de37ae0" returned: 0 in 0.555s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:04 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-baf0c424-36bf-4d4c-bed4-669d36d605b1 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.470s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:04 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-baf0c424-36bf-4d4c-bed4-669d36d605b1 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:32:04 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-b298635b-e3e3-4d2e-bd43-aea724483c5e tempest-SnapshotDependencyTests-277758335 None] Lock "cinder-quobyte-d5601f33-acb7-4f3f-8767-1ecd3de37ae0" released by "_copy_volume_from_snapshot" :: held 5.129s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:32:04 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-baf0c424-36bf-4d4c-bed4-669d36d605b1 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Deleted volume successfully.
Feb 27 01:32:04 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-b298635b-e3e3-4d2e-bd43-aea724483c5e tempest-SnapshotDependencyTests-277758335 None] Lock "cinder-quobyte-937a2045-a21a-4104-b2d9-eb09624e1f7b-d5601f33-acb7-4f3f-8767-1ecd3de37ae0" released by "_create_volume_from_snapshot" :: held 5.181s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:32:04 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-b298635b-e3e3-4d2e-bd43-aea724483c5e tempest-SnapshotDependencyTests-277758335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.218s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:32:04 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-0a313f99-0660-4f29-9ea0-a530fec3ef1c tempest-VolumeDependencyTests-1629780687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.032s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:32:04 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-0a313f99-0660-4f29-9ea0-a530fec3ef1c tempest-VolumeDependencyTests-1629780687 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:31:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-77463479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ade9918f-1f8a-4b6e-b3aa-fef154760cfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae46202a7c8e473eb29eb42c73fcbd9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:31:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:31:56Z,use_quota=True,user_id='b3008ba5718f4609b1c16d3b5395869c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:32:04 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-0a313f99-0660-4f29-9ea0-a530fec3ef1c tempest-VolumeDependencyTests-1629780687 None] Creating volume ade9918f-1f8a-4b6e-b3aa-fef154760cfd {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:32:04 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-0a313f99-0660-4f29-9ea0-a530fec3ef1c tempest-VolumeDependencyTests-1629780687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:32:04 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-0a313f99-0660-4f29-9ea0-a530fec3ef1c tempest-VolumeDependencyTests-1629780687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:32:04 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-0a313f99-0660-4f29-9ea0-a530fec3ef1c tempest-VolumeDependencyTests-1629780687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:32:04 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-0a313f99-0660-4f29-9ea0-a530fec3ef1c tempest-VolumeDependencyTests-1629780687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:32:04 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-0a313f99-0660-4f29-9ea0-a530fec3ef1c tempest-VolumeDependencyTests-1629780687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:32:04 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-0a313f99-0660-4f29-9ea0-a530fec3ef1c tempest-VolumeDependencyTests-1629780687 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:32:04 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-0a313f99-0660-4f29-9ea0-a530fec3ef1c tempest-VolumeDependencyTests-1629780687 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:32:04 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0a313f99-0660-4f29-9ea0-a530fec3ef1c tempest-VolumeDependencyTests-1629780687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ade9918f-1f8a-4b6e-b3aa-fef154760cfd 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:04 devstack sudo[91160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ade9918f-1f8a-4b6e-b3aa-fef154760cfd 1073741824
Feb 27 01:32:04 devstack sudo[91160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:04 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-baf0c424-36bf-4d4c-bed4-669d36d605b1 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Lock "cinder-7dfd305d-2ba1-4906-83d9-9cc4f1de18ce-delete_volume" released by "delete_volume" :: held 2.651s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:32:04 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-b298635b-e3e3-4d2e-bd43-aea724483c5e tempest-SnapshotDependencyTests-277758335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f5bbc4f-35d0-4de7-bdd9-7785311943a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5601f33-acb7-4f3f-8767-1ecd3de37ae0', 'volume_size': 1, 'snapshot_id': '937a2045-a21a-4104-b2d9-eb09624e1f7b'}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:32:04 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-b298635b-e3e3-4d2e-bd43-aea724483c5e tempest-SnapshotDependencyTests-277758335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de54431e-cbdf-4648-8fff-63be235d44ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:32:04 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-b298635b-e3e3-4d2e-bd43-aea724483c5e tempest-SnapshotDependencyTests-277758335 None] Volume volume-d5601f33-acb7-4f3f-8767-1ecd3de37ae0 (d5601f33-acb7-4f3f-8767-1ecd3de37ae0): created successfully
Feb 27 01:32:04 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-b298635b-e3e3-4d2e-bd43-aea724483c5e tempest-SnapshotDependencyTests-277758335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de54431e-cbdf-4648-8fff-63be235d44ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:32:04 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-b298635b-e3e3-4d2e-bd43-aea724483c5e tempest-SnapshotDependencyTests-277758335 None] Flow 'volume_create_manager' (2df21e07-5766-4460-93c7-88d8e515eba2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:32:04 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-b298635b-e3e3-4d2e-bd43-aea724483c5e tempest-SnapshotDependencyTests-277758335 None] Created volume successfully.
Feb 27 01:32:05 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cc76cd7-5435-4a23-b72f-15f7b5c99fcd tempest-CinderUnicodeTest-1662562026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:32:05 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-0cc76cd7-5435-4a23-b72f-15f7b5c99fcd tempest-CinderUnicodeTest-1662562026 None] Flow 'volume_create_manager' (27b76513-8118-400b-90df-3cb6e4b0c5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:32:05 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-0cc76cd7-5435-4a23-b72f-15f7b5c99fcd tempest-CinderUnicodeTest-1662562026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c245babf-2bf5-4609-89b9-22bea0bbb037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:32:05 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-0cc76cd7-5435-4a23-b72f-15f7b5c99fcd tempest-CinderUnicodeTest-1662562026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c245babf-2bf5-4609-89b9-22bea0bbb037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:32:05Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0af0dc4-e417-48b1-8ead-0a8da0063eec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='087bf5dc6c9a424f8fb1a44da4605edb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:32:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:32:05Z,use_quota=True,user_id='d807bcde196d4c9f94c7e8e291c06f3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:32:05 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-0cc76cd7-5435-4a23-b72f-15f7b5c99fcd tempest-CinderUnicodeTest-1662562026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d63b2915-e06c-4824-afad-1ff3fe6532b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:32:05 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-0cc76cd7-5435-4a23-b72f-15f7b5c99fcd tempest-CinderUnicodeTest-1662562026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d63b2915-e06c-4824-afad-1ff3fe6532b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:32:05 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-0cc76cd7-5435-4a23-b72f-15f7b5c99fcd tempest-CinderUnicodeTest-1662562026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d920ddae-09a4-45c8-aa94-6939b34d507b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:32:05 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-0cc76cd7-5435-4a23-b72f-15f7b5c99fcd tempest-CinderUnicodeTest-1662562026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d920ddae-09a4-45c8-aa94-6939b34d507b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0af0dc4-e417-48b1-8ead-0a8da0063eec', 'volume_name': 'volume-b0af0dc4-e417-48b1-8ead-0a8da0063eec', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:32:05 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-0cc76cd7-5435-4a23-b72f-15f7b5c99fcd tempest-CinderUnicodeTest-1662562026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc3ef67d-d2d0-4c20-b54b-189fc04dcffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:32:05 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-0cc76cd7-5435-4a23-b72f-15f7b5c99fcd tempest-CinderUnicodeTest-1662562026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc3ef67d-d2d0-4c20-b54b-189fc04dcffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:32:05 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-0cc76cd7-5435-4a23-b72f-15f7b5c99fcd tempest-CinderUnicodeTest-1662562026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b31723d-49af-4865-abd1-4dfe3e0184fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:32:05 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-0cc76cd7-5435-4a23-b72f-15f7b5c99fcd tempest-CinderUnicodeTest-1662562026 None] Volume b0af0dc4-e417-48b1-8ead-0a8da0063eec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0af0dc4-e417-48b1-8ead-0a8da0063eec', 'volume_size': 1}
Feb 27 01:32:05 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-0cc76cd7-5435-4a23-b72f-15f7b5c99fcd tempest-CinderUnicodeTest-1662562026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:32:05 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-9ef9b705-8eec-402f-bde9-2a7397436e41 tempest-SnapshotDependencyTests-277758335 None] Acquiring lock "cinder-937a2045-a21a-4104-b2d9-eb09624e1f7b-delete_snapshot" by "delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:32:05 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-9ef9b705-8eec-402f-bde9-2a7397436e41 tempest-SnapshotDependencyTests-277758335 None] Lock "cinder-937a2045-a21a-4104-b2d9-eb09624e1f7b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:32:05 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-9ef9b705-8eec-402f-bde9-2a7397436e41 tempest-SnapshotDependencyTests-277758335 None] Acquiring lock "cinder-quobyte-0170b02c-0d22-4644-98ef-dbbd753a8989" by "delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:32:05 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-9ef9b705-8eec-402f-bde9-2a7397436e41 tempest-SnapshotDependencyTests-277758335 None] Lock "cinder-quobyte-0170b02c-0d22-4644-98ef-dbbd753a8989" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:32:05 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-9ef9b705-8eec-402f-bde9-2a7397436e41 tempest-SnapshotDependencyTests-277758335 None] Acquiring lock "cinder-quobyte-937a2045-a21a-4104-b2d9-eb09624e1f7b" by "_delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:32:05 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-9ef9b705-8eec-402f-bde9-2a7397436e41 tempest-SnapshotDependencyTests-277758335 None] Lock "cinder-quobyte-937a2045-a21a-4104-b2d9-eb09624e1f7b" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:32:05 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-9ef9b705-8eec-402f-bde9-2a7397436e41 tempest-SnapshotDependencyTests-277758335 None] Deleting offline snapshot 937a2045-a21a-4104-b2d9-eb09624e1f7b of volume 0170b02c-0d22-4644-98ef-dbbd753a8989 {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:32:05 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-9ef9b705-8eec-402f-bde9-2a7397436e41 tempest-SnapshotDependencyTests-277758335 None] snapshot_file for this snap is: volume-0170b02c-0d22-4644-98ef-dbbd753a8989.937a2045-a21a-4104-b2d9-eb09624e1f7b {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:32:05 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bced2b9-7c02-4735-91c0-da71dc6dd4a6]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:32:05 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9ef9b705-8eec-402f-bde9-2a7397436e41 tempest-SnapshotDependencyTests-277758335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0170b02c-0d22-4644-98ef-dbbd753a8989.937a2045-a21a-4104-b2d9-eb09624e1f7b {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:05 devstack sudo[91157]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:05 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-bb3e60f8-aeae-4bbe-930c-b6eef9f8ece9 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-1f3bbf25-0f9b-4025-b2c1-7b6e220145a5" returned: 0 in 0.656s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:05 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-bb3e60f8-aeae-4bbe-930c-b6eef9f8ece9 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-1f3bbf25-0f9b-4025-b2c1-7b6e220145a5 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:05 devstack sudo[91169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-1f3bbf25-0f9b-4025-b2c1-7b6e220145a5
Feb 27 01:32:05 devstack sudo[91169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:05 devstack sudo[91168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0170b02c-0d22-4644-98ef-dbbd753a8989.937a2045-a21a-4104-b2d9-eb09624e1f7b
Feb 27 01:32:05 devstack sudo[91168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:05 devstack sudo[91160]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:05 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0a313f99-0660-4f29-9ea0-a530fec3ef1c tempest-VolumeDependencyTests-1629780687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ade9918f-1f8a-4b6e-b3aa-fef154760cfd 1073741824" returned: 0 in 0.612s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:05 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0a313f99-0660-4f29-9ea0-a530fec3ef1c tempest-VolumeDependencyTests-1629780687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ade9918f-1f8a-4b6e-b3aa-fef154760cfd {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:05 devstack sudo[91172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ade9918f-1f8a-4b6e-b3aa-fef154760cfd
Feb 27 01:32:05 devstack sudo[91172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:05 devstack sudo[91169]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:05 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-bb3e60f8-aeae-4bbe-930c-b6eef9f8ece9 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-1f3bbf25-0f9b-4025-b2c1-7b6e220145a5" returned: 0 in 0.478s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:05 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-bb3e60f8-aeae-4bbe-930c-b6eef9f8ece9 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Lock "cinder-quobyte-1f3bbf25-0f9b-4025-b2c1-7b6e220145a5" released by "delete_volume" :: held 1.160s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:32:05 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-bb3e60f8-aeae-4bbe-930c-b6eef9f8ece9 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Created reservations ['753005d3-6e3f-458f-8532-a5c24d1a8f2c', 'b9bcca32-661c-41c9-8fc7-29625b5578a3', '8f3a65ce-2ef0-45a0-b576-632cd055a861', 'd9d1193b-0165-41d0-b822-ae901f6a5531'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:32:05 devstack sudo[91168]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:05 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9ef9b705-8eec-402f-bde9-2a7397436e41 tempest-SnapshotDependencyTests-277758335 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0170b02c-0d22-4644-98ef-dbbd753a8989.937a2045-a21a-4104-b2d9-eb09624e1f7b" returned: 0 in 0.564s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:05 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-9ef9b705-8eec-402f-bde9-2a7397436e41 tempest-SnapshotDependencyTests-277758335 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0170b02c-0d22-4644-98ef-dbbd753a8989(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83106) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:32:05 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bad1c6c-550a-47f0-8b89-a2c3b74df276]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:32:05 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9ef9b705-8eec-402f-bde9-2a7397436e41 tempest-SnapshotDependencyTests-277758335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0170b02c-0d22-4644-98ef-dbbd753a8989 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:05 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-bb3e60f8-aeae-4bbe-930c-b6eef9f8ece9 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:32:05 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-bb3e60f8-aeae-4bbe-930c-b6eef9f8ece9 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:32:05 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-bb3e60f8-aeae-4bbe-930c-b6eef9f8ece9 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:32:05 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-bb3e60f8-aeae-4bbe-930c-b6eef9f8ece9 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:32:05 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-bb3e60f8-aeae-4bbe-930c-b6eef9f8ece9 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:32:05 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-bb3e60f8-aeae-4bbe-930c-b6eef9f8ece9 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:05 devstack sudo[91180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:32:05 devstack sudo[91180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:05 devstack sudo[91179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0170b02c-0d22-4644-98ef-dbbd753a8989
Feb 27 01:32:05 devstack sudo[91179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:05 devstack sudo[91172]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:05 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0a313f99-0660-4f29-9ea0-a530fec3ef1c tempest-VolumeDependencyTests-1629780687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ade9918f-1f8a-4b6e-b3aa-fef154760cfd" returned: 0 in 0.522s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:05 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-0a313f99-0660-4f29-9ea0-a530fec3ef1c tempest-VolumeDependencyTests-1629780687 None] <== create_volume: return (1189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:32:05 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-0a313f99-0660-4f29-9ea0-a530fec3ef1c tempest-VolumeDependencyTests-1629780687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.193s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:32:05 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-0cc76cd7-5435-4a23-b72f-15f7b5c99fcd tempest-CinderUnicodeTest-1662562026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.792s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:32:05 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-0cc76cd7-5435-4a23-b72f-15f7b5c99fcd tempest-CinderUnicodeTest-1662562026 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:32:05Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0af0dc4-e417-48b1-8ead-0a8da0063eec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='087bf5dc6c9a424f8fb1a44da4605edb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:32:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:32:05Z,use_quota=True,user_id='d807bcde196d4c9f94c7e8e291c06f3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:32:05 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-0cc76cd7-5435-4a23-b72f-15f7b5c99fcd tempest-CinderUnicodeTest-1662562026 None] Creating volume b0af0dc4-e417-48b1-8ead-0a8da0063eec {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:32:05 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-0cc76cd7-5435-4a23-b72f-15f7b5c99fcd tempest-CinderUnicodeTest-1662562026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:32:05 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-0cc76cd7-5435-4a23-b72f-15f7b5c99fcd tempest-CinderUnicodeTest-1662562026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:32:05 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-0cc76cd7-5435-4a23-b72f-15f7b5c99fcd tempest-CinderUnicodeTest-1662562026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:32:05 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-0cc76cd7-5435-4a23-b72f-15f7b5c99fcd tempest-CinderUnicodeTest-1662562026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:32:05 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-0cc76cd7-5435-4a23-b72f-15f7b5c99fcd tempest-CinderUnicodeTest-1662562026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:32:05 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-0cc76cd7-5435-4a23-b72f-15f7b5c99fcd tempest-CinderUnicodeTest-1662562026 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:32:05 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-0cc76cd7-5435-4a23-b72f-15f7b5c99fcd tempest-CinderUnicodeTest-1662562026 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:32:05 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0cc76cd7-5435-4a23-b72f-15f7b5c99fcd tempest-CinderUnicodeTest-1662562026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b0af0dc4-e417-48b1-8ead-0a8da0063eec 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:05 devstack sudo[91183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b0af0dc4-e417-48b1-8ead-0a8da0063eec 1073741824
Feb 27 01:32:05 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-0a313f99-0660-4f29-9ea0-a530fec3ef1c tempest-VolumeDependencyTests-1629780687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60835b6f-220b-4ab4-84c7-83ceda0fc124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ade9918f-1f8a-4b6e-b3aa-fef154760cfd', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:32:05 devstack sudo[91183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:05 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-0a313f99-0660-4f29-9ea0-a530fec3ef1c tempest-VolumeDependencyTests-1629780687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c4dc994-5cfe-4ecf-acef-b114d1b6b0b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:32:06 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-0a313f99-0660-4f29-9ea0-a530fec3ef1c tempest-VolumeDependencyTests-1629780687 None] Volume volume-ade9918f-1f8a-4b6e-b3aa-fef154760cfd (ade9918f-1f8a-4b6e-b3aa-fef154760cfd): created successfully
Feb 27 01:32:06 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-0a313f99-0660-4f29-9ea0-a530fec3ef1c tempest-VolumeDependencyTests-1629780687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c4dc994-5cfe-4ecf-acef-b114d1b6b0b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:32:06 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-0a313f99-0660-4f29-9ea0-a530fec3ef1c tempest-VolumeDependencyTests-1629780687 None] Flow 'volume_create_manager' (4f8f917e-1c4b-4b91-ba7e-28bd80836240) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:32:06 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-0a313f99-0660-4f29-9ea0-a530fec3ef1c tempest-VolumeDependencyTests-1629780687 None] Created volume successfully.
Feb 27 01:32:06 devstack sudo[91180]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:06 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-bb3e60f8-aeae-4bbe-930c-b6eef9f8ece9 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.495s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:06 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-bb3e60f8-aeae-4bbe-930c-b6eef9f8ece9 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:32:06 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-bb3e60f8-aeae-4bbe-930c-b6eef9f8ece9 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Deleted volume successfully.
Feb 27 01:32:06 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-bb3e60f8-aeae-4bbe-930c-b6eef9f8ece9 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Lock "cinder-1f3bbf25-0f9b-4025-b2c1-7b6e220145a5-delete_volume" released by "delete_volume" :: held 1.820s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:32:06 devstack sudo[91179]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:06 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9ef9b705-8eec-402f-bde9-2a7397436e41 tempest-SnapshotDependencyTests-277758335 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0170b02c-0d22-4644-98ef-dbbd753a8989" returned: 0 in 0.562s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:06 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9ef9b705-8eec-402f-bde9-2a7397436e41 tempest-SnapshotDependencyTests-277758335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0170b02c-0d22-4644-98ef-dbbd753a8989.937a2045-a21a-4104-b2d9-eb09624e1f7b {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:06 devstack sudo[91192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0170b02c-0d22-4644-98ef-dbbd753a8989.937a2045-a21a-4104-b2d9-eb09624e1f7b
Feb 27 01:32:06 devstack sudo[91192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:06 devstack sudo[91183]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:06 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0cc76cd7-5435-4a23-b72f-15f7b5c99fcd tempest-CinderUnicodeTest-1662562026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b0af0dc4-e417-48b1-8ead-0a8da0063eec 1073741824" returned: 0 in 0.598s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:06 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0cc76cd7-5435-4a23-b72f-15f7b5c99fcd tempest-CinderUnicodeTest-1662562026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b0af0dc4-e417-48b1-8ead-0a8da0063eec {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:06 devstack sudo[91194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b0af0dc4-e417-48b1-8ead-0a8da0063eec
Feb 27 01:32:06 devstack sudo[91194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:06 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-2d202560-1ffa-4ae8-8ce0-692ff13adaad tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Acquiring lock "cinder-c8832989-9424-4746-9d3e-7b7ea24c096c-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:32:06 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-2d202560-1ffa-4ae8-8ce0-692ff13adaad tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Lock "cinder-c8832989-9424-4746-9d3e-7b7ea24c096c-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:32:06 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-2d202560-1ffa-4ae8-8ce0-692ff13adaad tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Acquiring lock "cinder-quobyte-c8832989-9424-4746-9d3e-7b7ea24c096c" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:32:06 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-2d202560-1ffa-4ae8-8ce0-692ff13adaad tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Lock "cinder-quobyte-c8832989-9424-4746-9d3e-7b7ea24c096c" acquired by "delete_volume" :: waited 0.014s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:32:06 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f11ff3-5bbf-4644-960f-326fdb8b938c]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:32:06 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-2d202560-1ffa-4ae8-8ce0-692ff13adaad tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c8832989-9424-4746-9d3e-7b7ea24c096c {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:06 devstack sudo[91199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c8832989-9424-4746-9d3e-7b7ea24c096c
Feb 27 01:32:06 devstack sudo[91199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:06 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:32:06 devstack sudo[91192]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:06 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] Flow 'volume_create_manager' (a5bb304d-e819-40af-91df-99e46070e59b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:32:06 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b2e9a51-b460-4173-9a7c-7749853cc5ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:32:06 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9ef9b705-8eec-402f-bde9-2a7397436e41 tempest-SnapshotDependencyTests-277758335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0170b02c-0d22-4644-98ef-dbbd753a8989.937a2045-a21a-4104-b2d9-eb09624e1f7b" returned: 0 in 0.579s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:06 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9ef9b705-8eec-402f-bde9-2a7397436e41 tempest-SnapshotDependencyTests-277758335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0170b02c-0d22-4644-98ef-dbbd753a8989.937a2045-a21a-4104-b2d9-eb09624e1f7b {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:07 devstack sudo[91201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0170b02c-0d22-4644-98ef-dbbd753a8989.937a2045-a21a-4104-b2d9-eb09624e1f7b
Feb 27 01:32:07 devstack sudo[91201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:07 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b2e9a51-b460-4173-9a7c-7749853cc5ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:32:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1008611907',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e8b1dee-89ec-42db-a029-568498ce60e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae46202a7c8e473eb29eb42c73fcbd9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:32:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=ade9918f-1f8a-4b6e-b3aa-fef154760cfd,status='creating',terminated_at=None,updated_at=2026-02-27T00:32:07Z,use_quota=True,user_id='b3008ba5718f4609b1c16d3b5395869c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:32:07 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd29c862-2109-4325-8ed3-7bba73fd013f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:32:07 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd29c862-2109-4325-8ed3-7bba73fd013f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:32:07 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bbd494a-3e9f-4f5a-8313-1fa48f65bb10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:32:07 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bbd494a-3e9f-4f5a-8313-1fa48f65bb10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '0e8b1dee-89ec-42db-a029-568498ce60e4', 'volume_name': 'volume-0e8b1dee-89ec-42db-a029-568498ce60e4', 'volume_size': 1, 'source_volid': 'ade9918f-1f8a-4b6e-b3aa-fef154760cfd', 'source_volstatus': 'available'}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:32:07 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82529b29-2144-43b1-9e81-8ea2a32362a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:32:07 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82529b29-2144-43b1-9e81-8ea2a32362a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:32:07 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5f90350-d3c9-4f08-a608-edcbe16b63ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:32:07 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] Volume 0e8b1dee-89ec-42db-a029-568498ce60e4: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-0e8b1dee-89ec-42db-a029-568498ce60e4', 'volume_size': 1, 'source_volid': 'ade9918f-1f8a-4b6e-b3aa-fef154760cfd', 'source_volstatus': 'available'}
Feb 27 01:32:07 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:32:07 devstack sudo[91194]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:07 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0cc76cd7-5435-4a23-b72f-15f7b5c99fcd tempest-CinderUnicodeTest-1662562026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b0af0dc4-e417-48b1-8ead-0a8da0063eec" returned: 0 in 0.509s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:07 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-0cc76cd7-5435-4a23-b72f-15f7b5c99fcd tempest-CinderUnicodeTest-1662562026 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:32:07 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-0cc76cd7-5435-4a23-b72f-15f7b5c99fcd tempest-CinderUnicodeTest-1662562026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:32:07 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.033s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:32:07 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] Cloning volume ade9918f-1f8a-4b6e-b3aa-fef154760cfd to volume 0e8b1dee-89ec-42db-a029-568498ce60e4
Feb 27 01:32:07 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-0cc76cd7-5435-4a23-b72f-15f7b5c99fcd tempest-CinderUnicodeTest-1662562026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b31723d-49af-4865-abd1-4dfe3e0184fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0af0dc4-e417-48b1-8ead-0a8da0063eec', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:32:07 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-0cc76cd7-5435-4a23-b72f-15f7b5c99fcd tempest-CinderUnicodeTest-1662562026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba94f63f-667e-4140-abbf-61f6fbbd44cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:32:07 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-0cc76cd7-5435-4a23-b72f-15f7b5c99fcd tempest-CinderUnicodeTest-1662562026 None] Volume volume-b0af0dc4-e417-48b1-8ead-0a8da0063eec (b0af0dc4-e417-48b1-8ead-0a8da0063eec): created successfully
Feb 27 01:32:07 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-0cc76cd7-5435-4a23-b72f-15f7b5c99fcd tempest-CinderUnicodeTest-1662562026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba94f63f-667e-4140-abbf-61f6fbbd44cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:32:07 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-0cc76cd7-5435-4a23-b72f-15f7b5c99fcd tempest-CinderUnicodeTest-1662562026 None] Flow 'volume_create_manager' (27b76513-8118-400b-90df-3cb6e4b0c5ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:32:07 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] Creating offline snapshot 0222fea4-1aad-4fc6-bfbf-8ad0c788fd44 of volume ade9918f-1f8a-4b6e-b3aa-fef154760cfd {{(pid=83106) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:32:07 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-0cc76cd7-5435-4a23-b72f-15f7b5c99fcd tempest-CinderUnicodeTest-1662562026 None] Created volume successfully.
Feb 27 01:32:07 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[62145714-fe28-4e8a-a46f-60293e3df8b5]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:32:07 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ade9918f-1f8a-4b6e-b3aa-fef154760cfd {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:07 devstack sudo[91204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ade9918f-1f8a-4b6e-b3aa-fef154760cfd
Feb 27 01:32:07 devstack sudo[91204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:07 devstack sudo[91199]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:07 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-2d202560-1ffa-4ae8-8ce0-692ff13adaad tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c8832989-9424-4746-9d3e-7b7ea24c096c" returned: 0 in 0.527s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:07 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-2d202560-1ffa-4ae8-8ce0-692ff13adaad tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c8832989-9424-4746-9d3e-7b7ea24c096c {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:07 devstack sudo[91210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c8832989-9424-4746-9d3e-7b7ea24c096c
Feb 27 01:32:07 devstack sudo[91210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:07 devstack sudo[91201]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:07 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-9ef9b705-8eec-402f-bde9-2a7397436e41 tempest-SnapshotDependencyTests-277758335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0170b02c-0d22-4644-98ef-dbbd753a8989.937a2045-a21a-4104-b2d9-eb09624e1f7b" returned: 0 in 0.449s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:07 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-9ef9b705-8eec-402f-bde9-2a7397436e41 tempest-SnapshotDependencyTests-277758335 None] Lock "cinder-quobyte-937a2045-a21a-4104-b2d9-eb09624e1f7b" released by "_delete_snapshot" :: held 2.224s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:32:07 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-9ef9b705-8eec-402f-bde9-2a7397436e41 tempest-SnapshotDependencyTests-277758335 None] Lock "cinder-quobyte-0170b02c-0d22-4644-98ef-dbbd753a8989" released by "delete_snapshot" :: held 2.243s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:32:07 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-9ef9b705-8eec-402f-bde9-2a7397436e41 tempest-SnapshotDependencyTests-277758335 None] Created reservations ['49060a6c-c989-4e5d-8e1e-1afd6568967b', '815a8188-8b19-49e7-b230-41f3e38d105a', '9a68bac5-c92c-4a13-a4fe-d6e63250860c', 'a9da4bc0-d50c-41c2-af1d-4971e00588e4'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:32:07 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-9ef9b705-8eec-402f-bde9-2a7397436e41 tempest-SnapshotDependencyTests-277758335 None] Delete snapshot completed successfully.
Feb 27 01:32:07 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-9ef9b705-8eec-402f-bde9-2a7397436e41 tempest-SnapshotDependencyTests-277758335 None] Lock "cinder-937a2045-a21a-4104-b2d9-eb09624e1f7b-delete_snapshot" released by "delete_snapshot" :: held 2.348s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:32:07 devstack sudo[91204]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:07 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ade9918f-1f8a-4b6e-b3aa-fef154760cfd" returned: 0 in 0.515s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:07 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ade9918f-1f8a-4b6e-b3aa-fef154760cfd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ade9918f-1f8a-4b6e-b3aa-fef154760cfd.0222fea4-1aad-4fc6-bfbf-8ad0c788fd44 1G {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:07 devstack sudo[91215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ade9918f-1f8a-4b6e-b3aa-fef154760cfd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ade9918f-1f8a-4b6e-b3aa-fef154760cfd.0222fea4-1aad-4fc6-bfbf-8ad0c788fd44 1G
Feb 27 01:32:07 devstack sudo[91215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:07 devstack sudo[91210]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:07 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-2d202560-1ffa-4ae8-8ce0-692ff13adaad tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-c8832989-9424-4746-9d3e-7b7ea24c096c" returned: 0 in 0.429s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:07 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-2d202560-1ffa-4ae8-8ce0-692ff13adaad tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Lock "cinder-quobyte-c8832989-9424-4746-9d3e-7b7ea24c096c" released by "delete_volume" :: held 0.980s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:32:07 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-2d202560-1ffa-4ae8-8ce0-692ff13adaad tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Created reservations ['78d80b4a-82fa-480d-ba4c-9875e2792c4c', 'd9029bf9-e547-4791-9268-2f1af702aeda', 'fedddca3-1158-40c1-9dad-6e4d7b2a6a6c', 'e696a799-0b9d-4419-8ac6-672838be685f'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:32:07 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-2d202560-1ffa-4ae8-8ce0-692ff13adaad tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:32:07 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-2d202560-1ffa-4ae8-8ce0-692ff13adaad tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:32:07 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-2d202560-1ffa-4ae8-8ce0-692ff13adaad tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:32:07 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-2d202560-1ffa-4ae8-8ce0-692ff13adaad tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:32:07 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-2d202560-1ffa-4ae8-8ce0-692ff13adaad tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:32:07 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-2d202560-1ffa-4ae8-8ce0-692ff13adaad tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:07 devstack sudo[91218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:32:07 devstack sudo[91218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:08 devstack sudo[91215]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:08 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ade9918f-1f8a-4b6e-b3aa-fef154760cfd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ade9918f-1f8a-4b6e-b3aa-fef154760cfd.0222fea4-1aad-4fc6-bfbf-8ad0c788fd44 1G" returned: 0 in 0.537s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:08 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ade9918f-1f8a-4b6e-b3aa-fef154760cfd -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ade9918f-1f8a-4b6e-b3aa-fef154760cfd.0222fea4-1aad-4fc6-bfbf-8ad0c788fd44 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:08 devstack sudo[91223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ade9918f-1f8a-4b6e-b3aa-fef154760cfd -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ade9918f-1f8a-4b6e-b3aa-fef154760cfd.0222fea4-1aad-4fc6-bfbf-8ad0c788fd44
Feb 27 01:32:08 devstack sudo[91223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:08 devstack sudo[91218]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:08 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-2d202560-1ffa-4ae8-8ce0-692ff13adaad tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.416s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:08 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-2d202560-1ffa-4ae8-8ce0-692ff13adaad tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:32:08 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-2d202560-1ffa-4ae8-8ce0-692ff13adaad tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Deleted volume successfully.
Feb 27 01:32:08 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-2d202560-1ffa-4ae8-8ce0-692ff13adaad tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Lock "cinder-c8832989-9424-4746-9d3e-7b7ea24c096c-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:32:08 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-344c8bf9-9e0b-46d6-9942-f4601dfb7f15 tempest-SnapshotDependencyTests-277758335 None] Acquiring lock "cinder-0170b02c-0d22-4644-98ef-dbbd753a8989-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:32:08 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-344c8bf9-9e0b-46d6-9942-f4601dfb7f15 tempest-SnapshotDependencyTests-277758335 None] Lock "cinder-0170b02c-0d22-4644-98ef-dbbd753a8989-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:32:08 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-344c8bf9-9e0b-46d6-9942-f4601dfb7f15 tempest-SnapshotDependencyTests-277758335 None] Acquiring lock "cinder-quobyte-0170b02c-0d22-4644-98ef-dbbd753a8989" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:32:08 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-344c8bf9-9e0b-46d6-9942-f4601dfb7f15 tempest-SnapshotDependencyTests-277758335 None] Lock "cinder-quobyte-0170b02c-0d22-4644-98ef-dbbd753a8989" acquired by "delete_volume" :: waited 0.006s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:32:08 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49160e6-9508-421b-b152-4cec4fe2549b]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:32:08 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-344c8bf9-9e0b-46d6-9942-f4601dfb7f15 tempest-SnapshotDependencyTests-277758335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0170b02c-0d22-4644-98ef-dbbd753a8989 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:08 devstack sudo[91226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0170b02c-0d22-4644-98ef-dbbd753a8989
Feb 27 01:32:08 devstack sudo[91226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:08 devstack cinder-volume[83106]: DEBUG cinder.volume.flows.manager.create_volume [None req-7efc6ead-e657-4e8f-bdb9-76783ac5ed13 tempest-CinderUnicodeTest-1662562026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83106) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 01:32:08 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7efc6ead-e657-4e8f-bdb9-76783ac5ed13 tempest-CinderUnicodeTest-1662562026 None] Flow 'volume_create_manager' (ee1aa792-b5be-4298-81f2-be844b106eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:32:08 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7efc6ead-e657-4e8f-bdb9-76783ac5ed13 tempest-CinderUnicodeTest-1662562026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd20558b-df37-469f-896e-591091e3b6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:32:08 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7efc6ead-e657-4e8f-bdb9-76783ac5ed13 tempest-CinderUnicodeTest-1662562026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd20558b-df37-469f-896e-591091e3b6d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:32:08Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-244260619',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82a3319e-553a-4c47-90e2-e518ecc64f46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='087bf5dc6c9a424f8fb1a44da4605edb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:32:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:32:09Z,use_quota=True,user_id='d807bcde196d4c9f94c7e8e291c06f3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:32:08 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7efc6ead-e657-4e8f-bdb9-76783ac5ed13 tempest-CinderUnicodeTest-1662562026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (656dc1de-4678-4b60-9b12-6f1f8cc4430a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:32:08 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7efc6ead-e657-4e8f-bdb9-76783ac5ed13 tempest-CinderUnicodeTest-1662562026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (656dc1de-4678-4b60-9b12-6f1f8cc4430a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:32:08 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7efc6ead-e657-4e8f-bdb9-76783ac5ed13 tempest-CinderUnicodeTest-1662562026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01d18c30-815a-4007-9900-cf0fc9d5722b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:32:08 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7efc6ead-e657-4e8f-bdb9-76783ac5ed13 tempest-CinderUnicodeTest-1662562026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01d18c30-815a-4007-9900-cf0fc9d5722b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82a3319e-553a-4c47-90e2-e518ecc64f46', 'volume_name': 'volume-82a3319e-553a-4c47-90e2-e518ecc64f46', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:32:08 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7efc6ead-e657-4e8f-bdb9-76783ac5ed13 tempest-CinderUnicodeTest-1662562026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e757f825-a811-4b25-a622-fa62670d1e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:32:08 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7efc6ead-e657-4e8f-bdb9-76783ac5ed13 tempest-CinderUnicodeTest-1662562026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e757f825-a811-4b25-a622-fa62670d1e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:32:08 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7efc6ead-e657-4e8f-bdb9-76783ac5ed13 tempest-CinderUnicodeTest-1662562026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcfb5789-295b-42d8-ac2e-095fbb74af1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:32:08 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-7efc6ead-e657-4e8f-bdb9-76783ac5ed13 tempest-CinderUnicodeTest-1662562026 None] Volume 82a3319e-553a-4c47-90e2-e518ecc64f46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82a3319e-553a-4c47-90e2-e518ecc64f46', 'volume_size': 1}
Feb 27 01:32:08 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-7efc6ead-e657-4e8f-bdb9-76783ac5ed13 tempest-CinderUnicodeTest-1662562026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:32:08 devstack sudo[91223]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:08 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ade9918f-1f8a-4b6e-b3aa-fef154760cfd -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ade9918f-1f8a-4b6e-b3aa-fef154760cfd.0222fea4-1aad-4fc6-bfbf-8ad0c788fd44" returned: 0 in 0.525s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:08 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ade9918f-1f8a-4b6e-b3aa-fef154760cfd.0222fea4-1aad-4fc6-bfbf-8ad0c788fd44 is being set with open permissions: ugo+rw
Feb 27 01:32:08 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ade9918f-1f8a-4b6e-b3aa-fef154760cfd.0222fea4-1aad-4fc6-bfbf-8ad0c788fd44 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:08 devstack sudo[91231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ade9918f-1f8a-4b6e-b3aa-fef154760cfd.0222fea4-1aad-4fc6-bfbf-8ad0c788fd44
Feb 27 01:32:08 devstack sudo[91231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:08 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-ed983ad4-29f3-46c9-8b3d-97a168ae053a tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Acquiring lock "cinder-e35ed84c-fa52-4372-914a-b6539abc0ca3-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:32:08 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-ed983ad4-29f3-46c9-8b3d-97a168ae053a tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Lock "cinder-e35ed84c-fa52-4372-914a-b6539abc0ca3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:32:09 devstack sudo[91226]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:09 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-344c8bf9-9e0b-46d6-9942-f4601dfb7f15 tempest-SnapshotDependencyTests-277758335 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0170b02c-0d22-4644-98ef-dbbd753a8989" returned: 0 in 0.546s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:09 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-344c8bf9-9e0b-46d6-9942-f4601dfb7f15 tempest-SnapshotDependencyTests-277758335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0170b02c-0d22-4644-98ef-dbbd753a8989 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:09 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-ed983ad4-29f3-46c9-8b3d-97a168ae053a tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Acquiring lock "cinder-quobyte-e35ed84c-fa52-4372-914a-b6539abc0ca3" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:32:09 devstack sudo[91236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0170b02c-0d22-4644-98ef-dbbd753a8989
Feb 27 01:32:09 devstack sudo[91236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:09 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-ed983ad4-29f3-46c9-8b3d-97a168ae053a tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Lock "cinder-quobyte-e35ed84c-fa52-4372-914a-b6539abc0ca3" acquired by "delete_volume" :: waited 0.013s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:32:09 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[e041803d-119e-4b95-aebe-a0ffaa802e8c]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:32:09 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ed983ad4-29f3-46c9-8b3d-97a168ae053a tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e35ed84c-fa52-4372-914a-b6539abc0ca3 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:09 devstack sudo[91238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e35ed84c-fa52-4372-914a-b6539abc0ca3
Feb 27 01:32:09 devstack sudo[91238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:09 devstack sudo[91231]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:09 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ade9918f-1f8a-4b6e-b3aa-fef154760cfd.0222fea4-1aad-4fc6-bfbf-8ad0c788fd44" returned: 0 in 0.417s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:09 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ade9918f-1f8a-4b6e-b3aa-fef154760cfd.info {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:09 devstack sudo[91241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ade9918f-1f8a-4b6e-b3aa-fef154760cfd.info
Feb 27 01:32:09 devstack sudo[91241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:09 devstack sudo[91236]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:09 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-344c8bf9-9e0b-46d6-9942-f4601dfb7f15 tempest-SnapshotDependencyTests-277758335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0170b02c-0d22-4644-98ef-dbbd753a8989" returned: 0 in 0.422s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:09 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-344c8bf9-9e0b-46d6-9942-f4601dfb7f15 tempest-SnapshotDependencyTests-277758335 None] Lock "cinder-quobyte-0170b02c-0d22-4644-98ef-dbbd753a8989" released by "delete_volume" :: held 1.015s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:32:09 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-344c8bf9-9e0b-46d6-9942-f4601dfb7f15 tempest-SnapshotDependencyTests-277758335 None] Created reservations ['f70bcb43-d7cf-4839-9ae5-7e292bfa33df', '38453af6-f787-4ca1-9965-f3fcf01f13bc', '615dec49-9f9b-4949-9da9-2d3dad56d625', 'b4441cfa-5c81-4555-8f1c-98beeb65bf30'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:32:09 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-344c8bf9-9e0b-46d6-9942-f4601dfb7f15 tempest-SnapshotDependencyTests-277758335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:32:09 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-344c8bf9-9e0b-46d6-9942-f4601dfb7f15 tempest-SnapshotDependencyTests-277758335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:32:09 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-344c8bf9-9e0b-46d6-9942-f4601dfb7f15 tempest-SnapshotDependencyTests-277758335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:32:09 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-344c8bf9-9e0b-46d6-9942-f4601dfb7f15 tempest-SnapshotDependencyTests-277758335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:32:09 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-344c8bf9-9e0b-46d6-9942-f4601dfb7f15 tempest-SnapshotDependencyTests-277758335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:32:09 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-344c8bf9-9e0b-46d6-9942-f4601dfb7f15 tempest-SnapshotDependencyTests-277758335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:09 devstack sudo[91238]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:09 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ed983ad4-29f3-46c9-8b3d-97a168ae053a tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e35ed84c-fa52-4372-914a-b6539abc0ca3" returned: 0 in 0.542s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:09 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ed983ad4-29f3-46c9-8b3d-97a168ae053a tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e35ed84c-fa52-4372-914a-b6539abc0ca3 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:09 devstack sudo[91248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:32:09 devstack sudo[91248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:09 devstack sudo[91250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e35ed84c-fa52-4372-914a-b6539abc0ca3
Feb 27 01:32:09 devstack sudo[91250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:09 devstack sudo[91241]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:09 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ade9918f-1f8a-4b6e-b3aa-fef154760cfd.info" returned: 0 in 0.447s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:09 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ade9918f-1f8a-4b6e-b3aa-fef154760cfd.info is being set with open permissions: ugo+rw
Feb 27 01:32:09 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ade9918f-1f8a-4b6e-b3aa-fef154760cfd.info {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:09 devstack sudo[91252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ade9918f-1f8a-4b6e-b3aa-fef154760cfd.info
Feb 27 01:32:09 devstack sudo[91252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:09 devstack sudo[91250]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:09 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ed983ad4-29f3-46c9-8b3d-97a168ae053a tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-e35ed84c-fa52-4372-914a-b6539abc0ca3" returned: 0 in 0.388s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:10 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-ed983ad4-29f3-46c9-8b3d-97a168ae053a tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Lock "cinder-quobyte-e35ed84c-fa52-4372-914a-b6539abc0ca3" released by "delete_volume" :: held 0.957s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:32:10 devstack sudo[91252]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:10 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ade9918f-1f8a-4b6e-b3aa-fef154760cfd.info" returned: 0 in 0.411s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:10 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] Acquiring lock "cinder-quobyte-0e8b1dee-89ec-42db-a029-568498ce60e4" by "_copy_volume_from_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:32:10 devstack sudo[91248]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:10 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-ed983ad4-29f3-46c9-8b3d-97a168ae053a tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Created reservations ['b3df98e6-e194-44bd-b1cf-59a1ee231e61', 'b5abe44d-a69f-4f5a-9f05-baac8a3f88a3', '8d46bee1-a542-4724-83f4-933b40afb9ee', '83912021-4617-4fd6-8ac2-bd9058e5392c'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:32:10 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] Lock "cinder-quobyte-0e8b1dee-89ec-42db-a029-568498ce60e4" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:32:10 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] snapshot: 0222fea4-1aad-4fc6-bfbf-8ad0c788fd44, volume: 0e8b1dee-89ec-42db-a029-568498ce60e4,  {{(pid=83106) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Feb 27 01:32:10 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:32:10 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:32:10 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:32:10 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:32:10 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:32:10 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-344c8bf9-9e0b-46d6-9942-f4601dfb7f15 tempest-SnapshotDependencyTests-277758335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.521s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:10 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-344c8bf9-9e0b-46d6-9942-f4601dfb7f15 tempest-SnapshotDependencyTests-277758335 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:32:10 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[93285b5b-5cd9-41c6-a051-0bddea9f240c]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:32:10 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ade9918f-1f8a-4b6e-b3aa-fef154760cfd.0222fea4-1aad-4fc6-bfbf-8ad0c788fd44 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:10 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-344c8bf9-9e0b-46d6-9942-f4601dfb7f15 tempest-SnapshotDependencyTests-277758335 None] Deleted volume successfully.
Feb 27 01:32:10 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-344c8bf9-9e0b-46d6-9942-f4601dfb7f15 tempest-SnapshotDependencyTests-277758335 None] Lock "cinder-0170b02c-0d22-4644-98ef-dbbd753a8989-delete_volume" released by "delete_volume" :: held 1.733s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:32:10 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-ed983ad4-29f3-46c9-8b3d-97a168ae053a tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:32:10 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-ed983ad4-29f3-46c9-8b3d-97a168ae053a tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:32:10 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-ed983ad4-29f3-46c9-8b3d-97a168ae053a tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:32:10 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-ed983ad4-29f3-46c9-8b3d-97a168ae053a tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:32:10 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-ed983ad4-29f3-46c9-8b3d-97a168ae053a tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:32:10 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ed983ad4-29f3-46c9-8b3d-97a168ae053a tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:10 devstack sudo[91257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ade9918f-1f8a-4b6e-b3aa-fef154760cfd.0222fea4-1aad-4fc6-bfbf-8ad0c788fd44
Feb 27 01:32:10 devstack sudo[91257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:10 devstack sudo[91258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:32:10 devstack sudo[91258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:10 devstack sudo[91258]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:10 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-ed180f81-8610-47dd-8cd5-d3544595ddab tempest-SnapshotDependencyTests-277758335 None] Acquiring lock "cinder-d5601f33-acb7-4f3f-8767-1ecd3de37ae0-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:32:10 devstack sudo[91257]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:10 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ed983ad4-29f3-46c9-8b3d-97a168ae053a tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.435s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:10 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-ed983ad4-29f3-46c9-8b3d-97a168ae053a tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:32:10 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ade9918f-1f8a-4b6e-b3aa-fef154760cfd.0222fea4-1aad-4fc6-bfbf-8ad0c788fd44" returned: 0 in 0.506s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:10 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ade9918f-1f8a-4b6e-b3aa-fef154760cfd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83106) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:32:10 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ade9918f-1f8a-4b6e-b3aa-fef154760cfd {{(pid=83106) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Feb 27 01:32:10 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] Creating direct copy from snapshot {{(pid=83106) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Feb 27 01:32:10 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-ed180f81-8610-47dd-8cd5-d3544595ddab tempest-SnapshotDependencyTests-277758335 None] Lock "cinder-d5601f33-acb7-4f3f-8767-1ecd3de37ae0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:32:10 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-ed983ad4-29f3-46c9-8b3d-97a168ae053a tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Deleted volume successfully.
Feb 27 01:32:10 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea407bb-0118-4812-8452-529ae9195762]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:32:10 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ade9918f-1f8a-4b6e-b3aa-fef154760cfd {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:10 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-ed983ad4-29f3-46c9-8b3d-97a168ae053a tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Lock "cinder-e35ed84c-fa52-4372-914a-b6539abc0ca3-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:32:10 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-ed180f81-8610-47dd-8cd5-d3544595ddab tempest-SnapshotDependencyTests-277758335 None] Acquiring lock "cinder-quobyte-d5601f33-acb7-4f3f-8767-1ecd3de37ae0" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:32:10 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-ed180f81-8610-47dd-8cd5-d3544595ddab tempest-SnapshotDependencyTests-277758335 None] Lock "cinder-quobyte-d5601f33-acb7-4f3f-8767-1ecd3de37ae0" acquired by "delete_volume" :: waited 0.007s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:32:10 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26907b3-6aea-43e1-911c-d1878a8c3e08]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:32:10 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ed180f81-8610-47dd-8cd5-d3544595ddab tempest-SnapshotDependencyTests-277758335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-d5601f33-acb7-4f3f-8767-1ecd3de37ae0 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:10 devstack sudo[91265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ade9918f-1f8a-4b6e-b3aa-fef154760cfd
Feb 27 01:32:10 devstack sudo[91265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:10 devstack sudo[91266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-d5601f33-acb7-4f3f-8767-1ecd3de37ae0
Feb 27 01:32:10 devstack sudo[91266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:11 devstack sudo[91265]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:11 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ade9918f-1f8a-4b6e-b3aa-fef154760cfd" returned: 0 in 0.514s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:11 devstack cinder-volume[83106]: DEBUG cinder.utils [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] Path /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0e8b1dee-89ec-42db-a029-568498ce60e4 not found in is_blk_device check {{(pid=83106) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Feb 27 01:32:11 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ade9918f-1f8a-4b6e-b3aa-fef154760cfd /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0e8b1dee-89ec-42db-a029-568498ce60e4 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:11 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5b829ee2-1cf0-454a-9451-bd07084b7c54 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Acquiring lock "cinder-eef7f087-6b13-4dcc-afc9-6632c83019db-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:32:11 devstack sudo[91275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ade9918f-1f8a-4b6e-b3aa-fef154760cfd /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0e8b1dee-89ec-42db-a029-568498ce60e4
Feb 27 01:32:11 devstack sudo[91275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:11 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5b829ee2-1cf0-454a-9451-bd07084b7c54 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Lock "cinder-eef7f087-6b13-4dcc-afc9-6632c83019db-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:32:11 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5b829ee2-1cf0-454a-9451-bd07084b7c54 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Acquiring lock "cinder-quobyte-eef7f087-6b13-4dcc-afc9-6632c83019db" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:32:11 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5b829ee2-1cf0-454a-9451-bd07084b7c54 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Lock "cinder-quobyte-eef7f087-6b13-4dcc-afc9-6632c83019db" acquired by "delete_volume" :: waited 0.013s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:32:11 devstack sudo[91266]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:11 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ed180f81-8610-47dd-8cd5-d3544595ddab tempest-SnapshotDependencyTests-277758335 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-d5601f33-acb7-4f3f-8767-1ecd3de37ae0" returned: 0 in 0.550s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:11 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ed180f81-8610-47dd-8cd5-d3544595ddab tempest-SnapshotDependencyTests-277758335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-d5601f33-acb7-4f3f-8767-1ecd3de37ae0 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:11 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc55c12-1823-46cc-aa58-da20220bacb5]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:32:11 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5b829ee2-1cf0-454a-9451-bd07084b7c54 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-eef7f087-6b13-4dcc-afc9-6632c83019db {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:11 devstack sudo[91277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-d5601f33-acb7-4f3f-8767-1ecd3de37ae0
Feb 27 01:32:11 devstack sudo[91277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:11 devstack sudo[91278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-eef7f087-6b13-4dcc-afc9-6632c83019db
Feb 27 01:32:11 devstack sudo[91278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:11 devstack sudo[91277]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:11 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ed180f81-8610-47dd-8cd5-d3544595ddab tempest-SnapshotDependencyTests-277758335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-d5601f33-acb7-4f3f-8767-1ecd3de37ae0" returned: 0 in 0.693s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:11 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-ed180f81-8610-47dd-8cd5-d3544595ddab tempest-SnapshotDependencyTests-277758335 None] Lock "cinder-quobyte-d5601f33-acb7-4f3f-8767-1ecd3de37ae0" released by "delete_volume" :: held 1.280s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:32:12 devstack sudo[91278]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:12 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5b829ee2-1cf0-454a-9451-bd07084b7c54 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-eef7f087-6b13-4dcc-afc9-6632c83019db" returned: 0 in 0.796s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:12 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5b829ee2-1cf0-454a-9451-bd07084b7c54 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-eef7f087-6b13-4dcc-afc9-6632c83019db {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:12 devstack sudo[91295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-eef7f087-6b13-4dcc-afc9-6632c83019db
Feb 27 01:32:12 devstack sudo[91295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:12 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-ed180f81-8610-47dd-8cd5-d3544595ddab tempest-SnapshotDependencyTests-277758335 None] Created reservations ['f092d3e0-7614-49eb-88c5-40e736d93308', 'e46f045d-8c52-4e79-a1de-fb91506c1e40', 'e1e54ac0-bed0-4b5a-ab3c-8859577eda37', 'a0a62b20-ca4c-435a-a92d-3ce26a739c0e'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:32:12 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-ed180f81-8610-47dd-8cd5-d3544595ddab tempest-SnapshotDependencyTests-277758335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:32:12 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-ed180f81-8610-47dd-8cd5-d3544595ddab tempest-SnapshotDependencyTests-277758335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:32:12 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-ed180f81-8610-47dd-8cd5-d3544595ddab tempest-SnapshotDependencyTests-277758335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:32:12 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-ed180f81-8610-47dd-8cd5-d3544595ddab tempest-SnapshotDependencyTests-277758335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:32:12 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-ed180f81-8610-47dd-8cd5-d3544595ddab tempest-SnapshotDependencyTests-277758335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:32:12 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ed180f81-8610-47dd-8cd5-d3544595ddab tempest-SnapshotDependencyTests-277758335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:12 devstack sudo[91297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:32:12 devstack sudo[91297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:13 devstack sudo[91295]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:13 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5b829ee2-1cf0-454a-9451-bd07084b7c54 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-eef7f087-6b13-4dcc-afc9-6632c83019db" returned: 0 in 1.080s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:13 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5b829ee2-1cf0-454a-9451-bd07084b7c54 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Lock "cinder-quobyte-eef7f087-6b13-4dcc-afc9-6632c83019db" released by "delete_volume" :: held 1.943s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:32:13 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-5b829ee2-1cf0-454a-9451-bd07084b7c54 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Created reservations ['39af620b-dc38-40c4-b7a2-e681a1a797b0', 'a3c67f47-02f4-48e8-a7f9-5976b2eeca59', '887ae355-8d25-40f8-b525-a207cde10d1a', '4b58c00d-1ae8-46ab-9ded-3642d9e4facf'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:32:13 devstack sudo[91297]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:13 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ed180f81-8610-47dd-8cd5-d3544595ddab tempest-SnapshotDependencyTests-277758335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 1.006s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:13 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-ed180f81-8610-47dd-8cd5-d3544595ddab tempest-SnapshotDependencyTests-277758335 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:32:13 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-ed180f81-8610-47dd-8cd5-d3544595ddab tempest-SnapshotDependencyTests-277758335 None] Deleted volume successfully.
Feb 27 01:32:13 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-ed180f81-8610-47dd-8cd5-d3544595ddab tempest-SnapshotDependencyTests-277758335 None] Lock "cinder-d5601f33-acb7-4f3f-8767-1ecd3de37ae0-delete_volume" released by "delete_volume" :: held 2.882s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:32:13 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-5b829ee2-1cf0-454a-9451-bd07084b7c54 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:32:13 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-5b829ee2-1cf0-454a-9451-bd07084b7c54 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:32:13 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-5b829ee2-1cf0-454a-9451-bd07084b7c54 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:32:13 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-5b829ee2-1cf0-454a-9451-bd07084b7c54 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:32:13 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-5b829ee2-1cf0-454a-9451-bd07084b7c54 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:32:13 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5b829ee2-1cf0-454a-9451-bd07084b7c54 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:13 devstack sudo[91302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:32:13 devstack sudo[91302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:13 devstack sudo[91275]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:13 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ade9918f-1f8a-4b6e-b3aa-fef154760cfd /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0e8b1dee-89ec-42db-a029-568498ce60e4" returned: 0 in 2.497s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:13 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[95fc28d8-0442-4037-ad8b-0feb54bfe4f7]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:32:13 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ade9918f-1f8a-4b6e-b3aa-fef154760cfd {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:13 devstack sudo[91304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ade9918f-1f8a-4b6e-b3aa-fef154760cfd
Feb 27 01:32:13 devstack sudo[91304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:14 devstack sudo[91302]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:14 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5b829ee2-1cf0-454a-9451-bd07084b7c54 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.506s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:14 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-5b829ee2-1cf0-454a-9451-bd07084b7c54 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:32:14 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-5b829ee2-1cf0-454a-9451-bd07084b7c54 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Deleted volume successfully.
Feb 27 01:32:14 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5b829ee2-1cf0-454a-9451-bd07084b7c54 tempest-CreateVolumesFromSourceVolumeTest-1359736655 None] Lock "cinder-eef7f087-6b13-4dcc-afc9-6632c83019db-delete_volume" released by "delete_volume" :: held 2.899s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:32:14 devstack sudo[91304]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:14 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ade9918f-1f8a-4b6e-b3aa-fef154760cfd" returned: 0 in 0.798s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:14 devstack cinder-volume[83106]: DEBUG cinder.image.image_utils [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] Image conversion details: src /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ade9918f-1f8a-4b6e-b3aa-fef154760cfd, size 1024.00 MB, duration 2.50 sec, destination /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0e8b1dee-89ec-42db-a029-568498ce60e4 {{(pid=83106) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 27 01:32:14 devstack cinder-volume[83106]: INFO cinder.image.image_utils [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] Converted 1024.00 MB image at 409.85 MB/s
Feb 27 01:32:14 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0e8b1dee-89ec-42db-a029-568498ce60e4 is being set with open permissions: ugo+rw
Feb 27 01:32:14 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0e8b1dee-89ec-42db-a029-568498ce60e4 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:14 devstack sudo[91310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0e8b1dee-89ec-42db-a029-568498ce60e4
Feb 27 01:32:14 devstack sudo[91310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:14 devstack sudo[91310]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:14 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0e8b1dee-89ec-42db-a029-568498ce60e4" returned: 0 in 0.448s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:14 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] Lock "cinder-quobyte-0e8b1dee-89ec-42db-a029-568498ce60e4" released by "_copy_volume_from_snapshot" :: held 4.845s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:32:14 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] Acquiring lock "cinder-quobyte-0222fea4-1aad-4fc6-bfbf-8ad0c788fd44" by "_delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:32:14 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] Lock "cinder-quobyte-0222fea4-1aad-4fc6-bfbf-8ad0c788fd44" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:32:14 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] Deleting offline snapshot 0222fea4-1aad-4fc6-bfbf-8ad0c788fd44 of volume ade9918f-1f8a-4b6e-b3aa-fef154760cfd {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:32:14 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] snapshot_file for this snap is: volume-ade9918f-1f8a-4b6e-b3aa-fef154760cfd.0222fea4-1aad-4fc6-bfbf-8ad0c788fd44 {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:32:14 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b60dac9-9614-4154-b29d-17a05b6b9323]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:32:14 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ade9918f-1f8a-4b6e-b3aa-fef154760cfd.0222fea4-1aad-4fc6-bfbf-8ad0c788fd44 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:15 devstack sudo[91313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ade9918f-1f8a-4b6e-b3aa-fef154760cfd.0222fea4-1aad-4fc6-bfbf-8ad0c788fd44
Feb 27 01:32:15 devstack sudo[91313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:15 devstack sudo[91313]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:15 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ade9918f-1f8a-4b6e-b3aa-fef154760cfd.0222fea4-1aad-4fc6-bfbf-8ad0c788fd44" returned: 0 in 0.541s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:15 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ade9918f-1f8a-4b6e-b3aa-fef154760cfd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83106) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:32:15 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[d37d52ee-64a5-4f08-9c66-0b47fb2aa513]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:32:15 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ade9918f-1f8a-4b6e-b3aa-fef154760cfd {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:15 devstack sudo[91319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ade9918f-1f8a-4b6e-b3aa-fef154760cfd
Feb 27 01:32:15 devstack sudo[91319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:15 devstack sudo[91319]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:15 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ade9918f-1f8a-4b6e-b3aa-fef154760cfd" returned: 0 in 0.475s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:15 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ade9918f-1f8a-4b6e-b3aa-fef154760cfd.0222fea4-1aad-4fc6-bfbf-8ad0c788fd44 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:16 devstack sudo[91324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ade9918f-1f8a-4b6e-b3aa-fef154760cfd.0222fea4-1aad-4fc6-bfbf-8ad0c788fd44
Feb 27 01:32:16 devstack sudo[91324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:16 devstack sudo[91324]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:16 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ade9918f-1f8a-4b6e-b3aa-fef154760cfd.0222fea4-1aad-4fc6-bfbf-8ad0c788fd44" returned: 0 in 0.567s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:16 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ade9918f-1f8a-4b6e-b3aa-fef154760cfd.0222fea4-1aad-4fc6-bfbf-8ad0c788fd44 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:16 devstack sudo[91329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ade9918f-1f8a-4b6e-b3aa-fef154760cfd.0222fea4-1aad-4fc6-bfbf-8ad0c788fd44
Feb 27 01:32:16 devstack sudo[91329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:17 devstack sudo[91329]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:17 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ade9918f-1f8a-4b6e-b3aa-fef154760cfd.0222fea4-1aad-4fc6-bfbf-8ad0c788fd44" returned: 0 in 0.447s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:17 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] Lock "cinder-quobyte-0222fea4-1aad-4fc6-bfbf-8ad0c788fd44" released by "_delete_snapshot" :: held 2.078s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:32:17 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.955s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:32:17 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-7efc6ead-e657-4e8f-bdb9-76783ac5ed13 tempest-CinderUnicodeTest-1662562026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.373s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:32:17 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-7efc6ead-e657-4e8f-bdb9-76783ac5ed13 tempest-CinderUnicodeTest-1662562026 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f07e9a55630>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T00:32:08Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-244260619',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82a3319e-553a-4c47-90e2-e518ecc64f46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='087bf5dc6c9a424f8fb1a44da4605edb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T00:32:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T00:32:09Z,use_quota=True,user_id='d807bcde196d4c9f94c7e8e291c06f3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5b0b92-1573-4c64-b215-eb312e3cfee2),volume_type_id=ab5b0b92-1573-4c64-b215-eb312e3cfee2)}" {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 01:32:17 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-7efc6ead-e657-4e8f-bdb9-76783ac5ed13 tempest-CinderUnicodeTest-1662562026 None] Creating volume 82a3319e-553a-4c47-90e2-e518ecc64f46 {{(pid=83106) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 01:32:17 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-7efc6ead-e657-4e8f-bdb9-76783ac5ed13 tempest-CinderUnicodeTest-1662562026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:32:17 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-7efc6ead-e657-4e8f-bdb9-76783ac5ed13 tempest-CinderUnicodeTest-1662562026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:32:17 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-7efc6ead-e657-4e8f-bdb9-76783ac5ed13 tempest-CinderUnicodeTest-1662562026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:32:17 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-7efc6ead-e657-4e8f-bdb9-76783ac5ed13 tempest-CinderUnicodeTest-1662562026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:32:17 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-7efc6ead-e657-4e8f-bdb9-76783ac5ed13 tempest-CinderUnicodeTest-1662562026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:32:17 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-7efc6ead-e657-4e8f-bdb9-76783ac5ed13 tempest-CinderUnicodeTest-1662562026 None] Selected osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c as target Quobyte volume. {{(pid=83106) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 01:32:17 devstack cinder-volume[83106]: INFO cinder.volume.drivers.remotefs [None req-7efc6ead-e657-4e8f-bdb9-76783ac5ed13 tempest-CinderUnicodeTest-1662562026 None] casted to osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c
Feb 27 01:32:17 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7efc6ead-e657-4e8f-bdb9-76783ac5ed13 tempest-CinderUnicodeTest-1662562026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-82a3319e-553a-4c47-90e2-e518ecc64f46 1073741824 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:17 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5f90350-d3c9-4f08-a608-edcbe16b63ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e8b1dee-89ec-42db-a029-568498ce60e4', 'volume_size': 1, 'source_volid': 'ade9918f-1f8a-4b6e-b3aa-fef154760cfd', 'source_volstatus': 'available'}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:32:17 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33451d87-e006-43f2-b9c0-3889f89f2b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:32:17 devstack sudo[91332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-82a3319e-553a-4c47-90e2-e518ecc64f46 1073741824
Feb 27 01:32:17 devstack sudo[91332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:17 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] Volume volume-0e8b1dee-89ec-42db-a029-568498ce60e4 (0e8b1dee-89ec-42db-a029-568498ce60e4): created successfully
Feb 27 01:32:17 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33451d87-e006-43f2-b9c0-3889f89f2b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:32:17 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] Flow 'volume_create_manager' (a5bb304d-e819-40af-91df-99e46070e59b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:32:17 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-a306ded8-bc6c-4404-a2bf-fa9b98b1c0ba tempest-VolumeDependencyTests-1629780687 None] Created volume successfully.
Feb 27 01:32:17 devstack sudo[91332]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:17 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7efc6ead-e657-4e8f-bdb9-76783ac5ed13 tempest-CinderUnicodeTest-1662562026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-82a3319e-553a-4c47-90e2-e518ecc64f46 1073741824" returned: 0 in 0.584s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:17 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7efc6ead-e657-4e8f-bdb9-76783ac5ed13 tempest-CinderUnicodeTest-1662562026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-82a3319e-553a-4c47-90e2-e518ecc64f46 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:17 devstack sudo[91338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-82a3319e-553a-4c47-90e2-e518ecc64f46
Feb 27 01:32:17 devstack sudo[91338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:17 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-20ad3c81-b752-434b-bdaf-13f0729e6b19 tempest-VolumeDependencyTests-1629780687 None] Acquiring lock "cinder-ade9918f-1f8a-4b6e-b3aa-fef154760cfd-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:32:17 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-20ad3c81-b752-434b-bdaf-13f0729e6b19 tempest-VolumeDependencyTests-1629780687 None] Lock "cinder-ade9918f-1f8a-4b6e-b3aa-fef154760cfd-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:32:17 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-20ad3c81-b752-434b-bdaf-13f0729e6b19 tempest-VolumeDependencyTests-1629780687 None] Acquiring lock "cinder-quobyte-ade9918f-1f8a-4b6e-b3aa-fef154760cfd" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:32:17 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-20ad3c81-b752-434b-bdaf-13f0729e6b19 tempest-VolumeDependencyTests-1629780687 None] Lock "cinder-quobyte-ade9918f-1f8a-4b6e-b3aa-fef154760cfd" acquired by "delete_volume" :: waited 0.009s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:32:17 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[77afa508-f551-4971-9ac6-cd0e8d58668e]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:32:17 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-20ad3c81-b752-434b-bdaf-13f0729e6b19 tempest-VolumeDependencyTests-1629780687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ade9918f-1f8a-4b6e-b3aa-fef154760cfd {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:18 devstack sudo[91340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ade9918f-1f8a-4b6e-b3aa-fef154760cfd
Feb 27 01:32:18 devstack sudo[91340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:18 devstack sudo[91338]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:18 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7efc6ead-e657-4e8f-bdb9-76783ac5ed13 tempest-CinderUnicodeTest-1662562026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-82a3319e-553a-4c47-90e2-e518ecc64f46" returned: 0 in 0.493s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:18 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-7efc6ead-e657-4e8f-bdb9-76783ac5ed13 tempest-CinderUnicodeTest-1662562026 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'} {{(pid=83106) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 01:32:18 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-7efc6ead-e657-4e8f-bdb9-76783ac5ed13 tempest-CinderUnicodeTest-1662562026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:32:18 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7efc6ead-e657-4e8f-bdb9-76783ac5ed13 tempest-CinderUnicodeTest-1662562026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcfb5789-295b-42d8-ac2e-095fbb74af1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82a3319e-553a-4c47-90e2-e518ecc64f46', 'volume_size': 1}' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:32:18 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7efc6ead-e657-4e8f-bdb9-76783ac5ed13 tempest-CinderUnicodeTest-1662562026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00ec9072-40c9-4225-a2eb-62c012bb4676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 01:32:18 devstack cinder-volume[83106]: INFO cinder.volume.flows.manager.create_volume [None req-7efc6ead-e657-4e8f-bdb9-76783ac5ed13 tempest-CinderUnicodeTest-1662562026 None] Volume volume-82a3319e-553a-4c47-90e2-e518ecc64f46 (82a3319e-553a-4c47-90e2-e518ecc64f46): created successfully
Feb 27 01:32:18 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7efc6ead-e657-4e8f-bdb9-76783ac5ed13 tempest-CinderUnicodeTest-1662562026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00ec9072-40c9-4225-a2eb-62c012bb4676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83106) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 01:32:18 devstack cinder-volume[83106]: DEBUG cinder.volume.manager [None req-7efc6ead-e657-4e8f-bdb9-76783ac5ed13 tempest-CinderUnicodeTest-1662562026 None] Flow 'volume_create_manager' (ee1aa792-b5be-4298-81f2-be844b106eed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83106) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 01:32:18 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-7efc6ead-e657-4e8f-bdb9-76783ac5ed13 tempest-CinderUnicodeTest-1662562026 None] Created volume successfully.
Feb 27 01:32:18 devstack sudo[91340]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:18 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-20ad3c81-b752-434b-bdaf-13f0729e6b19 tempest-VolumeDependencyTests-1629780687 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ade9918f-1f8a-4b6e-b3aa-fef154760cfd" returned: 0 in 0.550s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:18 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-20ad3c81-b752-434b-bdaf-13f0729e6b19 tempest-VolumeDependencyTests-1629780687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ade9918f-1f8a-4b6e-b3aa-fef154760cfd {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:18 devstack sudo[91347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ade9918f-1f8a-4b6e-b3aa-fef154760cfd
Feb 27 01:32:18 devstack sudo[91347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:18 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-0500ddfc-71de-47b1-bd4e-18e5318babc9 tempest-CinderUnicodeTest-1662562026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:32:18 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-0500ddfc-71de-47b1-bd4e-18e5318babc9 tempest-CinderUnicodeTest-1662562026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:32:18 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-0500ddfc-71de-47b1-bd4e-18e5318babc9 tempest-CinderUnicodeTest-1662562026 None] Creating offline snapshot e2d59a61-2a0c-49df-98c6-7694e58151b9 of volume 82a3319e-553a-4c47-90e2-e518ecc64f46 {{(pid=83106) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 01:32:18 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d8cfa5-41f4-4c64-957e-fdc7f51787e1]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:32:18 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0500ddfc-71de-47b1-bd4e-18e5318babc9 tempest-CinderUnicodeTest-1662562026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-82a3319e-553a-4c47-90e2-e518ecc64f46 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:18 devstack sudo[91349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-82a3319e-553a-4c47-90e2-e518ecc64f46
Feb 27 01:32:18 devstack sudo[91349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:18 devstack sudo[91347]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:18 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-20ad3c81-b752-434b-bdaf-13f0729e6b19 tempest-VolumeDependencyTests-1629780687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-ade9918f-1f8a-4b6e-b3aa-fef154760cfd" returned: 0 in 0.484s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:19 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-20ad3c81-b752-434b-bdaf-13f0729e6b19 tempest-VolumeDependencyTests-1629780687 None] Lock "cinder-quobyte-ade9918f-1f8a-4b6e-b3aa-fef154760cfd" released by "delete_volume" :: held 1.074s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:32:19 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-20ad3c81-b752-434b-bdaf-13f0729e6b19 tempest-VolumeDependencyTests-1629780687 None] Created reservations ['c846765d-f8bf-4edf-b326-d926e1442976', 'c5575a6f-0503-4bed-a260-7336d9f6d338', 'ccf2eba6-766d-4741-9184-a136e2960dd4', '40f5808e-2e31-4ac2-b6fb-d0932406fd7f'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:32:19 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-20ad3c81-b752-434b-bdaf-13f0729e6b19 tempest-VolumeDependencyTests-1629780687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:32:19 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-20ad3c81-b752-434b-bdaf-13f0729e6b19 tempest-VolumeDependencyTests-1629780687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:32:19 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-20ad3c81-b752-434b-bdaf-13f0729e6b19 tempest-VolumeDependencyTests-1629780687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:32:19 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-20ad3c81-b752-434b-bdaf-13f0729e6b19 tempest-VolumeDependencyTests-1629780687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:32:19 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-20ad3c81-b752-434b-bdaf-13f0729e6b19 tempest-VolumeDependencyTests-1629780687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:32:19 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-20ad3c81-b752-434b-bdaf-13f0729e6b19 tempest-VolumeDependencyTests-1629780687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:19 devstack sudo[91355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:32:19 devstack sudo[91355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:19 devstack sudo[91349]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:19 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0500ddfc-71de-47b1-bd4e-18e5318babc9 tempest-CinderUnicodeTest-1662562026 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-82a3319e-553a-4c47-90e2-e518ecc64f46" returned: 0 in 0.618s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:19 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0500ddfc-71de-47b1-bd4e-18e5318babc9 tempest-CinderUnicodeTest-1662562026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-82a3319e-553a-4c47-90e2-e518ecc64f46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-82a3319e-553a-4c47-90e2-e518ecc64f46.e2d59a61-2a0c-49df-98c6-7694e58151b9 1G {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:19 devstack sudo[91357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-82a3319e-553a-4c47-90e2-e518ecc64f46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-82a3319e-553a-4c47-90e2-e518ecc64f46.e2d59a61-2a0c-49df-98c6-7694e58151b9 1G
Feb 27 01:32:19 devstack sudo[91357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:19 devstack sudo[91355]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:19 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-20ad3c81-b752-434b-bdaf-13f0729e6b19 tempest-VolumeDependencyTests-1629780687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.521s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:19 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-20ad3c81-b752-434b-bdaf-13f0729e6b19 tempest-VolumeDependencyTests-1629780687 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:32:19 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-20ad3c81-b752-434b-bdaf-13f0729e6b19 tempest-VolumeDependencyTests-1629780687 None] Deleted volume successfully.
Feb 27 01:32:19 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-20ad3c81-b752-434b-bdaf-13f0729e6b19 tempest-VolumeDependencyTests-1629780687 None] Lock "cinder-ade9918f-1f8a-4b6e-b3aa-fef154760cfd-delete_volume" released by "delete_volume" :: held 1.838s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:32:19 devstack sudo[91357]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:19 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0500ddfc-71de-47b1-bd4e-18e5318babc9 tempest-CinderUnicodeTest-1662562026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-82a3319e-553a-4c47-90e2-e518ecc64f46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-82a3319e-553a-4c47-90e2-e518ecc64f46.e2d59a61-2a0c-49df-98c6-7694e58151b9 1G" returned: 0 in 0.647s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:19 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0500ddfc-71de-47b1-bd4e-18e5318babc9 tempest-CinderUnicodeTest-1662562026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82a3319e-553a-4c47-90e2-e518ecc64f46 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-82a3319e-553a-4c47-90e2-e518ecc64f46.e2d59a61-2a0c-49df-98c6-7694e58151b9 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:19 devstack sudo[91363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82a3319e-553a-4c47-90e2-e518ecc64f46 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-82a3319e-553a-4c47-90e2-e518ecc64f46.e2d59a61-2a0c-49df-98c6-7694e58151b9
Feb 27 01:32:19 devstack sudo[91363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:20 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5ed6f4d7-9dfa-4b29-9a50-1c00445afcd9 tempest-VolumeDependencyTests-1629780687 None] Acquiring lock "cinder-0e8b1dee-89ec-42db-a029-568498ce60e4-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:32:20 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5ed6f4d7-9dfa-4b29-9a50-1c00445afcd9 tempest-VolumeDependencyTests-1629780687 None] Lock "cinder-0e8b1dee-89ec-42db-a029-568498ce60e4-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:32:20 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5ed6f4d7-9dfa-4b29-9a50-1c00445afcd9 tempest-VolumeDependencyTests-1629780687 None] Acquiring lock "cinder-quobyte-0e8b1dee-89ec-42db-a029-568498ce60e4" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:32:20 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5ed6f4d7-9dfa-4b29-9a50-1c00445afcd9 tempest-VolumeDependencyTests-1629780687 None] Lock "cinder-quobyte-0e8b1dee-89ec-42db-a029-568498ce60e4" acquired by "delete_volume" :: waited 0.014s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:32:20 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ca0eab-6d57-48ae-b390-924880b029d8]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:32:20 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5ed6f4d7-9dfa-4b29-9a50-1c00445afcd9 tempest-VolumeDependencyTests-1629780687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0e8b1dee-89ec-42db-a029-568498ce60e4 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:20 devstack sudo[91365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0e8b1dee-89ec-42db-a029-568498ce60e4
Feb 27 01:32:20 devstack sudo[91365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:20 devstack sudo[91363]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:20 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0500ddfc-71de-47b1-bd4e-18e5318babc9 tempest-CinderUnicodeTest-1662562026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82a3319e-553a-4c47-90e2-e518ecc64f46 -F qcow2 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-82a3319e-553a-4c47-90e2-e518ecc64f46.e2d59a61-2a0c-49df-98c6-7694e58151b9" returned: 0 in 0.593s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:20 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-0500ddfc-71de-47b1-bd4e-18e5318babc9 tempest-CinderUnicodeTest-1662562026 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-82a3319e-553a-4c47-90e2-e518ecc64f46.e2d59a61-2a0c-49df-98c6-7694e58151b9 is being set with open permissions: ugo+rw
Feb 27 01:32:20 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0500ddfc-71de-47b1-bd4e-18e5318babc9 tempest-CinderUnicodeTest-1662562026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-82a3319e-553a-4c47-90e2-e518ecc64f46.e2d59a61-2a0c-49df-98c6-7694e58151b9 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:20 devstack sudo[91371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-82a3319e-553a-4c47-90e2-e518ecc64f46.e2d59a61-2a0c-49df-98c6-7694e58151b9
Feb 27 01:32:20 devstack sudo[91371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:20 devstack sudo[91365]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:20 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5ed6f4d7-9dfa-4b29-9a50-1c00445afcd9 tempest-VolumeDependencyTests-1629780687 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0e8b1dee-89ec-42db-a029-568498ce60e4" returned: 0 in 0.624s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:20 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5ed6f4d7-9dfa-4b29-9a50-1c00445afcd9 tempest-VolumeDependencyTests-1629780687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0e8b1dee-89ec-42db-a029-568498ce60e4 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:20 devstack sudo[91376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0e8b1dee-89ec-42db-a029-568498ce60e4
Feb 27 01:32:20 devstack sudo[91376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:20 devstack sudo[91371]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:20 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0500ddfc-71de-47b1-bd4e-18e5318babc9 tempest-CinderUnicodeTest-1662562026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-82a3319e-553a-4c47-90e2-e518ecc64f46.e2d59a61-2a0c-49df-98c6-7694e58151b9" returned: 0 in 0.539s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:21 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0500ddfc-71de-47b1-bd4e-18e5318babc9 tempest-CinderUnicodeTest-1662562026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-82a3319e-553a-4c47-90e2-e518ecc64f46.info {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:21 devstack sudo[91379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-82a3319e-553a-4c47-90e2-e518ecc64f46.info
Feb 27 01:32:21 devstack sudo[91379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:21 devstack sudo[91376]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:21 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5ed6f4d7-9dfa-4b29-9a50-1c00445afcd9 tempest-VolumeDependencyTests-1629780687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-0e8b1dee-89ec-42db-a029-568498ce60e4" returned: 0 in 0.526s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:21 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5ed6f4d7-9dfa-4b29-9a50-1c00445afcd9 tempest-VolumeDependencyTests-1629780687 None] Lock "cinder-quobyte-0e8b1dee-89ec-42db-a029-568498ce60e4" released by "delete_volume" :: held 1.179s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:32:21 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-5ed6f4d7-9dfa-4b29-9a50-1c00445afcd9 tempest-VolumeDependencyTests-1629780687 None] Created reservations ['73d78f12-281b-45c8-8022-a5fce8810d5d', '440d0fa4-64c5-4b2a-81db-2236094963d0', 'fefdce0a-ad2c-40d9-95da-6fba636cce52', '894a02a1-a6eb-4ca9-8fd3-fe6df1ab1ebf'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:32:21 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-5ed6f4d7-9dfa-4b29-9a50-1c00445afcd9 tempest-VolumeDependencyTests-1629780687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:32:21 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-5ed6f4d7-9dfa-4b29-9a50-1c00445afcd9 tempest-VolumeDependencyTests-1629780687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:32:21 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-5ed6f4d7-9dfa-4b29-9a50-1c00445afcd9 tempest-VolumeDependencyTests-1629780687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:32:21 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-5ed6f4d7-9dfa-4b29-9a50-1c00445afcd9 tempest-VolumeDependencyTests-1629780687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:32:21 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-5ed6f4d7-9dfa-4b29-9a50-1c00445afcd9 tempest-VolumeDependencyTests-1629780687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:32:21 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5ed6f4d7-9dfa-4b29-9a50-1c00445afcd9 tempest-VolumeDependencyTests-1629780687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:21 devstack sudo[91382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:32:21 devstack sudo[91382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:21 devstack sudo[91379]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:21 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0500ddfc-71de-47b1-bd4e-18e5318babc9 tempest-CinderUnicodeTest-1662562026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-82a3319e-553a-4c47-90e2-e518ecc64f46.info" returned: 0 in 0.559s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:21 devstack cinder-volume[83106]: WARNING cinder.volume.drivers.remotefs [None req-0500ddfc-71de-47b1-bd4e-18e5318babc9 tempest-CinderUnicodeTest-1662562026 None] /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-82a3319e-553a-4c47-90e2-e518ecc64f46.info is being set with open permissions: ugo+rw
Feb 27 01:32:21 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0500ddfc-71de-47b1-bd4e-18e5318babc9 tempest-CinderUnicodeTest-1662562026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-82a3319e-553a-4c47-90e2-e518ecc64f46.info {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:21 devstack sudo[91385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-82a3319e-553a-4c47-90e2-e518ecc64f46.info
Feb 27 01:32:21 devstack sudo[91385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:21 devstack sudo[91382]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:21 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5ed6f4d7-9dfa-4b29-9a50-1c00445afcd9 tempest-VolumeDependencyTests-1629780687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.464s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:21 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-5ed6f4d7-9dfa-4b29-9a50-1c00445afcd9 tempest-VolumeDependencyTests-1629780687 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:32:21 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-5ed6f4d7-9dfa-4b29-9a50-1c00445afcd9 tempest-VolumeDependencyTests-1629780687 None] Deleted volume successfully.
Feb 27 01:32:21 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5ed6f4d7-9dfa-4b29-9a50-1c00445afcd9 tempest-VolumeDependencyTests-1629780687 None] Lock "cinder-0e8b1dee-89ec-42db-a029-568498ce60e4-delete_volume" released by "delete_volume" :: held 1.846s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:32:22 devstack sudo[91385]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:22 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-0500ddfc-71de-47b1-bd4e-18e5318babc9 tempest-CinderUnicodeTest-1662562026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-82a3319e-553a-4c47-90e2-e518ecc64f46.info" returned: 0 in 0.511s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:22 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-0500ddfc-71de-47b1-bd4e-18e5318babc9 tempest-CinderUnicodeTest-1662562026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.533s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:32:22 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-0500ddfc-71de-47b1-bd4e-18e5318babc9 tempest-CinderUnicodeTest-1662562026 None] Create snapshot completed successfully
Feb 27 01:32:23 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-ae668a42-544b-454c-8637-f5818068748d tempest-CinderUnicodeTest-1662562026 None] Acquiring lock "cinder-e2d59a61-2a0c-49df-98c6-7694e58151b9-delete_snapshot" by "delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:32:23 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-ae668a42-544b-454c-8637-f5818068748d tempest-CinderUnicodeTest-1662562026 None] Lock "cinder-e2d59a61-2a0c-49df-98c6-7694e58151b9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:32:23 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-ae668a42-544b-454c-8637-f5818068748d tempest-CinderUnicodeTest-1662562026 None] Acquiring lock "cinder-quobyte-82a3319e-553a-4c47-90e2-e518ecc64f46" by "delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:32:23 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-ae668a42-544b-454c-8637-f5818068748d tempest-CinderUnicodeTest-1662562026 None] Lock "cinder-quobyte-82a3319e-553a-4c47-90e2-e518ecc64f46" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:32:23 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-ae668a42-544b-454c-8637-f5818068748d tempest-CinderUnicodeTest-1662562026 None] Acquiring lock "cinder-quobyte-e2d59a61-2a0c-49df-98c6-7694e58151b9" by "_delete_snapshot" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:32:23 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-ae668a42-544b-454c-8637-f5818068748d tempest-CinderUnicodeTest-1662562026 None] Lock "cinder-quobyte-e2d59a61-2a0c-49df-98c6-7694e58151b9" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:32:23 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-ae668a42-544b-454c-8637-f5818068748d tempest-CinderUnicodeTest-1662562026 None] Deleting offline snapshot e2d59a61-2a0c-49df-98c6-7694e58151b9 of volume 82a3319e-553a-4c47-90e2-e518ecc64f46 {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 01:32:23 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-ae668a42-544b-454c-8637-f5818068748d tempest-CinderUnicodeTest-1662562026 None] snapshot_file for this snap is: volume-82a3319e-553a-4c47-90e2-e518ecc64f46.e2d59a61-2a0c-49df-98c6-7694e58151b9 {{(pid=83106) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 01:32:23 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[f052bd24-4685-4371-9afb-2e875ec8d867]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:32:23 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ae668a42-544b-454c-8637-f5818068748d tempest-CinderUnicodeTest-1662562026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-82a3319e-553a-4c47-90e2-e518ecc64f46.e2d59a61-2a0c-49df-98c6-7694e58151b9 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:23 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-7808eaad-dbd5-450b-b830-c84097b1d118 tempest-VolumeDependencyTests-1629780687 None] Acquiring lock "cinder-a2c71716-5455-472c-afc3-f5230e47eb3c-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:32:23 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-7808eaad-dbd5-450b-b830-c84097b1d118 tempest-VolumeDependencyTests-1629780687 None] Lock "cinder-a2c71716-5455-472c-afc3-f5230e47eb3c-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:32:23 devstack sudo[91390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-82a3319e-553a-4c47-90e2-e518ecc64f46.e2d59a61-2a0c-49df-98c6-7694e58151b9
Feb 27 01:32:23 devstack sudo[91390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:23 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-7808eaad-dbd5-450b-b830-c84097b1d118 tempest-VolumeDependencyTests-1629780687 None] Acquiring lock "cinder-quobyte-a2c71716-5455-472c-afc3-f5230e47eb3c" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:32:23 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-7808eaad-dbd5-450b-b830-c84097b1d118 tempest-VolumeDependencyTests-1629780687 None] Lock "cinder-quobyte-a2c71716-5455-472c-afc3-f5230e47eb3c" acquired by "delete_volume" :: waited 0.011s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:32:23 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c94524d-9cc2-45df-9efd-1d6b8e63952c]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:32:23 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7808eaad-dbd5-450b-b830-c84097b1d118 tempest-VolumeDependencyTests-1629780687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-a2c71716-5455-472c-afc3-f5230e47eb3c {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:23 devstack sudo[91392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-a2c71716-5455-472c-afc3-f5230e47eb3c
Feb 27 01:32:23 devstack sudo[91392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:23 devstack sudo[91390]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:23 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ae668a42-544b-454c-8637-f5818068748d tempest-CinderUnicodeTest-1662562026 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-82a3319e-553a-4c47-90e2-e518ecc64f46.e2d59a61-2a0c-49df-98c6-7694e58151b9" returned: 0 in 0.497s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:23 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.remotefs [None req-ae668a42-544b-454c-8637-f5818068748d tempest-CinderUnicodeTest-1662562026 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82a3319e-553a-4c47-90e2-e518ecc64f46(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83106) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 01:32:23 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[175ca1c7-8608-4f42-9139-a7695b82ae91]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:32:23 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ae668a42-544b-454c-8637-f5818068748d tempest-CinderUnicodeTest-1662562026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-82a3319e-553a-4c47-90e2-e518ecc64f46 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:23 devstack sudo[91397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-82a3319e-553a-4c47-90e2-e518ecc64f46
Feb 27 01:32:23 devstack sudo[91397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:23 devstack sudo[91392]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:23 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7808eaad-dbd5-450b-b830-c84097b1d118 tempest-VolumeDependencyTests-1629780687 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-a2c71716-5455-472c-afc3-f5230e47eb3c" returned: 0 in 0.503s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:23 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7808eaad-dbd5-450b-b830-c84097b1d118 tempest-VolumeDependencyTests-1629780687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-a2c71716-5455-472c-afc3-f5230e47eb3c {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:23 devstack sudo[91402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-a2c71716-5455-472c-afc3-f5230e47eb3c
Feb 27 01:32:23 devstack sudo[91402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:24 devstack sudo[91397]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:24 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ae668a42-544b-454c-8637-f5818068748d tempest-CinderUnicodeTest-1662562026 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-82a3319e-553a-4c47-90e2-e518ecc64f46" returned: 0 in 0.518s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:24 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ae668a42-544b-454c-8637-f5818068748d tempest-CinderUnicodeTest-1662562026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-82a3319e-553a-4c47-90e2-e518ecc64f46.e2d59a61-2a0c-49df-98c6-7694e58151b9 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:24 devstack sudo[91409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-82a3319e-553a-4c47-90e2-e518ecc64f46.e2d59a61-2a0c-49df-98c6-7694e58151b9
Feb 27 01:32:24 devstack sudo[91409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:24 devstack sudo[91402]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:24 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7808eaad-dbd5-450b-b830-c84097b1d118 tempest-VolumeDependencyTests-1629780687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-a2c71716-5455-472c-afc3-f5230e47eb3c" returned: 0 in 0.427s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:24 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-7808eaad-dbd5-450b-b830-c84097b1d118 tempest-VolumeDependencyTests-1629780687 None] Lock "cinder-quobyte-a2c71716-5455-472c-afc3-f5230e47eb3c" released by "delete_volume" :: held 0.962s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:32:24 devstack sudo[91409]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:24 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ae668a42-544b-454c-8637-f5818068748d tempest-CinderUnicodeTest-1662562026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-82a3319e-553a-4c47-90e2-e518ecc64f46.e2d59a61-2a0c-49df-98c6-7694e58151b9" returned: 0 in 0.532s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:24 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ae668a42-544b-454c-8637-f5818068748d tempest-CinderUnicodeTest-1662562026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-82a3319e-553a-4c47-90e2-e518ecc64f46.e2d59a61-2a0c-49df-98c6-7694e58151b9 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:24 devstack sudo[91415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-82a3319e-553a-4c47-90e2-e518ecc64f46.e2d59a61-2a0c-49df-98c6-7694e58151b9
Feb 27 01:32:24 devstack sudo[91415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:24 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-7808eaad-dbd5-450b-b830-c84097b1d118 tempest-VolumeDependencyTests-1629780687 None] Created reservations ['0a8b33af-b703-4d1b-8ce0-8d87995bc008', '8d974d05-a5ef-4fff-b14e-8cc9863751a8', '7daf5268-8c17-4239-9e8d-9291835e9749', 'da45245a-2ddc-4d4c-ad11-b4d05ed68386'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:32:25 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-7808eaad-dbd5-450b-b830-c84097b1d118 tempest-VolumeDependencyTests-1629780687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:32:25 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-7808eaad-dbd5-450b-b830-c84097b1d118 tempest-VolumeDependencyTests-1629780687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:32:25 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-7808eaad-dbd5-450b-b830-c84097b1d118 tempest-VolumeDependencyTests-1629780687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:32:25 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-7808eaad-dbd5-450b-b830-c84097b1d118 tempest-VolumeDependencyTests-1629780687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:32:25 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-7808eaad-dbd5-450b-b830-c84097b1d118 tempest-VolumeDependencyTests-1629780687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:32:25 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7808eaad-dbd5-450b-b830-c84097b1d118 tempest-VolumeDependencyTests-1629780687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:25 devstack sudo[91418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:32:25 devstack sudo[91418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:25 devstack sudo[91415]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:25 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-ae668a42-544b-454c-8637-f5818068748d tempest-CinderUnicodeTest-1662562026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-82a3319e-553a-4c47-90e2-e518ecc64f46.e2d59a61-2a0c-49df-98c6-7694e58151b9" returned: 0 in 0.422s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:25 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-ae668a42-544b-454c-8637-f5818068748d tempest-CinderUnicodeTest-1662562026 None] Lock "cinder-quobyte-e2d59a61-2a0c-49df-98c6-7694e58151b9" released by "_delete_snapshot" :: held 2.036s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:32:25 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-ae668a42-544b-454c-8637-f5818068748d tempest-CinderUnicodeTest-1662562026 None] Lock "cinder-quobyte-82a3319e-553a-4c47-90e2-e518ecc64f46" released by "delete_snapshot" :: held 2.049s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:32:25 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-ae668a42-544b-454c-8637-f5818068748d tempest-CinderUnicodeTest-1662562026 None] Created reservations ['ad9b1986-d2f7-4e5f-9448-9d2790eec63c', '856b2e19-ee13-42f0-9b4b-1b342a8a242d', '81ddeb58-ba33-404c-afa5-241686597c6e', '3925e88a-e1b2-4342-a2e9-8962e89361ad'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:32:25 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-ae668a42-544b-454c-8637-f5818068748d tempest-CinderUnicodeTest-1662562026 None] Delete snapshot completed successfully.
Feb 27 01:32:25 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-ae668a42-544b-454c-8637-f5818068748d tempest-CinderUnicodeTest-1662562026 None] Lock "cinder-e2d59a61-2a0c-49df-98c6-7694e58151b9-delete_snapshot" released by "delete_snapshot" :: held 2.151s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:32:25 devstack sudo[91418]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:25 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-7808eaad-dbd5-450b-b830-c84097b1d118 tempest-VolumeDependencyTests-1629780687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.454s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:25 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-7808eaad-dbd5-450b-b830-c84097b1d118 tempest-VolumeDependencyTests-1629780687 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:32:25 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5534a65f-a9ce-4d78-987d-fd34f4542948 tempest-CinderUnicodeTest-1662562026 None] Acquiring lock "cinder-82a3319e-553a-4c47-90e2-e518ecc64f46-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:32:25 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-7808eaad-dbd5-450b-b830-c84097b1d118 tempest-VolumeDependencyTests-1629780687 None] Deleted volume successfully.
Feb 27 01:32:25 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5534a65f-a9ce-4d78-987d-fd34f4542948 tempest-CinderUnicodeTest-1662562026 None] Lock "cinder-82a3319e-553a-4c47-90e2-e518ecc64f46-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:32:25 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-7808eaad-dbd5-450b-b830-c84097b1d118 tempest-VolumeDependencyTests-1629780687 None] Lock "cinder-a2c71716-5455-472c-afc3-f5230e47eb3c-delete_volume" released by "delete_volume" :: held 2.495s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:32:25 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5534a65f-a9ce-4d78-987d-fd34f4542948 tempest-CinderUnicodeTest-1662562026 None] Acquiring lock "cinder-quobyte-82a3319e-553a-4c47-90e2-e518ecc64f46" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:32:25 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5534a65f-a9ce-4d78-987d-fd34f4542948 tempest-CinderUnicodeTest-1662562026 None] Lock "cinder-quobyte-82a3319e-553a-4c47-90e2-e518ecc64f46" acquired by "delete_volume" :: waited 0.008s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:32:25 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5bbc50-28e1-4b05-ac64-9fa06e55ce19]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:32:25 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5534a65f-a9ce-4d78-987d-fd34f4542948 tempest-CinderUnicodeTest-1662562026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-82a3319e-553a-4c47-90e2-e518ecc64f46 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:25 devstack sudo[91421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-82a3319e-553a-4c47-90e2-e518ecc64f46
Feb 27 01:32:25 devstack sudo[91421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:26 devstack sudo[91421]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:26 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5534a65f-a9ce-4d78-987d-fd34f4542948 tempest-CinderUnicodeTest-1662562026 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-82a3319e-553a-4c47-90e2-e518ecc64f46" returned: 0 in 0.504s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:26 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5534a65f-a9ce-4d78-987d-fd34f4542948 tempest-CinderUnicodeTest-1662562026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-82a3319e-553a-4c47-90e2-e518ecc64f46 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:26 devstack sudo[91426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-82a3319e-553a-4c47-90e2-e518ecc64f46
Feb 27 01:32:26 devstack sudo[91426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:26 devstack sudo[91426]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:26 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5534a65f-a9ce-4d78-987d-fd34f4542948 tempest-CinderUnicodeTest-1662562026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-82a3319e-553a-4c47-90e2-e518ecc64f46" returned: 0 in 0.433s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:26 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5534a65f-a9ce-4d78-987d-fd34f4542948 tempest-CinderUnicodeTest-1662562026 None] Lock "cinder-quobyte-82a3319e-553a-4c47-90e2-e518ecc64f46" released by "delete_volume" :: held 0.969s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:32:27 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-5534a65f-a9ce-4d78-987d-fd34f4542948 tempest-CinderUnicodeTest-1662562026 None] Created reservations ['191049fb-d878-4a38-9edd-ed4091f767b1', '5e631949-4ad3-4228-9978-1561fcb53363', 'e9eaead9-70f9-4983-90e3-323afb5fcd15', '89d1cec9-369f-43d0-a315-7a86b500ed40'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:32:28 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-5534a65f-a9ce-4d78-987d-fd34f4542948 tempest-CinderUnicodeTest-1662562026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:32:28 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-5534a65f-a9ce-4d78-987d-fd34f4542948 tempest-CinderUnicodeTest-1662562026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:32:28 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-5534a65f-a9ce-4d78-987d-fd34f4542948 tempest-CinderUnicodeTest-1662562026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:32:28 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-5534a65f-a9ce-4d78-987d-fd34f4542948 tempest-CinderUnicodeTest-1662562026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:32:28 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-5534a65f-a9ce-4d78-987d-fd34f4542948 tempest-CinderUnicodeTest-1662562026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:32:28 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5534a65f-a9ce-4d78-987d-fd34f4542948 tempest-CinderUnicodeTest-1662562026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:28 devstack sudo[91429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:32:28 devstack sudo[91429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:28 devstack sudo[91429]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:28 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-5534a65f-a9ce-4d78-987d-fd34f4542948 tempest-CinderUnicodeTest-1662562026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.397s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:28 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-5534a65f-a9ce-4d78-987d-fd34f4542948 tempest-CinderUnicodeTest-1662562026 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:32:28 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-5534a65f-a9ce-4d78-987d-fd34f4542948 tempest-CinderUnicodeTest-1662562026 None] Deleted volume successfully.
Feb 27 01:32:28 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-d9062724-5a20-4e9c-92c4-1b507964ae23 tempest-CinderUnicodeTest-1662562026 None] Acquiring lock "cinder-b0af0dc4-e417-48b1-8ead-0a8da0063eec-delete_volume" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:32:28 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-d9062724-5a20-4e9c-92c4-1b507964ae23 tempest-CinderUnicodeTest-1662562026 None] Lock "cinder-b0af0dc4-e417-48b1-8ead-0a8da0063eec-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:32:28 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-5534a65f-a9ce-4d78-987d-fd34f4542948 tempest-CinderUnicodeTest-1662562026 None] Lock "cinder-82a3319e-553a-4c47-90e2-e518ecc64f46-delete_volume" released by "delete_volume" :: held 3.258s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:32:29 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-d9062724-5a20-4e9c-92c4-1b507964ae23 tempest-CinderUnicodeTest-1662562026 None] Acquiring lock "cinder-quobyte-b0af0dc4-e417-48b1-8ead-0a8da0063eec" by "delete_volume" {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 01:32:29 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-d9062724-5a20-4e9c-92c4-1b507964ae23 tempest-CinderUnicodeTest-1662562026 None] Lock "cinder-quobyte-b0af0dc4-e417-48b1-8ead-0a8da0063eec" acquired by "delete_volume" :: waited 0.009s {{(pid=83106) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 01:32:29 devstack cinder-volume[83106]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f81f84e-dd17-4c57-bc94-8fcc259d73da]: (4, 'qcow2') {{(pid=84063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 01:32:29 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d9062724-5a20-4e9c-92c4-1b507964ae23 tempest-CinderUnicodeTest-1662562026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b0af0dc4-e417-48b1-8ead-0a8da0063eec {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:29 devstack sudo[91432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b0af0dc4-e417-48b1-8ead-0a8da0063eec
Feb 27 01:32:29 devstack sudo[91432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:30 devstack sudo[91432]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:30 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d9062724-5a20-4e9c-92c4-1b507964ae23 tempest-CinderUnicodeTest-1662562026 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b0af0dc4-e417-48b1-8ead-0a8da0063eec" returned: 0 in 0.490s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:30 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d9062724-5a20-4e9c-92c4-1b507964ae23 tempest-CinderUnicodeTest-1662562026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b0af0dc4-e417-48b1-8ead-0a8da0063eec {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:30 devstack sudo[91437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b0af0dc4-e417-48b1-8ead-0a8da0063eec
Feb 27 01:32:30 devstack sudo[91437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:30 devstack sudo[91437]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:30 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d9062724-5a20-4e9c-92c4-1b507964ae23 tempest-CinderUnicodeTest-1662562026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514/volume-b0af0dc4-e417-48b1-8ead-0a8da0063eec" returned: 0 in 0.458s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:30 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-d9062724-5a20-4e9c-92c4-1b507964ae23 tempest-CinderUnicodeTest-1662562026 None] Lock "cinder-quobyte-b0af0dc4-e417-48b1-8ead-0a8da0063eec" released by "delete_volume" :: held 0.973s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:32:31 devstack cinder-volume[83106]: DEBUG cinder.quota [None req-d9062724-5a20-4e9c-92c4-1b507964ae23 tempest-CinderUnicodeTest-1662562026 None] Created reservations ['c13a0e29-f1b3-4430-95b0-4088c0ab4660', 'cbbcabca-f7b9-46f7-98ba-d02a985ac67a', '9f1b3a0c-228c-4b99-90a1-204326bbe279', 'ba8a34d4-8831-48d1-aee0-9107dc0d6bf7'] {{(pid=83106) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 01:32:32 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-d9062724-5a20-4e9c-92c4-1b507964ae23 tempest-CinderUnicodeTest-1662562026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 01:32:32 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-d9062724-5a20-4e9c-92c4-1b507964ae23 tempest-CinderUnicodeTest-1662562026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 01:32:32 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-d9062724-5a20-4e9c-92c4-1b507964ae23 tempest-CinderUnicodeTest-1662562026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c': None} {{(pid=83106) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 01:32:32 devstack cinder-volume[83106]: DEBUG cinder.volume.drivers.quobyte [None req-d9062724-5a20-4e9c-92c4-1b507964ae23 tempest-CinderUnicodeTest-1662562026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c3f7a454-5cdf-46cc-b08a-9f05c0c50c7c'] {{(pid=83106) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 01:32:32 devstack cinder-volume[83106]: DEBUG oslo_concurrency.lockutils [None req-d9062724-5a20-4e9c-92c4-1b507964ae23 tempest-CinderUnicodeTest-1662562026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83106) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 01:32:32 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d9062724-5a20-4e9c-92c4-1b507964ae23 tempest-CinderUnicodeTest-1662562026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514 {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:32:33 devstack sudo[91441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514
Feb 27 01:32:33 devstack sudo[91441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:32:33 devstack sudo[91441]: pam_unix(sudo:session): session closed for user root
Feb 27 01:32:33 devstack cinder-volume[83106]: DEBUG oslo_concurrency.processutils [None req-d9062724-5a20-4e9c-92c4-1b507964ae23 tempest-CinderUnicodeTest-1662562026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d7a8beb01d574009e86477d6c6300514" returned: 0 in 0.393s {{(pid=83106) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:32:33 devstack cinder-volume[83106]: DEBUG cinder.manager [None req-d9062724-5a20-4e9c-92c4-1b507964ae23 tempest-CinderUnicodeTest-1662562026 None] Notifying Schedulers of capabilities ... {{(pid=83106) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:32:33 devstack cinder-volume[83106]: INFO cinder.volume.manager [None req-d9062724-5a20-4e9c-92c4-1b507964ae23 tempest-CinderUnicodeTest-1662562026 None] Deleted volume successfully.
Feb 27 01:32:34 devstack cinder-volume[83106]: DEBUG cinder.coordination [None req-d9062724-5a20-4e9c-92c4-1b507964ae23 tempest-CinderUnicodeTest-1662562026 None] Lock "cinder-b0af0dc4-e417-48b1-8ead-0a8da0063eec-delete_volume" released by "delete_volume" :: held 5.720s {{(pid=83106) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 01:32:41 devstack cinder-volume[83106]: DEBUG dbcounter [-] [83106] Writing DB stats cinder:UPDATE=142,cinder:INSERT=43,cinder:DELETE=8,cinder:SELECT=105 {{(pid=83106) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 01:32:43 devstack cinder-volume[83106]: DEBUG dbcounter [-] [83106] Writing DB stats cinder:SELECT=89,cinder:UPDATE=149,cinder:INSERT=29,cinder:DELETE=13 {{(pid=83106) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}